2024-03-31T22:56:28.260 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-31T22:56:28.260 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} --archive /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125 -- /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/orig.config.yaml 2024-03-31T22:56:28.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T22:56:28.416 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7633125' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8238 sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 sleep_before_teardown: 0 subset: 361/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvUcKd3SyFURE3ILlmt0Z6gGd4TVHZRQRPwyWFY/VKOqrg/OCaoq0ToE4Ian4POCp0giAwCNN9E0XfhKanAXK8= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkZbnGd8pqbczM/ZBS2szp0CmZx2ppPWntj6csK09G7XQRPi093Syc86e/oc9AVHvEbJxEXhYk/GJJwuGmm530= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7MZzq2K1goC/DqjRUlf8fhx7WwqTPnMTpVFDWxGyRJ4v4bJqhXZRk0Bcp8DMa7wmwLTUkJZJScDwlLGlZXWug= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-31_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-31T22:56:28.416 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa; will attempt to use it 2024-03-31T22:56:28.416 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks 2024-03-31T22:56:28.417 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-31T22:56:28.418 INFO:teuthology.task.internal:Checking packages... 2024-03-31T22:56:28.442 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '384f31f3d3aee7f8ba3f60846b8844c049165583' 2024-03-31T22:56:28.442 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-31T22:56:28.442 INFO:teuthology.packaging:ref: None 2024-03-31T22:56:28.442 INFO:teuthology.packaging:tag: None 2024-03-31T22:56:28.442 INFO:teuthology.packaging:branch: squid 2024-03-31T22:56:28.442 INFO:teuthology.packaging:sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T22:56:28.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-03-31T22:56:28.616 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1977.g384f31f3 2024-03-31T22:56:28.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-31T22:56:28.624 INFO:teuthology.task.internal:no buildpackages task found 2024-03-31T22:56:28.624 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-31T22:56:28.644 INFO:teuthology.task.internal:Saving configuration 2024-03-31T22:56:28.667 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-31T22:56:28.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T22:56:28.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 22:51:27.015216', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvUcKd3SyFURE3ILlmt0Z6gGd4TVHZRQRPwyWFY/VKOqrg/OCaoq0ToE4Ian4POCp0giAwCNN9E0XfhKanAXK8='} 2024-03-31T22:56:28.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 22:51:27.012404', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkZbnGd8pqbczM/ZBS2szp0CmZx2ppPWntj6csK09G7XQRPi093Syc86e/oc9AVHvEbJxEXhYk/GJJwuGmm530='} 2024-03-31T22:56:28.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 22:51:27.013941', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7MZzq2K1goC/DqjRUlf8fhx7WwqTPnMTpVFDWxGyRJ4v4bJqhXZRk0Bcp8DMa7wmwLTUkJZJScDwlLGlZXWug='} 2024-03-31T22:56:28.751 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-31T22:56:28.757 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-31T22:56:28.757 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-31T22:56:28.757 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-31T22:56:28.757 INFO:teuthology.run_tasks:Running task console_log... 2024-03-31T22:56:28.861 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65db27f160>, signals=[15]) 2024-03-31T22:56:28.861 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-31T22:56:28.867 INFO:teuthology.task.internal:Opening connections... 2024-03-31T22:56:28.868 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T22:56:28.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T22:56:28.982 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-03-31T22:56:28.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T22:56:29.070 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-03-31T22:56:29.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T22:56:29.159 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-31T22:56:29.165 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-03-31T22:56:29.184 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-03-31T22:56:29.184 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-03-31T22:56:29.242 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-03-31T22:56:29.242 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T22:56:29.243 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T22:56:29.244 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-03-31T22:56:29.267 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-03-31T22:56:29.285 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-03-31T22:56:29.285 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-03-31T22:56:29.341 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-03-31T22:56:29.341 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-03-31T22:56:29.341 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T22:56:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T22:56:29.343 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-03-31T22:56:29.367 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-03-31T22:56:29.385 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-03-31T22:56:29.385 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-03-31T22:56:29.442 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-03-31T22:56:29.442 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-03-31T22:56:29.442 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-03-31T22:56:29.442 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-03-31T22:56:29.442 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-03-31T22:56:29.442 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T22:56:29.443 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T22:56:29.443 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-03-31T22:56:29.467 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-31T22:56:29.478 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-31T22:56:29.484 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-31T22:56:29.484 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-03-31T22:56:29.487 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-03-31T22:56:29.489 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-03-31T22:56:29.505 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-31T22:56:29.511 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-31T22:56:29.511 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-03-31T22:56:29.546 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-03-31T22:56:29.548 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-03-31T22:56:29.639 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-31T22:56:29.713 INFO:teuthology.run_tasks:Running task kernel... 2024-03-31T22:56:29.729 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-31T22:56:29.729 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-03-31T22:56:29.729 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-03-31T22:56:29.729 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-31T22:56:29.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T22:56:29.746 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-03-31T22:56:29.803 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-361.el9.x86_64 2024-03-31T22:56:29.804 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-361.el9.x86_64 2024-03-31T22:56:29.804 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-03-31T22:56:31.982 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-31T22:56:33.415 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2024-03-31T22:56:42.363 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 957 kB/s | 8.0 MB 00:08 2024-03-31T22:56:45.106 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-03-31T22:56:49.426 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-31T22:56:50.924 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-03-31T22:56:52.634 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-31T22:56:57.834 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-31T22:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-31T22:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-31T22:57:00.258 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-03-31T22:57:00.278 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-03-31T22:57:00.278 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-03-31T22:57:00.278 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-03-31T22:57:00.278 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-03-31T22:57:00.278 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 76 M 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 123 M 2024-03-31T22:57:00.279 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-03-31T22:57:00.444 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-03-31T22:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 26 MB/s | 15 MB 00:00 2024-03-31T22:57:01.486 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 28 MB/s | 34 MB 00:01 2024-03-31T22:57:01.845 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 20 MB/s | 28 MB 00:01 2024-03-31T22:57:01.848 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-03-31T22:57:01.848 INFO:teuthology.orchestra.run.smithi042.stdout:Total 49 MB/s | 76 MB 00:01 2024-03-31T22:57:01.848 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-03-31T22:57:02.290 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-03-31T22:57:02.290 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-03-31T22:57:03.178 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-03-31T22:57:03.179 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-03-31T22:57:05.612 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-03-31T22:57:06.326 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-31T22:57:06.421 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T22:57:09.336 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T22:57:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T22:57:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T22:57:14.600 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-31T22:57:19.695 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T22:57:50.967 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T22:57:50.967 INFO:teuthology.orchestra.run.smithi042.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-31T22:57:50.967 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:51.011 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-31T22:57:51.390 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-31T22:57:51.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-31T22:57:51.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T22:57:51.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T22:57:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:51.833 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-03-31T22:57:52.171 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-03-31T22:57:52.277 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-31T22:57:52.277 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-31T22:57:52.277 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-31T22:57:52.278 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-31T22:57:52.278 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-31T22:57:52.278 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-31T22:57:52.278 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-03-31T22:57:52.278 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-03-31T22:57:52.361 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-31T22:57:52.361 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-31T22:57:52.361 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-03-31T22:57:52.409 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-03-31T22:57:52.409 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-03-31T22:57:52.409 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-03-31T22:57:52.409 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 68.el9 2024-03-31T22:57:52.409 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8264254 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:52.410 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-31T22:57:52.411 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-31T22:57:52.411 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-31T22:57:52.411 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-03-31T22:57:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T22:57:52.411 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-03-31T22:57:52.412 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-31T22:57:52.412 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-434.el9.x86_64 2024-03-31T22:57:52.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-31T22:57:52.982 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-03-31T22:57:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-31T22:57:54.381 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-03-31T22:57:54.389 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-03-31T22:57:54.406 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.zDHweosEuO 2024-03-31T22:57:54.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zDHweosEuO 2024-03-31T22:57:54.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.zDHweosEuO 2024-03-31T22:57:54.620 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.zDHweosEuO is 6KB 2024-03-31T22:57:54.669 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.zDHweosEuO 2024-03-31T22:57:54.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-03-31T22:57:54.759 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-31T22:57:54.759 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-31T22:57:54.759 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-31T22:57:54.759 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-31T22:57:54.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-31T22:57:54.910 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-03-31T22:58:24.913 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-31T22:58:24.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-31T22:58:24.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T22:58:43.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-31T22:58:52.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-31T22:58:52.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T22:59:52.363 DEBUG:teuthology.orchestra.remote:timed out 2024-03-31T23:00:04.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-31T23:00:04.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T23:00:04.714 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-03-31T23:00:05.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-31T23:00:05.107 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-434.el9.x86_64"... 2024-03-31T23:00:05.107 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-03-31T23:00:05.122 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-434.el9.x86_64 2024-03-31T23:00:05.123 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-31T23:00:05.123 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-31T23:00:05.123 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-31T23:00:06.124 DEBUG:teuthology.parallel:result is None 2024-03-31T23:00:06.124 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-31T23:00:06.132 INFO:teuthology.task.internal:Creating test directory... 2024-03-31T23:00:06.132 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-31T23:00:06.135 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-31T23:00:06.138 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-31T23:00:06.156 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-31T23:00:06.162 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-31T23:00:06.173 INFO:teuthology.task.internal:Creating archive directory... 2024-03-31T23:00:06.173 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-31T23:00:06.193 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-31T23:00:06.196 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-31T23:00:06.505 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-31T23:00:06.512 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-31T23:00:06.512 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-31T23:00:06.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:00:06.528 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-31T23:00:06.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:00:06.545 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-31T23:00:06.548 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-31T23:00:06.571 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-31T23:00:06.632 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T23:00:06.633 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T23:00:06.641 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T23:00:06.654 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T23:00:06.655 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T23:00:06.673 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T23:00:06.675 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-31T23:00:06.682 INFO:teuthology.task.internal:Configuring sudo... 2024-03-31T23:00:06.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-31T23:00:06.685 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-31T23:00:06.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-31T23:00:06.717 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-31T23:00:06.727 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-31T23:00:06.727 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-31T23:00:06.755 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-31T23:00:06.757 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-31T23:00:06.772 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T23:00:06.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T23:00:06.901 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T23:00:06.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T23:00:07.028 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:00:07.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-31T23:00:07.096 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T23:00:07.141 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T23:00:07.196 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T23:00:07.280 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T23:00:07.323 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:00:07.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-31T23:00:07.392 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T23:00:07.435 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T23:00:07.495 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T23:00:07.579 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T23:00:07.625 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:00:07.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-31T23:00:07.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-03-31T23:00:07.697 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-03-31T23:00:07.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-03-31T23:00:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T23:00:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T23:00:07.777 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T23:00:08.248 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-31T23:00:08.257 INFO:teuthology.task.internal:Starting timer... 2024-03-31T23:00:08.257 INFO:teuthology.run_tasks:Running task pcp... 2024-03-31T23:00:08.267 INFO:teuthology.run_tasks:Running task selinux... 2024-03-31T23:00:08.276 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-03-31T23:00:08.276 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-03-31T23:00:08.330 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-03-31T23:00:08.331 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-03-31T23:00:08.414 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-03-31T23:00:08.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2024-03-31T23:00:08.489 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2024-03-31T23:00:08.491 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-31T23:00:08.491 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-03-31T23:00:08.510 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-03-31T23:00:08.510 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-03-31T23:00:08.532 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-03-31T23:00:08.533 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2024-03-31T23:00:08.553 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2024-03-31T23:00:08.553 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2024-03-31T23:00:08.553 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T23:00:08.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:00:08.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T23:00:08.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:00:08.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T23:00:08.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:00:08.637 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-31T23:00:08.638 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-03-31T23:00:08.670 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-03-31T23:00:08.717 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2024-03-31T23:00:08.755 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-31T23:00:08.765 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-31T23:00:08.770 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-31T23:00:08.898 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-31T23:00:08.914 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-31T23:00:08.915 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi094.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-31T23:04:42.415 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-03-31T23:04:42.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-31T23:04:42.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T23:04:42.508 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-03-31T23:04:42.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-31T23:04:42.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-31T23:04:42.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T23:04:42.682 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-03-31T23:04:42.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-31T23:04:42.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-03-31T23:04:42.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T23:04:42.843 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-03-31T23:04:42.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-03-31T23:04:42.915 INFO:teuthology.run_tasks:Running task clock... 2024-03-31T23:04:42.925 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-31T23:04:42.925 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-31T23:04:42.926 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T23:04:42.928 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-31T23:04:42.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T23:04:42.931 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-31T23:04:42.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T23:04:42.957 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-31T23:04:42.961 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-31T23:04:42.974 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-31T23:04:42.978 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-31T23:04:42.986 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-31T23:04:43.003 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-03-31T23:04:43.003 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-31T23:04:43.007 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-03-31T23:04:43.016 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-03-31T23:04:43.022 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-03-31T23:04:43.032 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-31T23:04:43.033 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2024-03-31T23:04:43.038 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-31T23:04:43.047 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2024-03-31T23:04:43.048 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-31T23:04:43.054 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-31T23:04:43.064 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-31T23:04:43.080 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-31T23:04:43.098 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.102 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-03-31T23:04:43.106 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T23:04:43.106 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-03-31T23:04:43.106 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.106 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.106 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.106 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.123 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-03-31T23:04:43.126 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T23:04:43.126 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-03-31T23:04:43.127 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.127 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.127 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.127 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:04:43.128 INFO:teuthology.run_tasks:Running task install... 2024-03-31T23:04:43.136 DEBUG:teuthology.task.install:project ceph 2024-03-31T23:04:43.136 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'}} 2024-03-31T23:04:43.136 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'} 2024-03-31T23:04:43.136 INFO:teuthology.task.install:Using flavor: default 2024-03-31T23:04:43.145 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-31T23:04:43.145 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-31T23:04:43.146 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'tag': None, 'wait_for_package': False} 2024-03-31T23:04:43.146 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:04:43.148 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'tag': None, 'wait_for_package': False} 2024-03-31T23:04:43.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:04:43.149 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'tag': None, 'wait_for_package': False} 2024-03-31T23:04:43.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:04:43.292 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/ 2024-03-31T23:04:43.292 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1977.g384f31f3 2024-03-31T23:04:43.381 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/ 2024-03-31T23:04:43.381 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1977.g384f31f3 2024-03-31T23:04:43.384 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/ 2024-03-31T23:04:43.384 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1977.g384f31f3 2024-03-31T23:04:43.404 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-31T23:04:43.405 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:04:43.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-31T23:04:43.436 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-31T23:04:43.436 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384f31f3d3aee7f8ba3f60846b8844c049165583/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-31T23:04:43.504 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-31T23:04:43.553 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-31T23:04:43.553 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:04:43.553 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-31T23:04:43.561 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-31T23:04:43.561 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:04:43.562 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-31T23:04:43.583 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-31T23:04:43.583 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384f31f3d3aee7f8ba3f60846b8844c049165583/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-31T23:04:43.584 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-31T23:04:43.590 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-31T23:04:43.590 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384f31f3d3aee7f8ba3f60846b8844c049165583/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-31T23:04:43.650 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-03-31T23:04:43.651 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-31T23:04:43.652 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-03-31T23:04:43.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-31T23:04:43.733 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-31T23:04:43.741 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-31T23:04:43.799 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-03-31T23:04:43.801 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-03-31T23:04:43.807 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2024-03-31T23:04:43.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-03-31T23:04:43.888 INFO:teuthology.orchestra.run.smithi094.stdout:74 files removed 2024-03-31T23:04:43.915 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-31T23:04:44.042 INFO:teuthology.orchestra.run.smithi188.stdout:74 files removed 2024-03-31T23:04:44.058 INFO:teuthology.orchestra.run.smithi042.stdout:74 files removed 2024-03-31T23:04:44.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-31T23:04:44.086 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-31T23:04:44.557 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 237 kB/s | 83 kB 00:00 2024-03-31T23:04:44.783 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 213 kB/s | 83 kB 00:00 2024-03-31T23:04:44.786 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 195 kB/s | 83 kB 00:00 2024-03-31T23:04:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-03-31T23:04:45.137 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-03-31T23:04:45.209 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-03-31T23:04:45.249 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-03-31T23:04:45.496 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-03-31T23:04:45.651 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-03-31T23:04:45.677 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-03-31T23:04:45.890 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-31T23:04:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-31T23:04:47.094 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-03-31T23:04:47.357 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-31T23:04:47.537 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-03-31T23:04:48.672 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.0 MB 00:00 2024-03-31T23:04:48.768 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.0 MB 00:01 2024-03-31T23:04:49.469 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-03-31T23:04:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-31T23:04:51.619 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-31T23:04:54.278 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 19 MB 00:03 2024-03-31T23:04:54.651 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.1 MB 00:00 2024-03-31T23:04:55.845 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.1 MB 00:00 2024-03-31T23:04:56.324 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-03-31T23:04:58.079 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-03-31T23:04:58.370 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-31T23:04:59.129 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.1 MB 00:01 2024-03-31T23:05:00.099 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-31T23:05:00.605 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 16 kB 00:00 2024-03-31T23:05:01.523 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-03-31T23:05:03.391 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-31T23:05:05.081 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-03-31T23:05:05.912 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T23:05:05.913 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T23:05:05.928 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-31T23:05:05.929 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-31T23:05:05.930 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-31T23:05:05.931 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-31T23:05:05.933 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-31T23:05:05.936 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-31T23:05:05.937 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-31T23:05:06.017 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-03-31T23:05:06.030 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 6.6 k 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 5.3 M 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 889 k 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 145 k 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 1.5 M 2024-03-31T23:05:06.031 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 139 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 3.5 M 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 7.4 M 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 49 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 9.8 M 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 47 M 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 264 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 748 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 221 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 27 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 18 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-31T23:05:06.032 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 32 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 746 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 127 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 161 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 320 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 298 k 2024-03-31T23:05:06.033 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 99 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 85 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.1 M 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 171 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-31T23:05:06.034 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.4 M 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.1 M 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-31T23:05:06.035 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 21 M 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 31 k 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 2.4 M 2024-03-31T23:05:06.036 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 248 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 4.7 M 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 17 M 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 15 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 25 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-31T23:05:06.037 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 163 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 501 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 5.1 M 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-31T23:05:06.038 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-31T23:05:06.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 45 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 131 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-31T23:05:06.040 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-31T23:05:06.041 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-31T23:05:06.042 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-31T23:05:06.043 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:05:06.044 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-03-31T23:05:06.045 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-03-31T23:05:06.045 INFO:teuthology.orchestra.run.smithi188.stdout:Install 150 Packages 2024-03-31T23:05:06.045 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 24 Packages 2024-03-31T23:05:06.045 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:05:06.045 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 226 M 2024-03-31T23:05:06.045 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-03-31T23:05:06.534 INFO:teuthology.orchestra.run.smithi188.stdout:(1/174): ceph-19.0.0-1977.g384f31f3.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2024-03-31T23:05:06.699 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-03-31T23:05:06.793 INFO:teuthology.orchestra.run.smithi188.stdout:(2/174): ceph-fuse-19.0.0-1977.g384f31f3.el9.x8 3.4 MB/s | 889 kB 00:00 2024-03-31T23:05:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:(3/174): ceph-immutable-object-cache-19.0.0-197 1.5 MB/s | 145 kB 00:00 2024-03-31T23:05:07.076 INFO:teuthology.orchestra.run.smithi188.stdout:(4/174): ceph-base-19.0.0-1977.g384f31f3.el9.x8 7.6 MB/s | 5.3 MB 00:00 2024-03-31T23:05:07.285 INFO:teuthology.orchestra.run.smithi188.stdout:(5/174): ceph-mgr-19.0.0-1977.g384f31f3.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-03-31T23:05:07.377 INFO:teuthology.orchestra.run.smithi188.stdout:(6/174): ceph-mds-19.0.0-1977.g384f31f3.el9.x86 4.8 MB/s | 2.4 MB 00:00 2024-03-31T23:05:07.609 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T23:05:07.610 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T23:05:07.623 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-31T23:05:07.624 INFO:teuthology.orchestra.run.smithi094.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-31T23:05:07.624 INFO:teuthology.orchestra.run.smithi094.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-31T23:05:07.625 INFO:teuthology.orchestra.run.smithi094.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-31T23:05:07.627 INFO:teuthology.orchestra.run.smithi094.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-31T23:05:07.630 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-31T23:05:07.631 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-31T23:05:07.711 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-03-31T23:05:07.725 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================================ 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================================ 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 6.6 k 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 5.3 M 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 889 k 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 145 k 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 1.5 M 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 139 k 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 3.5 M 2024-03-31T23:05:07.726 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 7.4 M 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 49 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 9.8 M 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 47 M 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 264 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 748 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 221 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-shell x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 27 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 18 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 32 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 746 k 2024-03-31T23:05:07.727 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 127 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 161 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 320 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 298 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 99 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 85 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.1 M 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 171 k 2024-03-31T23:05:07.728 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-31T23:05:07.729 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.4 M 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.1 M 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-03-31T23:05:07.730 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 21 M 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 31 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 2.4 M 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 248 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 4.7 M 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 17 M 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 15 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 25 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-31T23:05:07.731 INFO:teuthology.orchestra.run.smithi094.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 163 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 501 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 5.1 M 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-31T23:05:07.732 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-31T23:05:07.733 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 45 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 131 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-31T23:05:07.734 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-31T23:05:07.735 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-31T23:05:07.736 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-31T23:05:07.737 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-31T23:05:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================================ 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout:Install 150 Packages 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 24 Packages 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 226 M 2024-03-31T23:05:07.739 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-03-31T23:05:07.827 INFO:teuthology.orchestra.run.smithi188.stdout:(7/174): ceph-mon-19.0.0-1977.g384f31f3.el9.x86 8.7 MB/s | 4.7 MB 00:00 2024-03-31T23:05:08.244 INFO:teuthology.orchestra.run.smithi188.stdout:(8/174): ceph-common-19.0.0-1977.g384f31f3.el9. 11 MB/s | 21 MB 00:01 2024-03-31T23:05:08.294 INFO:teuthology.orchestra.run.smithi188.stdout:(9/174): ceph-selinux-19.0.0-1977.g384f31f3.el9 505 kB/s | 25 kB 00:00 2024-03-31T23:05:08.881 INFO:teuthology.orchestra.run.smithi094.stdout:(1/174): ceph-19.0.0-1977.g384f31f3.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-03-31T23:05:09.382 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T23:05:09.383 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T23:05:09.396 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-31T23:05:09.397 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-31T23:05:09.398 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-31T23:05:09.399 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-31T23:05:09.401 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-31T23:05:09.403 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-31T23:05:09.404 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-31T23:05:09.490 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-03-31T23:05:09.502 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-03-31T23:05:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 6.6 k 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 5.3 M 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 889 k 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 145 k 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 1.5 M 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 139 k 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 3.5 M 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 7.4 M 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 49 k 2024-03-31T23:05:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 9.8 M 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 47 M 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 264 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 748 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 221 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 27 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 18 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 32 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 746 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 127 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-31T23:05:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 161 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 320 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 298 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 99 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 85 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.1 M 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 171 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-31T23:05:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.4 M 2024-03-31T23:05:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 3.1 M 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-31T23:05:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 21 M 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 31 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 2.4 M 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 248 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 4.7 M 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 17 M 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1977.g384f31f3.el9 ceph-noarch 15 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 25 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-31T23:05:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 163 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 501 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 5.1 M 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-31T23:05:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-31T23:05:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 45 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.0.0-1977.g384f31f3.el9 ceph 131 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-31T23:05:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-31T23:05:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-31T23:05:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-31T23:05:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-31T23:05:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout:Install 150 Packages 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 24 Packages 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 226 M 2024-03-31T23:05:09.516 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-03-31T23:05:09.990 INFO:teuthology.orchestra.run.smithi094.stdout:(2/174): ceph-fuse-19.0.0-1977.g384f31f3.el9.x8 803 kB/s | 889 kB 00:01 2024-03-31T23:05:10.102 INFO:teuthology.orchestra.run.smithi188.stdout:(10/174): ceph-radosgw-19.0.0-1977.g384f31f3.el 4.3 MB/s | 9.8 MB 00:02 2024-03-31T23:05:10.132 INFO:teuthology.orchestra.run.smithi094.stdout:(3/174): ceph-immutable-object-cache-19.0.0-197 1.0 MB/s | 145 kB 00:00 2024-03-31T23:05:10.278 INFO:teuthology.orchestra.run.smithi188.stdout:(11/174): ceph-osd-19.0.0-1977.g384f31f3.el9.x8 5.8 MB/s | 17 MB 00:02 2024-03-31T23:05:10.303 INFO:teuthology.orchestra.run.smithi188.stdout:(12/174): cephfs-mirror-19.0.0-1977.g384f31f3.e 1.1 MB/s | 221 kB 00:00 2024-03-31T23:05:10.320 INFO:teuthology.orchestra.run.smithi188.stdout:(13/174): cephfs-shell-19.0.0-1977.g384f31f3.el 648 kB/s | 27 kB 00:00 2024-03-31T23:05:10.361 INFO:teuthology.orchestra.run.smithi188.stdout:(14/174): libcephfs-devel-19.0.0-1977.g384f31f3 542 kB/s | 32 kB 00:00 2024-03-31T23:05:10.450 INFO:teuthology.orchestra.run.smithi042.stdout:(1/174): ceph-19.0.0-1977.g384f31f3.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-03-31T23:05:10.478 INFO:teuthology.orchestra.run.smithi188.stdout:(15/174): libcephsqlite-19.0.0-1977.g384f31f3.e 1.4 MB/s | 163 kB 00:00 2024-03-31T23:05:10.587 INFO:teuthology.orchestra.run.smithi188.stdout:(16/174): librados-devel-19.0.0-1977.g384f31f3. 1.1 MB/s | 127 kB 00:00 2024-03-31T23:05:10.629 INFO:teuthology.orchestra.run.smithi188.stdout:(17/174): libcephfs2-19.0.0-1977.g384f31f3.el9. 2.4 MB/s | 746 kB 00:00 2024-03-31T23:05:10.755 INFO:teuthology.orchestra.run.smithi188.stdout:(18/174): libradosstriper1-19.0.0-1977.g384f31f 2.9 MB/s | 501 kB 00:00 2024-03-31T23:05:10.838 INFO:teuthology.orchestra.run.smithi188.stdout:(19/174): python3-ceph-argparse-19.0.0-1977.g38 542 kB/s | 45 kB 00:00 2024-03-31T23:05:10.930 INFO:teuthology.orchestra.run.smithi188.stdout:(20/174): python3-ceph-common-19.0.0-1977.g384f 1.4 MB/s | 131 kB 00:00 2024-03-31T23:05:11.022 INFO:teuthology.orchestra.run.smithi188.stdout:(21/174): python3-cephfs-19.0.0-1977.g384f31f3. 1.7 MB/s | 161 kB 00:00 2024-03-31T23:05:11.122 INFO:teuthology.orchestra.run.smithi188.stdout:(22/174): python3-rados-19.0.0-1977.g384f31f3.e 3.1 MB/s | 320 kB 00:00 2024-03-31T23:05:11.222 INFO:teuthology.orchestra.run.smithi188.stdout:(23/174): python3-rbd-19.0.0-1977.g384f31f3.el9 2.9 MB/s | 298 kB 00:00 2024-03-31T23:05:11.314 INFO:teuthology.orchestra.run.smithi188.stdout:(24/174): python3-rgw-19.0.0-1977.g384f31f3.el9 1.1 MB/s | 99 kB 00:00 2024-03-31T23:05:11.406 INFO:teuthology.orchestra.run.smithi188.stdout:(25/174): rbd-fuse-19.0.0-1977.g384f31f3.el9.x8 933 kB/s | 85 kB 00:00 2024-03-31T23:05:11.708 INFO:teuthology.orchestra.run.smithi042.stdout:(2/174): ceph-fuse-19.0.0-1977.g384f31f3.el9.x8 707 kB/s | 889 kB 00:01 2024-03-31T23:05:11.823 INFO:teuthology.orchestra.run.smithi094.stdout:(4/174): ceph-mds-19.0.0-1977.g384f31f3.el9.x86 1.4 MB/s | 2.4 MB 00:01 2024-03-31T23:05:12.000 INFO:teuthology.orchestra.run.smithi042.stdout:(3/174): ceph-immutable-object-cache-19.0.0-197 496 kB/s | 145 kB 00:00 2024-03-31T23:05:12.140 INFO:teuthology.orchestra.run.smithi188.stdout:(26/174): rbd-mirror-19.0.0-1977.g384f31f3.el9. 4.2 MB/s | 3.1 MB 00:00 2024-03-31T23:05:12.226 INFO:teuthology.orchestra.run.smithi094.stdout:(5/174): ceph-common-19.0.0-1977.g384f31f3.el9. 5.6 MB/s | 21 MB 00:03 2024-03-31T23:05:12.232 INFO:teuthology.orchestra.run.smithi188.stdout:(27/174): librgw2-19.0.0-1977.g384f31f3.el9.x86 3.2 MB/s | 5.1 MB 00:01 2024-03-31T23:05:12.257 INFO:teuthology.orchestra.run.smithi188.stdout:(28/174): rbd-nbd-19.0.0-1977.g384f31f3.el9.x86 1.4 MB/s | 171 kB 00:00 2024-03-31T23:05:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:(6/174): ceph-base-19.0.0-1977.g384f31f3.el9.x8 1.4 MB/s | 5.3 MB 00:03 2024-03-31T23:05:12.315 INFO:teuthology.orchestra.run.smithi188.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1977.g 378 kB/s | 31 kB 00:00 2024-03-31T23:05:12.349 INFO:teuthology.orchestra.run.smithi188.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1977.g384f31f 1.5 MB/s | 139 kB 00:00 2024-03-31T23:05:12.932 INFO:teuthology.orchestra.run.smithi094.stdout:(7/174): ceph-mgr-19.0.0-1977.g384f31f3.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-03-31T23:05:13.324 INFO:teuthology.orchestra.run.smithi188.stdout:(31/174): ceph-test-19.0.0-1977.g384f31f3.el9.x 9.4 MB/s | 47 MB 00:05 2024-03-31T23:05:13.408 INFO:teuthology.orchestra.run.smithi094.stdout:(8/174): ceph-mon-19.0.0-1977.g384f31f3.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-03-31T23:05:13.458 INFO:teuthology.orchestra.run.smithi188.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1977.g38 1.8 MB/s | 248 kB 00:00 2024-03-31T23:05:13.508 INFO:teuthology.orchestra.run.smithi094.stdout:(9/174): ceph-selinux-19.0.0-1977.g384f31f3.el9 251 kB/s | 25 kB 00:00 2024-03-31T23:05:13.558 INFO:teuthology.orchestra.run.smithi188.stdout:(33/174): ceph-mgr-rook-19.0.0-1977.g384f31f3.e 494 kB/s | 49 kB 00:00 2024-03-31T23:05:13.658 INFO:teuthology.orchestra.run.smithi188.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1977.g3 154 kB/s | 15 kB 00:00 2024-03-31T23:05:14.050 INFO:teuthology.orchestra.run.smithi188.stdout:(35/174): ceph-mgr-dashboard-19.0.0-1977.g384f3 2.0 MB/s | 3.5 MB 00:01 2024-03-31T23:05:14.075 INFO:teuthology.orchestra.run.smithi188.stdout:(36/174): ceph-volume-19.0.0-1977.g384f31f3.el9 632 kB/s | 264 kB 00:00 2024-03-31T23:05:14.176 INFO:teuthology.orchestra.run.smithi188.stdout:(37/174): cephfs-top-19.0.0-1977.g384f31f3.el9. 182 kB/s | 18 kB 00:00 2024-03-31T23:05:14.234 INFO:teuthology.orchestra.run.smithi042.stdout:(4/174): ceph-mds-19.0.0-1977.g384f31f3.el9.x86 1.1 MB/s | 2.4 MB 00:02 2024-03-31T23:05:14.301 INFO:teuthology.orchestra.run.smithi188.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2024-03-31T23:05:14.351 INFO:teuthology.orchestra.run.smithi188.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-03-31T23:05:14.385 INFO:teuthology.orchestra.run.smithi188.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-31T23:05:14.426 INFO:teuthology.orchestra.run.smithi188.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2024-03-31T23:05:14.460 INFO:teuthology.orchestra.run.smithi188.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 946 kB/s | 32 kB 00:00 2024-03-31T23:05:14.485 INFO:teuthology.orchestra.run.smithi188.stdout:(43/174): cephadm-19.0.0-1977.g384f31f3.el9.noa 1.7 MB/s | 748 kB 00:00 2024-03-31T23:05:14.561 INFO:teuthology.orchestra.run.smithi188.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-03-31T23:05:14.586 INFO:teuthology.orchestra.run.smithi188.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 177 kB/s | 17 kB 00:00 2024-03-31T23:05:14.611 INFO:teuthology.orchestra.run.smithi188.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-31T23:05:14.637 INFO:teuthology.orchestra.run.smithi188.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-31T23:05:14.654 INFO:teuthology.orchestra.run.smithi188.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-31T23:05:14.679 INFO:teuthology.orchestra.run.smithi188.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-03-31T23:05:14.704 INFO:teuthology.orchestra.run.smithi188.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-03-31T23:05:14.730 INFO:teuthology.orchestra.run.smithi188.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 939 kB/s | 46 kB 00:00 2024-03-31T23:05:14.755 INFO:teuthology.orchestra.run.smithi188.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-31T23:05:14.780 INFO:teuthology.orchestra.run.smithi188.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-31T23:05:14.805 INFO:teuthology.orchestra.run.smithi188.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-31T23:05:14.830 INFO:teuthology.orchestra.run.smithi188.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-03-31T23:05:14.931 INFO:teuthology.orchestra.run.smithi188.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-03-31T23:05:14.973 INFO:teuthology.orchestra.run.smithi188.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-03-31T23:05:15.015 INFO:teuthology.orchestra.run.smithi188.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 9.9 MB/s | 817 kB 00:00 2024-03-31T23:05:15.040 INFO:teuthology.orchestra.run.smithi188.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 132 kB 00:00 2024-03-31T23:05:15.165 INFO:teuthology.orchestra.run.smithi188.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2024-03-31T23:05:15.193 INFO:teuthology.orchestra.run.smithi188.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-03-31T23:05:15.218 INFO:teuthology.orchestra.run.smithi188.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 78 kB 00:00 2024-03-31T23:05:15.344 INFO:teuthology.orchestra.run.smithi188.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2024-03-31T23:05:15.369 INFO:teuthology.orchestra.run.smithi188.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 166 kB/s | 24 kB 00:00 2024-03-31T23:05:15.394 INFO:teuthology.orchestra.run.smithi188.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2024-03-31T23:05:15.420 INFO:teuthology.orchestra.run.smithi188.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-31T23:05:15.445 INFO:teuthology.orchestra.run.smithi188.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-03-31T23:05:15.545 INFO:teuthology.orchestra.run.smithi188.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-31T23:05:15.559 INFO:teuthology.orchestra.run.smithi042.stdout:(5/174): ceph-mgr-19.0.0-1977.g384f31f3.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-03-31T23:05:15.570 INFO:teuthology.orchestra.run.smithi188.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-03-31T23:05:15.596 INFO:teuthology.orchestra.run.smithi188.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-31T23:05:15.613 INFO:teuthology.orchestra.run.smithi188.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-03-31T23:05:15.697 INFO:teuthology.orchestra.run.smithi188.stdout:(72/174): ceph-mgr-diskprediction-local-19.0.0- 2.2 MB/s | 7.4 MB 00:03 2024-03-31T23:05:15.713 INFO:teuthology.orchestra.run.smithi188.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 351 kB/s | 41 kB 00:00 2024-03-31T23:05:15.738 INFO:teuthology.orchestra.run.smithi188.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 238 kB 00:00 2024-03-31T23:05:15.764 INFO:teuthology.orchestra.run.smithi188.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-31T23:05:15.780 INFO:teuthology.orchestra.run.smithi188.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-03-31T23:05:15.806 INFO:teuthology.orchestra.run.smithi188.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 712 kB/s | 47 kB 00:00 2024-03-31T23:05:15.831 INFO:teuthology.orchestra.run.smithi188.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 857 kB/s | 43 kB 00:00 2024-03-31T23:05:15.965 INFO:teuthology.orchestra.run.smithi188.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 248 kB/s | 39 kB 00:00 2024-03-31T23:05:16.132 INFO:teuthology.orchestra.run.smithi188.stdout:(80/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-31T23:05:16.157 INFO:teuthology.orchestra.run.smithi188.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 127 kB/s | 41 kB 00:00 2024-03-31T23:05:16.182 INFO:teuthology.orchestra.run.smithi188.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2024-03-31T23:05:16.207 INFO:teuthology.orchestra.run.smithi188.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 703 kB/s | 35 kB 00:00 2024-03-31T23:05:16.233 INFO:teuthology.orchestra.run.smithi188.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 620 kB/s | 46 kB 00:00 2024-03-31T23:05:16.258 INFO:teuthology.orchestra.run.smithi188.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-03-31T23:05:16.283 INFO:teuthology.orchestra.run.smithi188.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-31T23:05:16.308 INFO:teuthology.orchestra.run.smithi188.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 838 kB/s | 63 kB 00:00 2024-03-31T23:05:16.357 INFO:teuthology.orchestra.run.smithi188.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 448 kB/s | 44 kB 00:00 2024-03-31T23:05:16.384 INFO:teuthology.orchestra.run.smithi188.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-31T23:05:16.409 INFO:teuthology.orchestra.run.smithi188.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 241 kB 00:00 2024-03-31T23:05:16.443 INFO:teuthology.orchestra.run.smithi188.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-03-31T23:05:16.468 INFO:teuthology.orchestra.run.smithi188.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-31T23:05:16.485 INFO:teuthology.orchestra.run.smithi188.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 124 kB 00:00 2024-03-31T23:05:16.510 INFO:teuthology.orchestra.run.smithi188.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-03-31T23:05:16.577 INFO:teuthology.orchestra.run.smithi188.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2024-03-31T23:05:16.610 INFO:teuthology.orchestra.run.smithi188.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-03-31T23:05:16.644 INFO:teuthology.orchestra.run.smithi188.stdout:(97/174): libgfortran-11.4.1-3.el9.x86_64.rpm 4.9 MB/s | 803 kB 00:00 2024-03-31T23:05:16.678 INFO:teuthology.orchestra.run.smithi188.stdout:(98/174): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-03-31T23:05:16.770 INFO:teuthology.orchestra.run.smithi188.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 203 kB/s | 25 kB 00:00 2024-03-31T23:05:16.786 INFO:teuthology.orchestra.run.smithi188.stdout:(100/174): elfutils-libelf-devel-0.190-2.el9.x8 122 kB/s | 21 kB 00:00 2024-03-31T23:05:16.912 INFO:teuthology.orchestra.run.smithi188.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.9 MB/s | 248 kB 00:00 2024-03-31T23:05:16.937 INFO:teuthology.orchestra.run.smithi188.stdout:(102/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.4 MB/s | 245 kB 00:00 2024-03-31T23:05:16.971 INFO:teuthology.orchestra.run.smithi188.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-03-31T23:05:16.975 INFO:teuthology.orchestra.run.smithi042.stdout:(6/174): ceph-base-19.0.0-1977.g384f31f3.el9.x8 800 kB/s | 5.3 MB 00:06 2024-03-31T23:05:17.112 INFO:teuthology.orchestra.run.smithi188.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-03-31T23:05:17.238 INFO:teuthology.orchestra.run.smithi188.stdout:(105/174): openssl-devel-3.0.7-27.el9.x86_64.rp 7.4 MB/s | 4.1 MB 00:00 2024-03-31T23:05:17.288 INFO:teuthology.orchestra.run.smithi188.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-03-31T23:05:17.513 INFO:teuthology.orchestra.run.smithi188.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 86 kB/s | 19 kB 00:00 2024-03-31T23:05:17.680 INFO:teuthology.orchestra.run.smithi188.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 966 kB/s | 548 kB 00:00 2024-03-31T23:05:17.705 INFO:teuthology.orchestra.run.smithi188.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 661 kB/s | 309 kB 00:00 2024-03-31T23:05:17.781 INFO:teuthology.orchestra.run.smithi188.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-03-31T23:05:17.806 INFO:teuthology.orchestra.run.smithi188.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-03-31T23:05:17.873 INFO:teuthology.orchestra.run.smithi188.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-03-31T23:05:17.915 INFO:teuthology.orchestra.run.smithi188.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-03-31T23:05:18.057 INFO:teuthology.orchestra.run.smithi188.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-03-31T23:05:18.082 INFO:teuthology.orchestra.run.smithi188.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-03-31T23:05:18.149 INFO:teuthology.orchestra.run.smithi188.stdout:(116/174): libarrow-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-03-31T23:05:18.174 INFO:teuthology.orchestra.run.smithi188.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-03-31T23:05:18.202 INFO:teuthology.orchestra.run.smithi188.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 269 kB/s | 32 kB 00:00 2024-03-31T23:05:18.244 INFO:teuthology.orchestra.run.smithi188.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 159 kB/s | 15 kB 00:00 2024-03-31T23:05:18.269 INFO:teuthology.orchestra.run.smithi188.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-03-31T23:05:18.311 INFO:teuthology.orchestra.run.smithi188.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-03-31T23:05:18.336 INFO:teuthology.orchestra.run.smithi188.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-03-31T23:05:18.362 INFO:teuthology.orchestra.run.smithi188.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 382 kB/s | 35 kB 00:00 2024-03-31T23:05:18.412 INFO:teuthology.orchestra.run.smithi188.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-31T23:05:18.454 INFO:teuthology.orchestra.run.smithi188.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-03-31T23:05:18.496 INFO:teuthology.orchestra.run.smithi188.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-03-31T23:05:18.499 INFO:teuthology.orchestra.run.smithi094.stdout:(10/174): ceph-radosgw-19.0.0-1977.g384f31f3.el 1.8 MB/s | 9.8 MB 00:05 2024-03-31T23:05:18.538 INFO:teuthology.orchestra.run.smithi188.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-03-31T23:05:18.580 INFO:teuthology.orchestra.run.smithi188.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-03-31T23:05:18.622 INFO:teuthology.orchestra.run.smithi188.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-03-31T23:05:18.663 INFO:teuthology.orchestra.run.smithi188.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-03-31T23:05:18.708 INFO:teuthology.orchestra.run.smithi094.stdout:(11/174): cephfs-mirror-19.0.0-1977.g384f31f3.e 1.0 MB/s | 221 kB 00:00 2024-03-31T23:05:18.739 INFO:teuthology.orchestra.run.smithi188.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-03-31T23:05:18.764 INFO:teuthology.orchestra.run.smithi188.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-03-31T23:05:18.825 INFO:teuthology.orchestra.run.smithi094.stdout:(12/174): cephfs-shell-19.0.0-1977.g384f31f3.el 232 kB/s | 27 kB 00:00 2024-03-31T23:05:18.831 INFO:teuthology.orchestra.run.smithi188.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-03-31T23:05:18.856 INFO:teuthology.orchestra.run.smithi188.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2024-03-31T23:05:18.931 INFO:teuthology.orchestra.run.smithi188.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-03-31T23:05:18.942 INFO:teuthology.orchestra.run.smithi094.stdout:(13/174): libcephfs-devel-19.0.0-1977.g384f31f3 272 kB/s | 32 kB 00:00 2024-03-31T23:05:18.957 INFO:teuthology.orchestra.run.smithi188.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-03-31T23:05:19.024 INFO:teuthology.orchestra.run.smithi188.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 980 kB/s | 90 kB 00:00 2024-03-31T23:05:19.049 INFO:teuthology.orchestra.run.smithi188.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-03-31T23:05:19.116 INFO:teuthology.orchestra.run.smithi188.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-03-31T23:05:19.118 INFO:teuthology.orchestra.run.smithi042.stdout:(7/174): ceph-mon-19.0.0-1977.g384f31f3.el9.x86 1.3 MB/s | 4.7 MB 00:03 2024-03-31T23:05:19.150 INFO:teuthology.orchestra.run.smithi188.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-03-31T23:05:19.208 INFO:teuthology.orchestra.run.smithi188.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-03-31T23:05:19.242 INFO:teuthology.orchestra.run.smithi188.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2024-03-31T23:05:19.292 INFO:teuthology.orchestra.run.smithi188.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 611 kB/s | 51 kB 00:00 2024-03-31T23:05:19.342 INFO:teuthology.orchestra.run.smithi188.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-03-31T23:05:19.401 INFO:teuthology.orchestra.run.smithi188.stdout:(145/174): python3-grpcio-1.46.7-10.el9.x86_64. 1.9 MB/s | 2.0 MB 00:01 2024-03-31T23:05:19.426 INFO:teuthology.orchestra.run.smithi188.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 668 kB/s | 90 kB 00:00 2024-03-31T23:05:19.452 INFO:teuthology.orchestra.run.smithi188.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-03-31T23:05:19.476 INFO:teuthology.orchestra.run.smithi094.stdout:(14/174): libcephfs2-19.0.0-1977.g384f31f3.el9. 1.4 MB/s | 746 kB 00:00 2024-03-31T23:05:19.494 INFO:teuthology.orchestra.run.smithi188.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-03-31T23:05:19.519 INFO:teuthology.orchestra.run.smithi188.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-31T23:05:19.659 INFO:teuthology.orchestra.run.smithi094.stdout:(15/174): libcephsqlite-19.0.0-1977.g384f31f3.e 891 kB/s | 163 kB 00:00 2024-03-31T23:05:19.744 INFO:teuthology.orchestra.run.smithi188.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-03-31T23:05:19.759 INFO:teuthology.orchestra.run.smithi094.stdout:(16/174): librados-devel-19.0.0-1977.g384f31f3. 1.2 MB/s | 127 kB 00:00 2024-03-31T23:05:19.911 INFO:teuthology.orchestra.run.smithi188.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-03-31T23:05:19.978 INFO:teuthology.orchestra.run.smithi188.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-03-31T23:05:20.012 INFO:teuthology.orchestra.run.smithi188.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-31T23:05:20.054 INFO:teuthology.orchestra.run.smithi188.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-31T23:05:20.096 INFO:teuthology.orchestra.run.smithi188.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-03-31T23:05:20.126 INFO:teuthology.orchestra.run.smithi094.stdout:(17/174): libradosstriper1-19.0.0-1977.g384f31f 1.3 MB/s | 501 kB 00:00 2024-03-31T23:05:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 812 kB/s | 71 kB 00:00 2024-03-31T23:05:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 682 kB/s | 36 kB 00:00 2024-03-31T23:05:20.305 INFO:teuthology.orchestra.run.smithi188.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-31T23:05:20.380 INFO:teuthology.orchestra.run.smithi188.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-03-31T23:05:20.430 INFO:teuthology.orchestra.run.smithi188.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 462 kB/s | 23 kB 00:00 2024-03-31T23:05:20.498 INFO:teuthology.orchestra.run.smithi188.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-03-31T23:05:20.564 INFO:teuthology.orchestra.run.smithi188.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-03-31T23:05:20.633 INFO:teuthology.orchestra.run.smithi188.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 136 kB 00:00 2024-03-31T23:05:20.690 INFO:teuthology.orchestra.run.smithi188.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-31T23:05:20.740 INFO:teuthology.orchestra.run.smithi188.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 573 kB/s | 29 kB 00:00 2024-03-31T23:05:20.849 INFO:teuthology.orchestra.run.smithi188.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2024-03-31T23:05:20.983 INFO:teuthology.orchestra.run.smithi188.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 16 MB/s | 2.2 MB 00:00 2024-03-31T23:05:21.124 INFO:teuthology.orchestra.run.smithi188.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 16 MB/s | 2.3 MB 00:00 2024-03-31T23:05:21.208 INFO:teuthology.orchestra.run.smithi188.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.5 MB/s | 465 kB 00:00 2024-03-31T23:05:21.283 INFO:teuthology.orchestra.run.smithi188.stdout:(170/174): librados2-19.0.0-1977.g384f31f3.el9. 1.9 MB/s | 3.4 MB 00:01 2024-03-31T23:05:21.309 INFO:teuthology.orchestra.run.smithi188.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 310 kB/s | 31 kB 00:00 2024-03-31T23:05:21.426 INFO:teuthology.orchestra.run.smithi188.stdout:(172/174): librbd1-19.0.0-1977.g384f31f3.el9.x8 1.6 MB/s | 3.1 MB 00:01 2024-03-31T23:05:21.468 INFO:teuthology.orchestra.run.smithi188.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 468 kB/s | 74 kB 00:00 2024-03-31T23:05:21.501 INFO:teuthology.orchestra.run.smithi188.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.9 MB/s | 1.1 MB 00:00 2024-03-31T23:05:21.507 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-03-31T23:05:21.507 INFO:teuthology.orchestra.run.smithi188.stdout:Total 15 MB/s | 226 MB 00:15 2024-03-31T23:05:21.871 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-03-31T23:05:22.140 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-03-31T23:05:22.140 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-03-31T23:05:22.252 INFO:teuthology.orchestra.run.smithi094.stdout:(18/174): ceph-osd-19.0.0-1977.g384f31f3.el9.x8 1.7 MB/s | 17 MB 00:09 2024-03-31T23:05:22.352 INFO:teuthology.orchestra.run.smithi094.stdout:(19/174): python3-ceph-argparse-19.0.0-1977.g38 453 kB/s | 45 kB 00:00 2024-03-31T23:05:22.444 INFO:teuthology.orchestra.run.smithi094.stdout:(20/174): python3-ceph-common-19.0.0-1977.g384f 1.4 MB/s | 131 kB 00:00 2024-03-31T23:05:22.594 INFO:teuthology.orchestra.run.smithi094.stdout:(21/174): python3-cephfs-19.0.0-1977.g384f31f3. 1.1 MB/s | 161 kB 00:00 2024-03-31T23:05:22.869 INFO:teuthology.orchestra.run.smithi094.stdout:(22/174): python3-rados-19.0.0-1977.g384f31f3.e 1.1 MB/s | 320 kB 00:00 2024-03-31T23:05:23.161 INFO:teuthology.orchestra.run.smithi094.stdout:(23/174): python3-rbd-19.0.0-1977.g384f31f3.el9 1.0 MB/s | 298 kB 00:00 2024-03-31T23:05:23.270 INFO:teuthology.orchestra.run.smithi094.stdout:(24/174): python3-rgw-19.0.0-1977.g384f31f3.el9 917 kB/s | 99 kB 00:00 2024-03-31T23:05:23.361 INFO:teuthology.orchestra.run.smithi094.stdout:(25/174): rbd-fuse-19.0.0-1977.g384f31f3.el9.x8 931 kB/s | 85 kB 00:00 2024-03-31T23:05:23.779 INFO:teuthology.orchestra.run.smithi094.stdout:(26/174): librgw2-19.0.0-1977.g384f31f3.el9.x86 1.4 MB/s | 5.1 MB 00:03 2024-03-31T23:05:23.830 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-03-31T23:05:23.831 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-03-31T23:05:23.979 INFO:teuthology.orchestra.run.smithi094.stdout:(27/174): rbd-nbd-19.0.0-1977.g384f31f3.el9.x86 857 kB/s | 171 kB 00:00 2024-03-31T23:05:24.087 INFO:teuthology.orchestra.run.smithi094.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1977.g 291 kB/s | 31 kB 00:00 2024-03-31T23:05:24.571 INFO:teuthology.orchestra.run.smithi094.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1977.g384f31f 288 kB/s | 139 kB 00:00 2024-03-31T23:05:25.763 INFO:teuthology.orchestra.run.smithi094.stdout:(30/174): rbd-mirror-19.0.0-1977.g384f31f3.el9. 1.3 MB/s | 3.1 MB 00:02 2024-03-31T23:05:27.193 INFO:teuthology.orchestra.run.smithi042.stdout:(8/174): ceph-radosgw-19.0.0-1977.g384f31f3.el9 1.2 MB/s | 9.8 MB 00:08 2024-03-31T23:05:27.293 INFO:teuthology.orchestra.run.smithi042.stdout:(9/174): ceph-selinux-19.0.0-1977.g384f31f3.el9 252 kB/s | 25 kB 00:00 2024-03-31T23:05:27.413 INFO:teuthology.orchestra.run.smithi094.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1977.g384f3 1.2 MB/s | 3.5 MB 00:02 2024-03-31T23:05:27.613 INFO:teuthology.orchestra.run.smithi094.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1977.g38 1.2 MB/s | 248 kB 00:00 2024-03-31T23:05:27.713 INFO:teuthology.orchestra.run.smithi094.stdout:(33/174): ceph-mgr-rook-19.0.0-1977.g384f31f3.e 494 kB/s | 49 kB 00:00 2024-03-31T23:05:27.822 INFO:teuthology.orchestra.run.smithi094.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1977.g3 142 kB/s | 15 kB 00:00 2024-03-31T23:05:28.105 INFO:teuthology.orchestra.run.smithi094.stdout:(35/174): ceph-volume-19.0.0-1977.g384f31f3.el9 931 kB/s | 264 kB 00:00 2024-03-31T23:05:28.673 INFO:teuthology.orchestra.run.smithi094.stdout:(36/174): cephadm-19.0.0-1977.g384f31f3.el9.noa 1.3 MB/s | 748 kB 00:00 2024-03-31T23:05:28.781 INFO:teuthology.orchestra.run.smithi094.stdout:(37/174): cephfs-top-19.0.0-1977.g384f31f3.el9. 169 kB/s | 18 kB 00:00 2024-03-31T23:05:28.957 INFO:teuthology.orchestra.run.smithi094.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2024-03-31T23:05:29.424 INFO:teuthology.orchestra.run.smithi094.stdout:(39/174): ceph-test-19.0.0-1977.g384f31f3.el9.x 3.0 MB/s | 47 MB 00:15 2024-03-31T23:05:29.457 INFO:teuthology.orchestra.run.smithi094.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 920 kB 00:00 2024-03-31T23:05:29.468 INFO:teuthology.orchestra.run.smithi042.stdout:(10/174): ceph-osd-19.0.0-1977.g384f31f3.el9.x8 1.3 MB/s | 17 MB 00:12 2024-03-31T23:05:29.482 INFO:teuthology.orchestra.run.smithi094.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-31T23:05:29.507 INFO:teuthology.orchestra.run.smithi094.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-31T23:05:29.533 INFO:teuthology.orchestra.run.smithi094.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2024-03-31T23:05:29.610 INFO:teuthology.orchestra.run.smithi042.stdout:(11/174): cephfs-mirror-19.0.0-1977.g384f31f3.e 1.5 MB/s | 221 kB 00:00 2024-03-31T23:05:29.677 INFO:teuthology.orchestra.run.smithi042.stdout:(12/174): cephfs-shell-19.0.0-1977.g384f31f3.el 406 kB/s | 27 kB 00:00 2024-03-31T23:05:29.792 INFO:teuthology.orchestra.run.smithi094.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-03-31T23:05:29.817 INFO:teuthology.orchestra.run.smithi094.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 61 kB/s | 17 kB 00:00 2024-03-31T23:05:29.850 INFO:teuthology.orchestra.run.smithi094.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 305 kB/s | 10 kB 00:00 2024-03-31T23:05:29.876 INFO:teuthology.orchestra.run.smithi094.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-31T23:05:29.901 INFO:teuthology.orchestra.run.smithi094.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-31T23:05:29.942 INFO:teuthology.orchestra.run.smithi094.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-03-31T23:05:29.967 INFO:teuthology.orchestra.run.smithi094.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.7 MB/s | 578 kB 00:00 2024-03-31T23:05:29.992 INFO:teuthology.orchestra.run.smithi094.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 46 kB 00:00 2024-03-31T23:05:30.018 INFO:teuthology.orchestra.run.smithi094.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-31T23:05:30.044 INFO:teuthology.orchestra.run.smithi094.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2024-03-31T23:05:30.063 INFO:teuthology.orchestra.run.smithi042.stdout:(13/174): ceph-common-19.0.0-1977.g384f31f3.el9 1.0 MB/s | 21 MB 00:19 2024-03-31T23:05:30.069 INFO:teuthology.orchestra.run.smithi094.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-31T23:05:30.085 INFO:teuthology.orchestra.run.smithi042.stdout:(14/174): libcephfs-devel-19.0.0-1977.g384f31f3 78 kB/s | 32 kB 00:00 2024-03-31T23:05:30.086 INFO:teuthology.orchestra.run.smithi094.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 828 kB/s | 34 kB 00:00 2024-03-31T23:05:30.219 INFO:teuthology.orchestra.run.smithi042.stdout:(15/174): libcephsqlite-19.0.0-1977.g384f31f3.e 1.2 MB/s | 163 kB 00:00 2024-03-31T23:05:30.220 INFO:teuthology.orchestra.run.smithi094.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-03-31T23:05:30.253 INFO:teuthology.orchestra.run.smithi094.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 9.2 MB/s | 1.5 MB 00:00 2024-03-31T23:05:30.287 INFO:teuthology.orchestra.run.smithi094.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 817 kB 00:00 2024-03-31T23:05:30.320 INFO:teuthology.orchestra.run.smithi094.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 132 kB 00:00 2024-03-31T23:05:30.344 INFO:teuthology.orchestra.run.smithi042.stdout:(16/174): librados-devel-19.0.0-1977.g384f31f3. 1.0 MB/s | 127 kB 00:00 2024-03-31T23:05:30.445 INFO:teuthology.orchestra.run.smithi042.stdout:(17/174): libcephfs2-19.0.0-1977.g384f31f3.el9. 1.9 MB/s | 746 kB 00:00 2024-03-31T23:05:30.471 INFO:teuthology.orchestra.run.smithi094.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-03-31T23:05:30.504 INFO:teuthology.orchestra.run.smithi094.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-03-31T23:05:30.529 INFO:teuthology.orchestra.run.smithi094.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-31T23:05:30.570 INFO:teuthology.orchestra.run.smithi042.stdout:(18/174): libradosstriper1-19.0.0-1977.g384f31f 2.2 MB/s | 501 kB 00:00 2024-03-31T23:05:30.637 INFO:teuthology.orchestra.run.smithi042.stdout:(19/174): python3-ceph-argparse-19.0.0-1977.g38 679 kB/s | 45 kB 00:00 2024-03-31T23:05:30.638 INFO:teuthology.orchestra.run.smithi094.stdout:(63/174): ceph-mgr-diskprediction-local-19.0.0- 1.5 MB/s | 7.4 MB 00:04 2024-03-31T23:05:30.730 INFO:teuthology.orchestra.run.smithi094.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 5.8 MB 00:00 2024-03-31T23:05:30.747 INFO:teuthology.orchestra.run.smithi094.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 114 kB/s | 24 kB 00:00 2024-03-31T23:05:30.763 INFO:teuthology.orchestra.run.smithi094.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 147 kB/s | 18 kB 00:00 2024-03-31T23:05:30.778 INFO:teuthology.orchestra.run.smithi042.stdout:(20/174): python3-ceph-common-19.0.0-1977.g384f 929 kB/s | 131 kB 00:00 2024-03-31T23:05:30.780 INFO:teuthology.orchestra.run.smithi094.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 950 kB/s | 32 kB 00:00 2024-03-31T23:05:30.806 INFO:teuthology.orchestra.run.smithi094.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-31T23:05:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-03-31T23:05:30.904 INFO:teuthology.orchestra.run.smithi042.stdout:(21/174): python3-cephfs-19.0.0-1977.g384f31f3. 1.3 MB/s | 161 kB 00:00 2024-03-31T23:05:30.923 INFO:teuthology.orchestra.run.smithi094.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2024-03-31T23:05:30.948 INFO:teuthology.orchestra.run.smithi094.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-03-31T23:05:30.954 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-31T23:05:30.973 INFO:teuthology.orchestra.run.smithi094.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-03-31T23:05:30.988 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-31T23:05:30.990 INFO:teuthology.orchestra.run.smithi094.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-31T23:05:31.015 INFO:teuthology.orchestra.run.smithi094.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 986 kB/s | 41 kB 00:00 2024-03-31T23:05:31.019 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T23:05:31.028 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T23:05:31.040 INFO:teuthology.orchestra.run.smithi094.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-03-31T23:05:31.057 INFO:teuthology.orchestra.run.smithi094.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-31T23:05:31.077 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-31T23:05:31.083 INFO:teuthology.orchestra.run.smithi094.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2024-03-31T23:05:31.096 INFO:teuthology.orchestra.run.smithi042.stdout:(22/174): python3-rados-19.0.0-1977.g384f31f3.e 1.6 MB/s | 320 kB 00:00 2024-03-31T23:05:31.108 INFO:teuthology.orchestra.run.smithi094.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 708 kB/s | 47 kB 00:00 2024-03-31T23:05:31.130 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-31T23:05:31.133 INFO:teuthology.orchestra.run.smithi094.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 567 kB/s | 43 kB 00:00 2024-03-31T23:05:31.164 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-31T23:05:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-31T23:05:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-31T23:05:31.300 INFO:teuthology.orchestra.run.smithi094.stdout:(79/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 249 kB/s | 41 kB 00:00 2024-03-31T23:05:31.304 INFO:teuthology.orchestra.run.smithi042.stdout:(23/174): python3-rbd-19.0.0-1977.g384f31f3.el9 1.4 MB/s | 298 kB 00:00 2024-03-31T23:05:31.325 INFO:teuthology.orchestra.run.smithi094.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 204 kB/s | 39 kB 00:00 2024-03-31T23:05:31.380 INFO:teuthology.orchestra.run.smithi042.stdout:(24/174): python3-rgw-19.0.0-1977.g384f31f3.el9 1.3 MB/s | 99 kB 00:00 2024-03-31T23:05:31.463 INFO:teuthology.orchestra.run.smithi042.stdout:(25/174): rbd-fuse-19.0.0-1977.g384f31f3.el9.x8 1.0 MB/s | 85 kB 00:00 2024-03-31T23:05:31.484 INFO:teuthology.orchestra.run.smithi094.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-03-31T23:05:31.531 INFO:teuthology.orchestra.run.smithi094.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 951 kB/s | 220 kB 00:00 2024-03-31T23:05:31.552 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-31T23:05:31.559 INFO:teuthology.orchestra.run.smithi094.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 150 kB/s | 35 kB 00:00 2024-03-31T23:05:31.585 INFO:teuthology.orchestra.run.smithi094.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 878 kB/s | 46 kB 00:00 2024-03-31T23:05:31.610 INFO:teuthology.orchestra.run.smithi094.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.8 MB/s | 300 kB 00:00 2024-03-31T23:05:31.616 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:05:31.635 INFO:teuthology.orchestra.run.smithi094.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 746 kB/s | 56 kB 00:00 2024-03-31T23:05:31.660 INFO:teuthology.orchestra.run.smithi094.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2024-03-31T23:05:31.685 INFO:teuthology.orchestra.run.smithi094.stdout:(88/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 833 kB/s | 63 kB 00:00 2024-03-31T23:05:31.711 INFO:teuthology.orchestra.run.smithi094.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-31T23:05:31.720 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:05:31.736 INFO:teuthology.orchestra.run.smithi094.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-31T23:05:31.751 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:05:31.761 INFO:teuthology.orchestra.run.smithi094.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-03-31T23:05:31.803 INFO:teuthology.orchestra.run.smithi094.stdout:(92/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-03-31T23:05:31.828 INFO:teuthology.orchestra.run.smithi094.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-03-31T23:05:31.842 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:05:31.853 INFO:teuthology.orchestra.run.smithi094.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.0 MB/s | 187 kB 00:00 2024-03-31T23:05:31.872 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 12/198 2024-03-31T23:05:31.914 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-31T23:05:32.046 INFO:teuthology.orchestra.run.smithi094.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-03-31T23:05:32.071 INFO:teuthology.orchestra.run.smithi094.stdout:(96/174): jq-1.6-16.el9.x86_64.rpm 775 kB/s | 187 kB 00:00 2024-03-31T23:05:32.077 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-31T23:05:32.104 INFO:teuthology.orchestra.run.smithi094.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-31T23:05:32.128 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-31T23:05:32.148 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:05:32.171 INFO:teuthology.orchestra.run.smithi094.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-03-31T23:05:32.197 INFO:teuthology.orchestra.run.smithi094.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 277 kB/s | 25 kB 00:00 2024-03-31T23:05:32.230 INFO:teuthology.orchestra.run.smithi094.stdout:(100/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-03-31T23:05:32.234 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:05:32.257 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 17/198 2024-03-31T23:05:32.313 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 17/198 2024-03-31T23:05:32.339 INFO:teuthology.orchestra.run.smithi094.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.7 MB/s | 245 kB 00:00 2024-03-31T23:05:32.353 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-31T23:05:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T23:05:32.389 INFO:teuthology.orchestra.run.smithi094.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-31T23:05:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T23:05:32.414 INFO:teuthology.orchestra.run.smithi094.stdout:(103/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.3 MB/s | 248 kB 00:00 2024-03-31T23:05:32.481 INFO:teuthology.orchestra.run.smithi094.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 13 MB/s | 4.1 MB 00:00 2024-03-31T23:05:32.515 INFO:teuthology.orchestra.run.smithi094.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-03-31T23:05:32.575 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T23:05:32.586 INFO:teuthology.orchestra.run.smithi094.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.9 MB/s | 863 kB 00:00 2024-03-31T23:05:32.606 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T23:05:32.647 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-31T23:05:32.743 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-31T23:05:32.832 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T23:05:32.880 INFO:teuthology.orchestra.run.smithi042.stdout:(26/174): librgw2-19.0.0-1977.g384f31f3.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-03-31T23:05:32.893 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T23:05:32.969 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:32.989 INFO:teuthology.orchestra.run.smithi042.stdout:(27/174): rbd-mirror-19.0.0-1977.g384f31f3.el9. 2.0 MB/s | 3.1 MB 00:01 2024-03-31T23:05:33.019 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:33.020 INFO:teuthology.orchestra.run.smithi094.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 51 kB/s | 19 kB 00:00 2024-03-31T23:05:33.089 INFO:teuthology.orchestra.run.smithi042.stdout:(28/174): rbd-nbd-19.0.0-1977.g384f31f3.el9.x86 822 kB/s | 171 kB 00:00 2024-03-31T23:05:33.115 INFO:teuthology.orchestra.run.smithi042.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1977.g 251 kB/s | 31 kB 00:00 2024-03-31T23:05:33.198 INFO:teuthology.orchestra.run.smithi042.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1977.g384f31f 1.3 MB/s | 139 kB 00:00 2024-03-31T23:05:33.203 INFO:teuthology.orchestra.run.smithi094.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 449 kB/s | 309 kB 00:00 2024-03-31T23:05:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:33.245 INFO:teuthology.orchestra.run.smithi094.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 718 kB/s | 548 kB 00:00 2024-03-31T23:05:33.304 INFO:teuthology.orchestra.run.smithi094.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-03-31T23:05:33.348 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-31T23:05:33.354 INFO:teuthology.orchestra.run.smithi094.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-03-31T23:05:33.421 INFO:teuthology.orchestra.run.smithi094.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-03-31T23:05:33.436 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-31T23:05:33.474 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-31T23:05:33.480 INFO:teuthology.orchestra.run.smithi094.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-03-31T23:05:33.501 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-31T23:05:33.536 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-31T23:05:33.610 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-31T23:05:33.647 INFO:teuthology.orchestra.run.smithi094.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-03-31T23:05:33.664 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-31T23:05:33.680 INFO:teuthology.orchestra.run.smithi094.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 838 kB 00:00 2024-03-31T23:05:33.703 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-31T23:05:33.767 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-31T23:05:33.789 INFO:teuthology.orchestra.run.smithi094.stdout:(116/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-03-31T23:05:33.810 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-31T23:05:33.814 INFO:teuthology.orchestra.run.smithi094.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 260 kB/s | 43 kB 00:00 2024-03-31T23:05:33.839 INFO:teuthology.orchestra.run.smithi094.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2024-03-31T23:05:33.854 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-31T23:05:33.886 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-31T23:05:33.898 INFO:teuthology.orchestra.run.smithi094.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-03-31T23:05:33.914 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-31T23:05:33.957 INFO:teuthology.orchestra.run.smithi094.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-31T23:05:33.982 INFO:teuthology.orchestra.run.smithi094.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-03-31T23:05:33.985 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-31T23:05:34.007 INFO:teuthology.orchestra.run.smithi094.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-03-31T23:05:34.020 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:19.0.0-1977.g384f31f3.el9. 39/198 2024-03-31T23:05:34.063 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el 40/198 2024-03-31T23:05:34.066 INFO:teuthology.orchestra.run.smithi094.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 324 kB/s | 35 kB 00:00 2024-03-31T23:05:34.092 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_6 41/198 2024-03-31T23:05:34.099 INFO:teuthology.orchestra.run.smithi094.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-03-31T23:05:34.158 INFO:teuthology.orchestra.run.smithi094.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-03-31T23:05:34.162 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-31T23:05:34.183 INFO:teuthology.orchestra.run.smithi094.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-03-31T23:05:34.200 INFO:teuthology.orchestra.run.smithi094.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-03-31T23:05:34.207 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-31T23:05:34.259 INFO:teuthology.orchestra.run.smithi094.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-03-31T23:05:34.284 INFO:teuthology.orchestra.run.smithi094.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-03-31T23:05:34.289 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-31T23:05:34.309 INFO:teuthology.orchestra.run.smithi094.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 178 kB/s | 19 kB 00:00 2024-03-31T23:05:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-03-31T23:05:34.410 INFO:teuthology.orchestra.run.smithi094.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-03-31T23:05:34.430 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-31T23:05:34.469 INFO:teuthology.orchestra.run.smithi094.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 726 kB/s | 79 kB 00:00 2024-03-31T23:05:34.483 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-31T23:05:34.502 INFO:teuthology.orchestra.run.smithi094.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-03-31T23:05:34.536 INFO:teuthology.orchestra.run.smithi094.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 459 kB/s | 58 kB 00:00 2024-03-31T23:05:34.603 INFO:teuthology.orchestra.run.smithi094.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-03-31T23:05:34.620 INFO:teuthology.orchestra.run.smithi094.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-03-31T23:05:34.645 INFO:teuthology.orchestra.run.smithi094.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-03-31T23:05:34.704 INFO:teuthology.orchestra.run.smithi094.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-03-31T23:05:34.871 INFO:teuthology.orchestra.run.smithi094.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 123 kB/s | 31 kB 00:00 2024-03-31T23:05:34.912 INFO:teuthology.orchestra.run.smithi094.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 283 kB/s | 59 kB 00:00 2024-03-31T23:05:34.938 INFO:teuthology.orchestra.run.smithi094.stdout:(142/174): python3-routes-2.5.1-5.el9.noarch.rp 644 kB/s | 188 kB 00:00 2024-03-31T23:05:34.980 INFO:teuthology.orchestra.run.smithi094.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-03-31T23:05:35.001 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-31T23:05:35.022 INFO:teuthology.orchestra.run.smithi094.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 467 kB/s | 51 kB 00:00 2024-03-31T23:05:35.056 INFO:teuthology.orchestra.run.smithi094.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-31T23:05:35.080 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-31T23:05:35.089 INFO:teuthology.orchestra.run.smithi094.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 823 kB/s | 90 kB 00:00 2024-03-31T23:05:35.131 INFO:teuthology.orchestra.run.smithi094.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-03-31T23:05:35.157 INFO:teuthology.orchestra.run.smithi042.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1977.g384f3 1.7 MB/s | 3.5 MB 00:02 2024-03-31T23:05:35.165 INFO:teuthology.orchestra.run.smithi094.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-03-31T23:05:35.174 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-31T23:05:35.198 INFO:teuthology.orchestra.run.smithi094.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-03-31T23:05:35.225 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T23:05:35.235 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T23:05:35.264 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-31T23:05:35.273 INFO:teuthology.orchestra.run.smithi094.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-31T23:05:35.307 INFO:teuthology.orchestra.run.smithi042.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1977.g38 1.6 MB/s | 248 kB 00:00 2024-03-31T23:05:35.313 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-31T23:05:35.352 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_6 53/198 2024-03-31T23:05:35.357 INFO:teuthology.orchestra.run.smithi094.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 27 MB/s | 2.3 MB 00:00 2024-03-31T23:05:35.381 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-31T23:05:35.424 INFO:teuthology.orchestra.run.smithi094.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-03-31T23:05:35.458 INFO:teuthology.orchestra.run.smithi094.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-31T23:05:35.500 INFO:teuthology.orchestra.run.smithi094.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-31T23:05:35.542 INFO:teuthology.orchestra.run.smithi094.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-03-31T23:05:35.565 INFO:teuthology.orchestra.run.smithi042.stdout:(33/174): ceph-mgr-rook-19.0.0-1977.g384f31f3.e 191 kB/s | 49 kB 00:00 2024-03-31T23:05:35.605 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-31T23:05:35.625 INFO:teuthology.orchestra.run.smithi094.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 857 kB/s | 71 kB 00:00 2024-03-31T23:05:35.676 INFO:teuthology.orchestra.run.smithi094.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 727 kB/s | 36 kB 00:00 2024-03-31T23:05:35.707 INFO:teuthology.orchestra.run.smithi042.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1977.g3 108 kB/s | 15 kB 00:00 2024-03-31T23:05:35.759 INFO:teuthology.orchestra.run.smithi094.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-31T23:05:35.785 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-31T23:05:35.843 INFO:teuthology.orchestra.run.smithi094.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-31T23:05:35.859 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-31T23:05:35.893 INFO:teuthology.orchestra.run.smithi094.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 459 kB/s | 23 kB 00:00 2024-03-31T23:05:35.903 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-31T23:05:35.924 INFO:teuthology.orchestra.run.smithi042.stdout:(35/174): ceph-volume-19.0.0-1977.g384f31f3.el9 1.2 MB/s | 264 kB 00:00 2024-03-31T23:05:35.943 INFO:teuthology.orchestra.run.smithi094.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-31T23:05:35.994 INFO:teuthology.orchestra.run.smithi094.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-31T23:05:36.052 INFO:teuthology.orchestra.run.smithi094.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-31T23:05:36.103 INFO:teuthology.orchestra.run.smithi094.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-03-31T23:05:36.153 INFO:teuthology.orchestra.run.smithi094.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 573 kB/s | 29 kB 00:00 2024-03-31T23:05:36.234 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-31T23:05:36.349 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-31T23:05:36.358 INFO:teuthology.orchestra.run.smithi042.stdout:(36/174): cephadm-19.0.0-1977.g384f31f3.el9.noa 1.7 MB/s | 748 kB 00:00 2024-03-31T23:05:36.362 INFO:teuthology.orchestra.run.smithi094.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 5.8 MB/s | 1.2 MB 00:00 2024-03-31T23:05:36.407 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-31T23:05:36.442 INFO:teuthology.orchestra.run.smithi042.stdout:(37/174): cephfs-top-19.0.0-1977.g384f31f3.el9. 219 kB/s | 18 kB 00:00 2024-03-31T23:05:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-31T23:05:36.512 INFO:teuthology.orchestra.run.smithi094.stdout:(167/174): librbd1-19.0.0-1977.g384f31f3.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-03-31T23:05:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-31T23:05:36.553 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-31T23:05:36.584 INFO:teuthology.orchestra.run.smithi042.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-03-31T23:05:36.600 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-31T23:05:36.635 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-31T23:05:36.642 INFO:teuthology.orchestra.run.smithi042.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-03-31T23:05:36.670 INFO:teuthology.orchestra.run.smithi094.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.0 MB/s | 2.2 MB 00:00 2024-03-31T23:05:36.676 INFO:teuthology.orchestra.run.smithi042.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-31T23:05:36.678 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-31T23:05:36.718 INFO:teuthology.orchestra.run.smithi042.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-31T23:05:36.720 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-31T23:05:36.743 INFO:teuthology.orchestra.run.smithi042.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2024-03-31T23:05:36.763 INFO:teuthology.orchestra.run.smithi094.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.0 MB/s | 465 kB 00:00 2024-03-31T23:05:36.821 INFO:teuthology.orchestra.run.smithi094.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 533 kB/s | 31 kB 00:00 2024-03-31T23:05:36.843 INFO:teuthology.orchestra.run.smithi042.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-03-31T23:05:36.851 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-31T23:05:36.904 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-31T23:05:36.935 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-31T23:05:36.935 INFO:teuthology.orchestra.run.smithi042.stdout:(44/174): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-03-31T23:05:36.952 INFO:teuthology.orchestra.run.smithi042.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 17 kB 00:00 2024-03-31T23:05:36.955 INFO:teuthology.orchestra.run.smithi094.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 5.2 MB/s | 2.3 MB 00:00 2024-03-31T23:05:36.969 INFO:teuthology.orchestra.run.smithi042.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-03-31T23:05:36.976 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-31T23:05:36.989 INFO:teuthology.orchestra.run.smithi094.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2024-03-31T23:05:36.994 INFO:teuthology.orchestra.run.smithi042.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-31T23:05:37.012 INFO:teuthology.orchestra.run.smithi042.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-31T23:05:37.037 INFO:teuthology.orchestra.run.smithi042.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2024-03-31T23:05:37.055 INFO:teuthology.orchestra.run.smithi094.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 742 kB/s | 74 kB 00:00 2024-03-31T23:05:37.070 INFO:teuthology.orchestra.run.smithi042.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2024-03-31T23:05:37.071 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-31T23:05:37.087 INFO:teuthology.orchestra.run.smithi042.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 46 kB 00:00 2024-03-31T23:05:37.109 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-31T23:05:37.113 INFO:teuthology.orchestra.run.smithi042.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-31T23:05:37.138 INFO:teuthology.orchestra.run.smithi042.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-31T23:05:37.149 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-31T23:05:37.163 INFO:teuthology.orchestra.run.smithi042.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-31T23:05:37.175 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-31T23:05:37.180 INFO:teuthology.orchestra.run.smithi042.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 828 kB/s | 34 kB 00:00 2024-03-31T23:05:37.200 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-31T23:05:37.273 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-31T23:05:37.280 INFO:teuthology.orchestra.run.smithi094.stdout:(174/174): librados2-19.0.0-1977.g384f31f3.el9. 1.6 MB/s | 3.4 MB 00:02 2024-03-31T23:05:37.288 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-03-31T23:05:37.288 INFO:teuthology.orchestra.run.smithi094.stdout:Total 7.6 MB/s | 226 MB 00:29 2024-03-31T23:05:37.289 INFO:teuthology.orchestra.run.smithi042.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-03-31T23:05:37.331 INFO:teuthology.orchestra.run.smithi042.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-03-31T23:05:37.365 INFO:teuthology.orchestra.run.smithi042.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 817 kB 00:00 2024-03-31T23:05:37.381 INFO:teuthology.orchestra.run.smithi042.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.7 MB/s | 132 kB 00:00 2024-03-31T23:05:37.392 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-31T23:05:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-31T23:05:37.507 INFO:teuthology.orchestra.run.smithi042.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-31T23:05:37.541 INFO:teuthology.orchestra.run.smithi042.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-03-31T23:05:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-31T23:05:37.557 INFO:teuthology.orchestra.run.smithi042.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.6 MB/s | 78 kB 00:00 2024-03-31T23:05:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-31T23:05:37.646 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-31T23:05:37.656 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-03-31T23:05:37.683 INFO:teuthology.orchestra.run.smithi042.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-03-31T23:05:37.708 INFO:teuthology.orchestra.run.smithi042.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 164 kB/s | 24 kB 00:00 2024-03-31T23:05:37.742 INFO:teuthology.orchestra.run.smithi042.stdout:(65/174): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2024-03-31T23:05:37.767 INFO:teuthology.orchestra.run.smithi042.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 309 kB/s | 18 kB 00:00 2024-03-31T23:05:37.792 INFO:teuthology.orchestra.run.smithi042.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 630 kB/s | 32 kB 00:00 2024-03-31T23:05:37.830 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-31T23:05:37.880 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-31T23:05:37.918 INFO:teuthology.orchestra.run.smithi042.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-31T23:05:37.932 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-03-31T23:05:37.932 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-03-31T23:05:37.943 INFO:teuthology.orchestra.run.smithi042.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-31T23:05:37.968 INFO:teuthology.orchestra.run.smithi042.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-31T23:05:37.985 INFO:teuthology.orchestra.run.smithi042.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-03-31T23:05:38.008 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-31T23:05:38.010 INFO:teuthology.orchestra.run.smithi042.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 983 kB/s | 41 kB 00:00 2024-03-31T23:05:38.036 INFO:teuthology.orchestra.run.smithi042.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-31T23:05:38.044 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-31T23:05:38.061 INFO:teuthology.orchestra.run.smithi042.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-31T23:05:38.076 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-31T23:05:38.086 INFO:teuthology.orchestra.run.smithi042.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-31T23:05:38.111 INFO:teuthology.orchestra.run.smithi042.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2024-03-31T23:05:38.116 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T23:05:38.136 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-31T23:05:38.136 INFO:teuthology.orchestra.run.smithi042.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 858 kB/s | 43 kB 00:00 2024-03-31T23:05:38.161 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-31T23:05:38.200 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-31T23:05:38.233 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-31T23:05:38.262 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-31T23:05:38.270 INFO:teuthology.orchestra.run.smithi042.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 296 kB/s | 39 kB 00:00 2024-03-31T23:05:38.339 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-31T23:05:38.373 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-31T23:05:38.406 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-31T23:05:38.446 INFO:teuthology.orchestra.run.smithi042.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-03-31T23:05:38.447 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-31T23:05:38.471 INFO:teuthology.orchestra.run.smithi042.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 207 kB/s | 41 kB 00:00 2024-03-31T23:05:38.482 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-31T23:05:38.496 INFO:teuthology.orchestra.run.smithi042.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-03-31T23:05:38.521 INFO:teuthology.orchestra.run.smithi042.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 698 kB/s | 35 kB 00:00 2024-03-31T23:05:38.547 INFO:teuthology.orchestra.run.smithi042.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 925 kB/s | 46 kB 00:00 2024-03-31T23:05:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-31T23:05:38.572 INFO:teuthology.orchestra.run.smithi042.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-03-31T23:05:38.589 INFO:teuthology.orchestra.run.smithi042.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-03-31T23:05:38.606 INFO:teuthology.orchestra.run.smithi042.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-31T23:05:38.623 INFO:teuthology.orchestra.run.smithi042.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-31T23:05:38.648 INFO:teuthology.orchestra.run.smithi042.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-31T23:05:38.674 INFO:teuthology.orchestra.run.smithi042.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-31T23:05:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-31T23:05:38.716 INFO:teuthology.orchestra.run.smithi042.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-03-31T23:05:38.741 INFO:teuthology.orchestra.run.smithi042.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-03-31T23:05:38.766 INFO:teuthology.orchestra.run.smithi042.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-31T23:05:38.792 INFO:teuthology.orchestra.run.smithi042.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2024-03-31T23:05:38.888 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-31T23:05:38.958 INFO:teuthology.orchestra.run.smithi042.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 978 kB/s | 187 kB 00:00 2024-03-31T23:05:39.017 INFO:teuthology.orchestra.run.smithi042.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-03-31T23:05:39.062 INFO:teuthology.orchestra.run.smithi042.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-03-31T23:05:39.084 INFO:teuthology.orchestra.run.smithi042.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-31T23:05:39.100 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-31T23:05:39.118 INFO:teuthology.orchestra.run.smithi042.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 367 kB/s | 21 kB 00:00 2024-03-31T23:05:39.135 INFO:teuthology.orchestra.run.smithi042.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-03-31T23:05:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-31T23:05:39.210 INFO:teuthology.orchestra.run.smithi042.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 3.2 MB/s | 245 kB 00:00 2024-03-31T23:05:39.240 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-31T23:05:39.288 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-31T23:05:39.327 INFO:teuthology.orchestra.run.smithi042.stdout:(101/174): openssl-devel-3.0.7-27.el9.x86_64.rp 20 MB/s | 4.1 MB 00:00 2024-03-31T23:05:39.353 INFO:teuthology.orchestra.run.smithi042.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.7 MB/s | 248 kB 00:00 2024-03-31T23:05:39.403 INFO:teuthology.orchestra.run.smithi042.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-31T23:05:39.646 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-03-31T23:05:39.646 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-03-31T23:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-03-31T23:05:39.962 INFO:teuthology.orchestra.run.smithi042.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-03-31T23:05:40.017 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-31T23:05:40.029 INFO:teuthology.orchestra.run.smithi042.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-03-31T23:05:40.060 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-31T23:05:40.082 INFO:teuthology.orchestra.run.smithi042.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-03-31T23:05:40.094 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-31T23:05:40.112 INFO:teuthology.orchestra.run.smithi042.stdout:(108/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-03-31T23:05:40.143 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-31T23:05:40.229 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-31T23:05:40.261 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-31T23:05:40.438 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-31T23:05:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-31T23:05:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:(109/174): ceph-test-19.0.0-1977.g384f31f3.el9. 3.6 MB/s | 47 MB 00:13 2024-03-31T23:05:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-31T23:05:40.629 INFO:teuthology.orchestra.run.smithi042.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 50 kB/s | 26 kB 00:00 2024-03-31T23:05:40.680 INFO:teuthology.orchestra.run.smithi042.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2024-03-31T23:05:40.747 INFO:teuthology.orchestra.run.smithi042.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-03-31T23:05:40.822 INFO:teuthology.orchestra.run.smithi042.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-03-31T23:05:40.847 INFO:teuthology.orchestra.run.smithi042.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 904 kB/s | 151 kB 00:00 2024-03-31T23:05:40.923 INFO:teuthology.orchestra.run.smithi042.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-03-31T23:05:40.948 INFO:teuthology.orchestra.run.smithi042.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-03-31T23:05:40.982 INFO:teuthology.orchestra.run.smithi042.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-03-31T23:05:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2024-03-31T23:05:41.107 INFO:teuthology.orchestra.run.smithi042.stdout:(119/174): python3-cachetools-4.2.4-1.el9.noarc 175 kB/s | 32 kB 00:00 2024-03-31T23:05:41.133 INFO:teuthology.orchestra.run.smithi042.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-03-31T23:05:41.174 INFO:teuthology.orchestra.run.smithi042.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-03-31T23:05:41.179 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-31T23:05:41.191 INFO:teuthology.orchestra.run.smithi042.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 605 kB/s | 35 kB 00:00 2024-03-31T23:05:41.216 INFO:teuthology.orchestra.run.smithi042.stdout:(123/174): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-03-31T23:05:41.242 INFO:teuthology.orchestra.run.smithi042.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-03-31T23:05:41.276 INFO:teuthology.orchestra.run.smithi042.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-31T23:05:41.292 INFO:teuthology.orchestra.run.smithi042.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-03-31T23:05:41.299 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-31T23:05:41.334 INFO:teuthology.orchestra.run.smithi042.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-03-31T23:05:41.351 INFO:teuthology.orchestra.run.smithi042.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-03-31T23:05:41.368 INFO:teuthology.orchestra.run.smithi042.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-03-31T23:05:41.385 INFO:teuthology.orchestra.run.smithi042.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-03-31T23:05:41.419 INFO:teuthology.orchestra.run.smithi042.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-03-31T23:05:41.436 INFO:teuthology.orchestra.run.smithi042.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 920 kB/s | 46 kB 00:00 2024-03-31T23:05:41.478 INFO:teuthology.orchestra.run.smithi042.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-03-31T23:05:41.494 INFO:teuthology.orchestra.run.smithi042.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 986 kB/s | 58 kB 00:00 2024-03-31T23:05:41.528 INFO:teuthology.orchestra.run.smithi042.stdout:(135/174): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-03-31T23:05:41.545 INFO:teuthology.orchestra.run.smithi042.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-03-31T23:05:41.570 INFO:teuthology.orchestra.run.smithi042.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-31T23:05:41.587 INFO:teuthology.orchestra.run.smithi042.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-03-31T23:05:41.604 INFO:teuthology.orchestra.run.smithi042.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 479 kB/s | 28 kB 00:00 2024-03-31T23:05:41.621 INFO:teuthology.orchestra.run.smithi042.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-03-31T23:05:41.646 INFO:teuthology.orchestra.run.smithi042.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-03-31T23:05:41.663 INFO:teuthology.orchestra.run.smithi042.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-31T23:05:41.680 INFO:teuthology.orchestra.run.smithi042.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-03-31T23:05:41.697 INFO:teuthology.orchestra.run.smithi042.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-31T23:05:41.722 INFO:teuthology.orchestra.run.smithi042.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-03-31T23:05:41.740 INFO:teuthology.orchestra.run.smithi042.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-03-31T23:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-03-31T23:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-03-31T23:05:41.840 INFO:teuthology.orchestra.run.smithi042.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-31T23:05:41.907 INFO:teuthology.orchestra.run.smithi042.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-31T23:05:41.991 INFO:teuthology.orchestra.run.smithi042.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 27 MB/s | 2.3 MB 00:00 2024-03-31T23:05:42.117 INFO:teuthology.orchestra.run.smithi042.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 15 MB/s | 1.8 MB 00:00 2024-03-31T23:05:42.142 INFO:teuthology.orchestra.run.smithi042.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.6 MB/s | 41 kB 00:00 2024-03-31T23:05:42.184 INFO:teuthology.orchestra.run.smithi042.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-31T23:05:42.226 INFO:teuthology.orchestra.run.smithi042.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-03-31T23:05:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 859 kB/s | 71 kB 00:00 2024-03-31T23:05:42.351 INFO:teuthology.orchestra.run.smithi042.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 872 kB/s | 36 kB 00:00 2024-03-31T23:05:42.435 INFO:teuthology.orchestra.run.smithi042.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-31T23:05:42.513 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-31T23:05:42.518 INFO:teuthology.orchestra.run.smithi042.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-31T23:05:42.569 INFO:teuthology.orchestra.run.smithi042.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 461 kB/s | 23 kB 00:00 2024-03-31T23:05:42.586 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-31T23:05:42.610 INFO:teuthology.orchestra.run.smithi042.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 108 kB 00:00 2024-03-31T23:05:42.617 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-31T23:05:42.648 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-31T23:05:42.661 INFO:teuthology.orchestra.run.smithi042.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-31T23:05:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-31T23:05:42.711 INFO:teuthology.orchestra.run.smithi042.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 136 kB 00:00 2024-03-31T23:05:42.753 INFO:teuthology.orchestra.run.smithi042.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-31T23:05:42.795 INFO:teuthology.orchestra.run.smithi042.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 691 kB/s | 29 kB 00:00 2024-03-31T23:05:42.978 INFO:teuthology.orchestra.run.smithi042.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 6.6 MB/s | 1.2 MB 00:00 2024-03-31T23:05:42.987 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-31T23:05:43.014 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 124/198 2024-03-31T23:05:43.086 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 124/198 2024-03-31T23:05:43.119 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 125/198 2024-03-31T23:05:43.154 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-31T23:05:43.254 INFO:teuthology.orchestra.run.smithi042.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.8 MB/s | 2.2 MB 00:00 2024-03-31T23:05:43.471 INFO:teuthology.orchestra.run.smithi042.stdout:(168/174): librados2-19.0.0-1977.g384f31f3.el9. 2.0 MB/s | 3.4 MB 00:01 2024-03-31T23:05:43.554 INFO:teuthology.orchestra.run.smithi042.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.6 MB/s | 2.3 MB 00:00 2024-03-31T23:05:43.596 INFO:teuthology.orchestra.run.smithi042.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 751 kB/s | 31 kB 00:00 2024-03-31T23:05:43.606 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-31T23:05:43.633 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 128/198 2024-03-31T23:05:43.655 INFO:teuthology.orchestra.run.smithi042.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 2.5 MB/s | 465 kB 00:00 2024-03-31T23:05:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 128/198 2024-03-31T23:05:43.714 INFO:teuthology.orchestra.run.smithi042.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.2 MB/s | 1.1 MB 00:00 2024-03-31T23:05:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 129/198 2024-03-31T23:05:43.730 INFO:teuthology.orchestra.run.smithi042.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 990 kB/s | 74 kB 00:00 2024-03-31T23:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout:(174/174): librbd1-19.0.0-1977.g384f31f3.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-03-31T23:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-03-31T23:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout:Total 6.5 MB/s | 226 MB 00:34 2024-03-31T23:05:44.402 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-03-31T23:05:44.698 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-03-31T23:05:44.698 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-03-31T23:05:45.924 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:05:45.957 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:05:46.492 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:05:46.527 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 131/198 2024-03-31T23:05:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 131/198 2024-03-31T23:05:46.608 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-31T23:05:46.608 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-31T23:05:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:05:46.616 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-03-31T23:05:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 132/198 2024-03-31T23:05:46.752 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-31T23:05:46.778 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-31T23:05:46.809 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-03-31T23:05:46.809 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-03-31T23:05:46.817 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T23:05:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T23:05:46.866 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-31T23:05:46.945 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-31T23:05:46.978 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-31T23:05:47.013 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-31T23:05:47.054 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-31T23:05:47.375 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-31T23:05:47.422 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:05:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:05:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:05:47.631 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:05:47.661 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 12/198 2024-03-31T23:05:47.698 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-31T23:05:47.869 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-31T23:05:47.934 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-31T23:05:47.962 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:05:48.057 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:05:48.080 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 17/198 2024-03-31T23:05:48.144 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 17/198 2024-03-31T23:05:48.192 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-31T23:05:48.215 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T23:05:48.230 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T23:05:48.414 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T23:05:48.446 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T23:05:48.486 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-31T23:05:48.581 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-31T23:05:48.680 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T23:05:48.740 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T23:05:48.811 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:48.866 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:49.078 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:49.188 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-31T23:05:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-31T23:05:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-31T23:05:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-31T23:05:49.375 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-31T23:05:49.455 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-31T23:05:49.495 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-31T23:05:49.534 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-31T23:05:49.597 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-31T23:05:49.632 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-31T23:05:49.676 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-31T23:05:49.709 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-31T23:05:49.737 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-31T23:05:49.806 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-31T23:05:49.842 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:19.0.0-1977.g384f31f3.el9. 39/198 2024-03-31T23:05:49.885 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el 40/198 2024-03-31T23:05:49.906 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_6 41/198 2024-03-31T23:05:49.974 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-31T23:05:50.020 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-31T23:05:50.094 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-31T23:05:50.227 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-31T23:05:50.281 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-31T23:05:50.797 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-31T23:05:50.885 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-31T23:05:50.962 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-31T23:05:51.014 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T23:05:51.023 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T23:05:51.054 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-31T23:05:51.094 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-31T23:05:51.132 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_6 53/198 2024-03-31T23:05:51.162 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-31T23:05:51.398 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-31T23:05:51.569 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-31T23:05:51.623 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-31T23:05:51.659 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-31T23:05:51.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-31T23:05:51.862 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-31T23:05:51.918 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-31T23:05:51.990 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-31T23:05:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-31T23:05:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-31T23:05:52.104 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-31T23:05:52.145 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-31T23:05:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-31T23:05:52.230 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-31T23:05:52.363 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-31T23:05:52.403 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-31T23:05:52.433 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-31T23:05:52.475 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-31T23:05:52.568 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-31T23:05:52.616 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-31T23:05:52.656 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-31T23:05:52.682 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-31T23:05:52.707 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-31T23:05:52.779 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-31T23:05:52.907 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-31T23:05:53.048 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-31T23:05:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-31T23:05:53.139 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-31T23:05:53.194 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-31T23:05:53.377 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-31T23:05:53.420 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-31T23:05:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-31T23:05:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-31T23:05:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-31T23:05:53.665 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T23:05:53.693 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-31T23:05:53.727 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-31T23:05:53.766 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-31T23:05:53.798 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-31T23:05:53.828 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-31T23:05:53.903 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-31T23:05:53.909 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-03-31T23:05:53.938 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-31T23:05:53.972 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-31T23:05:53.993 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-31T23:05:54.013 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-31T23:05:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-31T23:05:54.048 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-31T23:05:54.075 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T23:05:54.085 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T23:05:54.133 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-31T23:05:54.136 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-31T23:05:54.188 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-31T23:05:54.220 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-31T23:05:54.237 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-31T23:05:54.251 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-31T23:05:54.287 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-31T23:05:54.304 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-31T23:05:54.318 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-31T23:05:54.365 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-31T23:05:54.462 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-31T23:05:54.511 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-31T23:05:54.649 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-31T23:05:54.703 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:05:54.836 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:05:54.862 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:05:54.954 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:05:54.988 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 12/198 2024-03-31T23:05:55.042 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-31T23:05:55.236 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-31T23:05:55.246 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-31T23:05:55.293 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-31T23:05:55.314 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-31T23:05:55.326 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-31T23:05:55.341 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:05:55.374 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-31T23:05:55.447 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:05:55.453 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-31T23:05:55.476 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 17/198 2024-03-31T23:05:55.485 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-31T23:05:55.533 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 17/198 2024-03-31T23:05:55.572 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-31T23:05:55.594 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T23:05:55.611 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T23:05:55.662 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-31T23:05:55.708 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-31T23:05:55.785 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-31T23:05:55.786 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T23:05:55.818 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T23:05:55.858 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-31T23:05:56.043 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-31T23:05:56.211 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T23:05:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T23:05:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:56.414 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:56.418 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-31T23:05:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-31T23:05:56.620 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T23:05:56.731 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-31T23:05:56.826 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-31T23:05:56.861 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-31T23:05:56.888 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-31T23:05:56.915 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-31T23:05:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-31T23:05:57.055 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-31T23:05:57.093 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-31T23:05:57.158 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-31T23:05:57.200 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-31T23:05:57.243 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-31T23:05:57.276 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-31T23:05:57.303 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-31T23:05:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-31T23:05:57.416 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.0.0-1977.g384f31f3.el9. 39/198 2024-03-31T23:05:57.452 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el 40/198 2024-03-31T23:05:57.480 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_6 41/198 2024-03-31T23:05:57.553 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-31T23:05:57.594 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-31T23:05:57.672 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-31T23:05:57.732 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-31T23:05:57.809 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-31T23:05:57.810 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-31T23:05:57.841 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-31T23:05:57.865 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-31T23:05:57.872 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-31T23:05:57.900 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-31T23:05:58.211 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-31T23:05:58.238 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 124/198 2024-03-31T23:05:58.329 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 124/198 2024-03-31T23:05:58.359 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 125/198 2024-03-31T23:05:58.396 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-31T23:05:58.420 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-31T23:05:58.503 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-31T23:05:58.523 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 132/198 2024-03-31T23:05:58.523 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-03-31T23:05:58.523 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-03-31T23:05:58.524 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-03-31T23:05:58.524 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-03-31T23:05:58.524 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-03-31T23:05:58.524 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2024-03-31T23:05:58.524 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-03-31T23:05:58.524 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:05:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-31T23:05:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T23:05:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T23:05:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-31T23:05:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 133/198 2024-03-31T23:05:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 133/198 2024-03-31T23:05:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:05:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-31T23:05:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:05:58.718 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-31T23:05:58.756 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_6 53/198 2024-03-31T23:05:58.786 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-31T23:05:58.848 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-31T23:05:58.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 128/198 2024-03-31T23:05:58.937 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 128/198 2024-03-31T23:05:58.961 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 129/198 2024-03-31T23:05:59.073 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-31T23:05:59.258 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-31T23:05:59.338 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-31T23:05:59.382 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-31T23:05:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-31T23:05:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-31T23:05:59.624 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-31T23:05:59.699 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-31T23:05:59.735 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-31T23:05:59.771 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-31T23:05:59.820 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-31T23:05:59.855 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-31T23:05:59.898 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-31T23:05:59.941 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-31T23:06:00.082 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-31T23:06:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-31T23:06:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-31T23:06:00.162 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 134/198 2024-03-31T23:06:00.187 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 134/198 2024-03-31T23:06:00.187 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:00.187 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-31T23:06:00.188 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T23:06:00.188 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T23:06:00.188 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-31T23:06:00.299 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-31T23:06:00.342 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-31T23:06:00.382 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-31T23:06:00.407 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-31T23:06:00.412 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 135/198 2024-03-31T23:06:00.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-31T23:06:00.435 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 135/198 2024-03-31T23:06:00.435 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:00.435 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-31T23:06:00.435 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T23:06:00.435 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T23:06:00.435 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:00.512 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-31T23:06:00.638 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-31T23:06:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-31T23:06:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-31T23:06:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-31T23:06:00.880 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 136/198 2024-03-31T23:06:00.902 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 136/198 2024-03-31T23:06:00.902 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:00.903 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-31T23:06:00.903 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T23:06:00.903 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T23:06:00.903 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:00.904 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-31T23:06:00.990 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-31T23:06:01.097 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-31T23:06:01.145 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-31T23:06:01.214 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:06:01.248 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:06:01.290 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-31T23:06:01.334 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-31T23:06:01.366 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-31T23:06:01.397 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T23:06:01.425 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-31T23:06:01.434 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 138/198 2024-03-31T23:06:01.459 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-31T23:06:01.466 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 138/198 2024-03-31T23:06:01.497 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.e 139/198 2024-03-31T23:06:01.499 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-31T23:06:01.530 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-31T23:06:01.557 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3. 140/198 2024-03-31T23:06:01.560 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-31T23:06:01.581 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 141/198 2024-03-31T23:06:01.648 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-31T23:06:01.687 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-31T23:06:01.721 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-31T23:06:01.763 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-31T23:06:01.782 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:06:01.805 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-31T23:06:01.819 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 131/198 2024-03-31T23:06:01.899 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-31T23:06:01.900 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 131/198 2024-03-31T23:06:01.900 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-31T23:06:01.900 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-31T23:06:01.900 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:01.928 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 132/198 2024-03-31T23:06:01.988 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-31T23:06:02.036 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-31T23:06:02.075 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-31T23:06:02.123 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-31T23:06:02.226 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-31T23:06:02.278 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-31T23:06:02.602 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 141/198 2024-03-31T23:06:02.632 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 142/198 2024-03-31T23:06:03.049 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-31T23:06:03.107 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-31T23:06:03.141 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-31T23:06:03.191 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-31T23:06:03.283 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-31T23:06:03.317 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-31T23:06:03.501 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-31T23:06:03.531 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-31T23:06:03.590 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 142/198 2024-03-31T23:06:03.615 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-31T23:06:03.624 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 143/198 2024-03-31T23:06:03.722 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 143/198 2024-03-31T23:06:03.877 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el 144/198 2024-03-31T23:06:03.909 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 145/198 2024-03-31T23:06:03.933 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 145/198 2024-03-31T23:06:03.933 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:03.933 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-31T23:06:03.933 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T23:06:03.933 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T23:06:03.933 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 146/198 2024-03-31T23:06:03.995 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 146/198 2024-03-31T23:06:04.041 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 147/198 2024-03-31T23:06:04.314 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-31T23:06:04.441 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-31T23:06:04.899 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-31T23:06:04.938 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 149/198 2024-03-31T23:06:04.960 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 149/198 2024-03-31T23:06:04.960 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:04.960 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-31T23:06:04.960 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T23:06:04.960 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T23:06:04.960 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:05.005 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1977.g384f3 150/198 2024-03-31T23:06:05.026 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1977.g384f3 150/198 2024-03-31T23:06:05.027 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:05.027 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-31T23:06:05.027 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:05.073 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:05.095 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:05.095 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:05.095 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-31T23:06:05.095 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T23:06:05.095 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T23:06:05.095 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:05.415 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 152/198 2024-03-31T23:06:05.437 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 152/198 2024-03-31T23:06:05.438 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:05.438 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-31T23:06:05.438 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T23:06:05.438 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T23:06:05.438 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:05.728 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-31T23:06:05.807 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-31T23:06:05.838 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-31T23:06:05.869 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-31T23:06:05.897 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-31T23:06:06.225 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-31T23:06:06.268 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 124/198 2024-03-31T23:06:06.359 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 124/198 2024-03-31T23:06:06.389 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 125/198 2024-03-31T23:06:06.426 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-31T23:06:06.906 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-31T23:06:06.938 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 128/198 2024-03-31T23:06:07.009 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 128/198 2024-03-31T23:06:07.039 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 129/198 2024-03-31T23:06:09.380 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:06:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:06:09.861 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 153/198 2024-03-31T23:06:09.902 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 154/198 2024-03-31T23:06:09.941 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 155/198 2024-03-31T23:06:09.968 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-31T23:06:09.994 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 130/198 2024-03-31T23:06:10.039 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 131/198 2024-03-31T23:06:10.122 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 131/198 2024-03-31T23:06:10.122 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-31T23:06:10.123 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-31T23:06:10.123 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 157/198 2024-03-31T23:06:10.157 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 132/198 2024-03-31T23:06:10.259 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-31T23:06:10.308 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 159/198 2024-03-31T23:06:10.347 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-31T23:06:10.408 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-31T23:06:10.451 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-31T23:06:10.475 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_ 163/198 2024-03-31T23:06:10.516 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-31T23:06:10.545 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-31T23:06:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-31T23:06:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-31T23:06:10.694 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-31T23:06:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:11.279 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:12.087 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 170/198 2024-03-31T23:06:12.180 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-31T23:06:12.220 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-31T23:06:12.301 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-31T23:06:12.334 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-31T23:06:12.359 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-31T23:06:12.420 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-31T23:06:12.444 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-31T23:06:12.444 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T23:06:12.532 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T23:06:12.562 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-31T23:06:12.562 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T23:06:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T23:06:12.673 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-31T23:06:12.706 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-31T23:06:12.731 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-31T23:06:12.756 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-31T23:06:12.789 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-31T23:06:12.829 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-31T23:06:12.861 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-31T23:06:12.887 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-31T23:06:12.912 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-31T23:06:12.937 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-31T23:06:12.962 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-31T23:06:12.969 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:12.969 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T23:06:13.231 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T23:06:13.263 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-31T23:06:13.290 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-31T23:06:13.316 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-31T23:06:13.341 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-31T23:06:13.405 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 132/198 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-03-31T23:06:13.889 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 133/198 2024-03-31T23:06:14.069 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 133/198 2024-03-31T23:06:14.070 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:14.070 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-31T23:06:14.070 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:15.558 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 134/198 2024-03-31T23:06:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 134/198 2024-03-31T23:06:15.586 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:15.586 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-31T23:06:15.586 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T23:06:15.586 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T23:06:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:15.800 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 135/198 2024-03-31T23:06:15.822 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 135/198 2024-03-31T23:06:15.822 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:15.822 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-31T23:06:15.822 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T23:06:15.823 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T23:06:15.823 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:16.268 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 136/198 2024-03-31T23:06:16.290 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 136/198 2024-03-31T23:06:16.290 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:16.290 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-31T23:06:16.290 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T23:06:16.290 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T23:06:16.290 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:16.395 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-31T23:06:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 138/198 2024-03-31T23:06:16.777 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 138/198 2024-03-31T23:06:16.800 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.e 139/198 2024-03-31T23:06:16.861 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3. 140/198 2024-03-31T23:06:16.883 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 141/198 2024-03-31T23:06:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 141/198 2024-03-31T23:06:17.943 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 142/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 1/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 2/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 3/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 4/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1977.g384f3 5/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 6/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 7/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 8/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 9/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:06:18.748 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 12/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 13/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 14/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_ 15/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 17/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_6 18/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 19/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 20/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el 21/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.0.0-1977.g384f31f3.el9. 22/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_6 23/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 24/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 25/198 2024-03-31T23:06:18.749 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 26/198 2024-03-31T23:06:18.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 27/198 2024-03-31T23:06:18.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 28/198 2024-03-31T23:06:18.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 29/198 2024-03-31T23:06:18.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3. 30/198 2024-03-31T23:06:18.750 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 31/198 2024-03-31T23:06:18.765 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 32/198 2024-03-31T23:06:18.765 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 33/198 2024-03-31T23:06:18.765 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el 34/198 2024-03-31T23:06:18.765 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 35/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.e 36/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 37/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 38/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 39/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-31T23:06:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-31T23:06:18.767 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-31T23:06:18.768 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-31T23:06:18.769 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-31T23:06:18.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-31T23:06:18.771 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-31T23:06:18.772 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-31T23:06:18.773 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-31T23:06:18.774 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 153/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-31T23:06:18.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-31T23:06:18.776 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-31T23:06:18.777 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-31T23:06:18.778 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-31T23:06:18.778 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-31T23:06:18.778 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-31T23:06:18.778 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-31T23:06:18.778 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-31T23:06:18.904 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 142/198 2024-03-31T23:06:18.927 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 143/198 2024-03-31T23:06:19.029 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 143/198 2024-03-31T23:06:19.190 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el 144/198 2024-03-31T23:06:19.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 145/198 2024-03-31T23:06:19.243 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 145/198 2024-03-31T23:06:19.244 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:19.244 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-31T23:06:19.244 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T23:06:19.244 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T23:06:19.244 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:19.297 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 146/198 2024-03-31T23:06:19.307 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 146/198 2024-03-31T23:06:19.353 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 147/198 2024-03-31T23:06:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-31T23:06:20.249 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 149/198 2024-03-31T23:06:20.271 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 149/198 2024-03-31T23:06:20.271 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:20.271 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-31T23:06:20.271 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T23:06:20.272 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T23:06:20.272 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:20.317 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1977.g384f3 150/198 2024-03-31T23:06:20.338 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1977.g384f3 150/198 2024-03-31T23:06:20.338 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:20.339 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-31T23:06:20.339 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:20.384 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:20.406 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:20.406 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:20.406 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-31T23:06:20.406 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T23:06:20.406 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T23:06:20.406 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:20.710 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 152/198 2024-03-31T23:06:20.732 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 152/198 2024-03-31T23:06:20.732 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:20.732 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-31T23:06:20.732 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T23:06:20.732 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T23:06:20.733 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:21.664 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-31T23:06:21.664 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:21.664 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: acl-2.3.1-4.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.665 INFO:teuthology.orchestra.run.smithi188.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-31T23:06:21.666 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.2-8.el9.noarch 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.7.4-5.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.667 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.668 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.668 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.668 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.668 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.668 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-31T23:06:21.669 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.4-9.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.6-16.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-31T23:06:21.670 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-31T23:06:21.671 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-31T23:06:21.672 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-13.14-1.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-31T23:06:21.673 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-31T23:06:21.674 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-31T23:06:21.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-31T23:06:21.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-31T23:06:21.677 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-31T23:06:21.678 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-31T23:06:21.679 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-31T23:06:21.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:06:21.679 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-03-31T23:06:22.147 DEBUG:teuthology.parallel:result is None 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 132/198 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-03-31T23:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:22.478 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 133/198 2024-03-31T23:06:22.494 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 133/198 2024-03-31T23:06:22.494 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:22.494 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-31T23:06:22.494 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:24.040 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 134/198 2024-03-31T23:06:24.065 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 134/198 2024-03-31T23:06:24.065 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:24.065 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-31T23:06:24.065 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T23:06:24.065 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T23:06:24.066 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 135/198 2024-03-31T23:06:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 135/198 2024-03-31T23:06:24.330 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:24.330 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-31T23:06:24.330 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T23:06:24.330 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T23:06:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:24.808 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 136/198 2024-03-31T23:06:24.831 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 136/198 2024-03-31T23:06:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-31T23:06:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T23:06:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T23:06:24.831 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:24.927 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-31T23:06:25.157 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 153/198 2024-03-31T23:06:25.197 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 154/198 2024-03-31T23:06:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 155/198 2024-03-31T23:06:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-31T23:06:25.361 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 138/198 2024-03-31T23:06:25.391 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 138/198 2024-03-31T23:06:25.423 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.e 139/198 2024-03-31T23:06:25.435 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 157/198 2024-03-31T23:06:25.487 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3. 140/198 2024-03-31T23:06:25.514 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 141/198 2024-03-31T23:06:25.554 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-31T23:06:25.595 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 159/198 2024-03-31T23:06:25.634 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-31T23:06:25.687 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-31T23:06:25.721 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-31T23:06:25.746 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_ 163/198 2024-03-31T23:06:25.787 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-31T23:06:25.816 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-31T23:06:25.879 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-31T23:06:25.941 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-31T23:06:25.973 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-31T23:06:26.550 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:26.588 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:26.602 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 141/198 2024-03-31T23:06:26.608 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:26.641 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 142/198 2024-03-31T23:06:27.431 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 170/198 2024-03-31T23:06:27.518 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-31T23:06:27.558 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-31T23:06:27.639 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-31T23:06:27.660 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 142/198 2024-03-31T23:06:27.688 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-31T23:06:27.692 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 143/198 2024-03-31T23:06:27.713 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-31T23:06:27.739 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-31T23:06:27.765 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-31T23:06:27.765 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T23:06:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 143/198 2024-03-31T23:06:27.861 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T23:06:27.891 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-31T23:06:27.891 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T23:06:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el 144/198 2024-03-31T23:06:27.976 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T23:06:28.002 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-31T23:06:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 145/198 2024-03-31T23:06:28.025 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 145/198 2024-03-31T23:06:28.025 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:28.025 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-31T23:06:28.025 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T23:06:28.025 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T23:06:28.025 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:28.035 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-31T23:06:28.069 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-31T23:06:28.069 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 146/198 2024-03-31T23:06:28.080 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 146/198 2024-03-31T23:06:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-31T23:06:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-31T23:06:28.136 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 147/198 2024-03-31T23:06:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-31T23:06:28.216 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-31T23:06:28.241 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-31T23:06:28.266 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-31T23:06:28.292 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-31T23:06:28.317 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-31T23:06:28.323 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:28.323 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:28.495 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:28.495 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T23:06:28.578 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T23:06:28.610 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-31T23:06:28.636 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-31T23:06:28.662 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-31T23:06:28.687 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-31T23:06:28.754 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T23:06:29.039 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-31T23:06:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 149/198 2024-03-31T23:06:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 149/198 2024-03-31T23:06:29.094 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:29.094 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-31T23:06:29.094 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T23:06:29.094 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T23:06:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1977.g384f3 150/198 2024-03-31T23:06:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1977.g384f3 150/198 2024-03-31T23:06:29.161 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:29.161 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-31T23:06:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:29.206 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:29.228 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:29.228 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:29.228 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-31T23:06:29.228 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T23:06:29.229 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T23:06:29.229 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:29.557 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 152/198 2024-03-31T23:06:29.579 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 152/198 2024-03-31T23:06:29.579 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T23:06:29.579 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-31T23:06:29.579 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T23:06:29.579 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T23:06:29.579 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:34.270 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 153/198 2024-03-31T23:06:34.311 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 154/198 2024-03-31T23:06:34.341 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 155/198 2024-03-31T23:06:34.368 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-31T23:06:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T23:06:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 1/198 2024-03-31T23:06:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 2/198 2024-03-31T23:06:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 3/198 2024-03-31T23:06:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 4/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1977.g384f3 5/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 6/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 7/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 8/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 9/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 12/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 13/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 14/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_ 15/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:06:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 17/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_6 18/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 19/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 20/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el 21/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:19.0.0-1977.g384f31f3.el9. 22/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_6 23/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 24/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 25/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 26/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 27/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 28/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 29/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3. 30/198 2024-03-31T23:06:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 31/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 32/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 33/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el 34/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 35/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.e 36/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 37/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 38/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 39/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-31T23:06:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-31T23:06:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-31T23:06:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-31T23:06:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-31T23:06:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-31T23:06:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-31T23:06:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-31T23:06:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 153/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-31T23:06:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-31T23:06:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-31T23:06:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-31T23:06:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-31T23:06:34.568 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 157/198 2024-03-31T23:06:34.688 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-31T23:06:34.734 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 159/198 2024-03-31T23:06:34.784 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-31T23:06:34.849 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-31T23:06:34.893 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-31T23:06:34.925 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_ 163/198 2024-03-31T23:06:34.957 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-31T23:06:34.987 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-31T23:06:35.053 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-31T23:06:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-31T23:06:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-31T23:06:35.737 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:35.775 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:35.795 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T23:06:36.674 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 170/198 2024-03-31T23:06:36.756 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-31T23:06:36.798 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-31T23:06:36.895 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-31T23:06:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-31T23:06:36.959 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-31T23:06:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-31T23:06:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-31T23:06:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T23:06:37.108 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T23:06:37.137 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-31T23:06:37.137 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T23:06:37.222 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T23:06:37.257 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-31T23:06:37.290 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-31T23:06:37.315 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-31T23:06:37.340 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-31T23:06:37.374 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-31T23:06:37.429 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-31T23:06:37.438 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-31T23:06:37.438 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: acl-2.3.1-4.el9.x86_64 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-31T23:06:37.439 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.440 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.441 INFO:teuthology.orchestra.run.smithi094.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: automake-1.16.2-8.el9.noarch 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.7.4-5.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.442 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.443 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.444 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.4-9.el9.x86_64 2024-03-31T23:06:37.445 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: jq-1.6-16.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-31T23:06:37.446 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-31T23:06:37.447 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-31T23:06:37.448 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: lua-5.4.4-4.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-13.14-1.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-31T23:06:37.449 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.450 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-31T23:06:37.451 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-31T23:06:37.452 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-31T23:06:37.453 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-31T23:06:37.454 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-3.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-31T23:06:37.455 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-31T23:06:37.456 INFO:teuthology.orchestra.run.smithi094.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-31T23:06:37.456 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-31T23:06:37.456 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-31T23:06:37.456 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-31T23:06:37.456 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-31T23:06:37.456 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-03-31T23:06:37.469 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-31T23:06:37.495 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-31T23:06:37.520 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-31T23:06:37.545 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-31T23:06:37.571 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-31T23:06:37.577 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:37.578 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T23:06:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T23:06:37.840 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T23:06:37.872 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-31T23:06:37.899 DEBUG:teuthology.parallel:result is None 2024-03-31T23:06:37.900 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-31T23:06:37.924 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-31T23:06:37.949 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-31T23:06:38.018 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T23:06:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T23:06:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 1/198 2024-03-31T23:06:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 2/198 2024-03-31T23:06:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 3/198 2024-03-31T23:06:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 4/198 2024-03-31T23:06:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1977.g384f3 5/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 6/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 7/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 8/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 9/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 10/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 11/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 12/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 13/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 14/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_ 15/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 16/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 17/198 2024-03-31T23:06:43.474 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_6 18/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86 19/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 20/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el 21/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.0.0-1977.g384f31f3.el9. 22/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_6 23/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 24/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 25/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 26/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 27/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 28/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 29/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3. 30/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noa 31/198 2024-03-31T23:06:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.n 32/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1977.g384 33/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el 34/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 35/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.e 36/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 37/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 38/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 39/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-31T23:06:43.476 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-31T23:06:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-31T23:06:43.478 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-31T23:06:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-31T23:06:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-31T23:06:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-31T23:06:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-31T23:06:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 151/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 153/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-31T23:06:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-31T23:06:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-31T23:06:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-31T23:06:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-31T23:06:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-31T23:06:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-31T23:06:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-31T23:06:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-31T23:06:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-31T23:06:46.493 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-31T23:06:46.493 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: acl-2.3.1-4.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-31T23:06:46.494 INFO:teuthology.orchestra.run.smithi042.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-03-31T23:06:46.495 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.496 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.0.0-1977.g384f31f3.el9.noarch 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-03-31T23:06:46.497 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: jq-1.6-16.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.498 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-31T23:06:46.499 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.14-1.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-31T23:06:46.500 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-31T23:06:46.501 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-31T23:06:46.502 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-31T23:06:46.503 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-31T23:06:46.504 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.0.0-1977.g384f31f3.el9.x86_64 2024-03-31T23:06:46.505 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-3.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:06:46.506 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-03-31T23:06:46.955 DEBUG:teuthology.parallel:result is None 2024-03-31T23:06:46.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:06:47.174 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-31T23:06:47.196 INFO:teuthology.orchestra.run.smithi042.stdout:19.0.0-1977.g384f31f3.el9 2024-03-31T23:06:47.196 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1977.g384f31f3.el9 2024-03-31T23:06:47.197 INFO:teuthology.task.install:The correct ceph version 19.0.0-1977.g384f31f3 is installed. 2024-03-31T23:06:47.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:06:47.411 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-31T23:06:47.436 INFO:teuthology.orchestra.run.smithi094.stdout:19.0.0-1977.g384f31f3.el9 2024-03-31T23:06:47.436 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1977.g384f31f3.el9 2024-03-31T23:06:47.437 INFO:teuthology.task.install:The correct ceph version 19.0.0-1977.g384f31f3 is installed. 2024-03-31T23:06:47.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:06:47.652 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-31T23:06:47.678 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-1977.g384f31f3.el9 2024-03-31T23:06:47.678 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1977.g384f31f3.el9 2024-03-31T23:06:47.678 INFO:teuthology.task.install:The correct ceph version 19.0.0-1977.g384f31f3 is installed. 2024-03-31T23:06:47.680 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-31T23:06:47.681 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:06:47.681 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-31T23:06:47.714 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:06:47.715 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-31T23:06:47.749 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:06:47.749 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-31T23:06:47.784 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-31T23:06:47.785 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:06:47.785 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-03-31T23:06:47.814 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-31T23:06:47.883 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:06:47.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-03-31T23:06:47.915 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-31T23:06:47.985 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:06:47.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-03-31T23:06:48.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-31T23:06:48.088 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-31T23:06:48.088 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:06:48.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-31T23:06:48.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-31T23:06:48.187 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:06:48.188 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-31T23:06:48.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-31T23:06:48.282 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:06:48.282 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-31T23:06:48.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-31T23:06:48.378 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-31T23:06:48.378 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:06:48.378 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-03-31T23:06:48.407 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-31T23:06:48.476 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:06:48.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-03-31T23:06:48.504 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-31T23:06:48.571 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:06:48.571 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-03-31T23:06:48.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-31T23:06:48.665 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-31T23:06:48.768 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-03-31T23:06:48.769 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:06:48.769 INFO:tasks.cephadm:Cluster fsid is 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:06:48.769 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-31T23:06:48.769 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.42', 'mon.b': '172.21.15.94', 'mon.c': '172.21.15.188'} 2024-03-31T23:06:48.769 INFO:tasks.cephadm:First mon is mon.a on smithi042 2024-03-31T23:06:48.770 INFO:tasks.cephadm:First mgr is x 2024-03-31T23:06:48.770 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-31T23:06:48.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname $(hostname -s) 2024-03-31T23:06:48.800 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname $(hostname -s) 2024-03-31T23:06:48.827 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname $(hostname -s) 2024-03-31T23:06:48.854 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-31T23:06:48.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:06:48.995 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/54774/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1977-g384f31f3', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1977.g384f31f3'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-31 17:40:06.063697', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-31T23:06:49.136 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 384f31f3d3aee7f8ba3f60846b8844c049165583 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:06:49.137 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/x86_64/flavors/default/cephadm 2024-03-31T23:06:49.137 DEBUG:teuthology.orchestra.run.smithi042:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:49.713 INFO:teuthology.orchestra.run.smithi042.stdout:-rw-r--r--. 1 ubuntu ubuntu 767490 Mar 31 23:06 /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:49.714 DEBUG:teuthology.orchestra.run.smithi094:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.136 INFO:teuthology.orchestra.run.smithi094.stdout:-rw-r--r--. 1 ubuntu ubuntu 767490 Mar 31 23:06 /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.136 DEBUG:teuthology.orchestra.run.smithi188:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.915 INFO:teuthology.orchestra.run.smithi188.stdout:-rw-r--r--. 1 ubuntu ubuntu 767490 Mar 31 23:06 /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.915 DEBUG:teuthology.orchestra.run.smithi042:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.933 DEBUG:teuthology.orchestra.run.smithi094:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.952 DEBUG:teuthology.orchestra.run.smithi188:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-31T23:06:50.990 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 on all hosts... 2024-03-31T23:06:50.990 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 pull 2024-03-31T23:06:50.992 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 pull 2024-03-31T23:06:50.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 pull 2024-03-31T23:06:51.850 INFO:teuthology.orchestra.run.smithi188.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583... 2024-03-31T23:06:51.865 INFO:teuthology.orchestra.run.smithi094.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583... 2024-03-31T23:06:51.892 INFO:teuthology.orchestra.run.smithi042.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583... 2024-03-31T23:07:21.427 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:07:21.427 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev)", 2024-03-31T23:07:21.427 INFO:teuthology.orchestra.run.smithi042.stdout: "image_id": "ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791", 2024-03-31T23:07:21.427 INFO:teuthology.orchestra.run.smithi042.stdout: "repo_digests": [ 2024-03-31T23:07:21.427 INFO:teuthology.orchestra.run.smithi042.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175" 2024-03-31T23:07:21.427 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:07:21.428 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev)", 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout: "image_id": "ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791", 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout: "repo_digests": [ 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175" 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-31T23:07:22.866 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-31T23:07:27.606 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-03-31T23:07:27.606 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev)", 2024-03-31T23:07:27.606 INFO:teuthology.orchestra.run.smithi188.stdout: "image_id": "ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791", 2024-03-31T23:07:27.606 INFO:teuthology.orchestra.run.smithi188.stdout: "repo_digests": [ 2024-03-31T23:07:27.606 INFO:teuthology.orchestra.run.smithi188.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175" 2024-03-31T23:07:27.606 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-03-31T23:07:27.607 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-03-31T23:07:27.630 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph 2024-03-31T23:07:27.665 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph 2024-03-31T23:07:27.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph 2024-03-31T23:07:27.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /etc/ceph 2024-03-31T23:07:27.759 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /etc/ceph 2024-03-31T23:07:27.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /etc/ceph 2024-03-31T23:07:27.818 INFO:tasks.cephadm:Writing seed config... 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-03-31T23:07:27.819 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-03-31T23:07:27.820 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-31T23:07:27.821 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-31T23:07:27.822 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-31T23:07:27.822 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-31T23:07:27.822 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-31T23:07:27.822 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-31T23:07:27.822 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-31T23:07:27.822 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-03-31T23:07:27.823 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:07:27.823 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-31T23:07:27.839 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5a449cfe-efb3-11ee-b647-cb9ed24678a4 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-31T23:07:27.839 DEBUG:teuthology.orchestra.run.smithi042:mon.a> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service 2024-03-31T23:07:27.882 DEBUG:teuthology.orchestra.run.smithi042:mgr.x> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x.service 2024-03-31T23:07:27.924 INFO:tasks.cephadm:Bootstrapping... 2024-03-31T23:07:27.924 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 -v bootstrap --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.42 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:07:28.124 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-03-31T23:07:28.124 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583', '-v', 'bootstrap', '--fsid', '5a449cfe-efb3-11ee-b647-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.42', '--skip-admin-label'] 2024-03-31T23:07:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-31T23:07:28.125 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying podman|docker is present... 2024-03-31T23:07:28.149 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-31T23:07:28.149 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying lvm2 is present... 2024-03-31T23:07:28.149 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying time synchronization is in place... 2024-03-31T23:07:28.156 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-31T23:07:28.156 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-31T23:07:28.162 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-31T23:07:28.163 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-03-31T23:07:28.169 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-03-31T23:07:28.175 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-03-31T23:07:28.175 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-03-31T23:07:28.175 INFO:teuthology.orchestra.run.smithi042.stdout:Repeating the final host check... 2024-03-31T23:07:28.197 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-31T23:07:28.197 INFO:teuthology.orchestra.run.smithi042.stdout:podman (/bin/podman) version 4.9.4 is present 2024-03-31T23:07:28.197 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl is present 2024-03-31T23:07:28.197 INFO:teuthology.orchestra.run.smithi042.stdout:lvcreate is present 2024-03-31T23:07:28.203 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-31T23:07:28.204 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-31T23:07:28.209 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-31T23:07:28.209 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-03-31T23:07:28.215 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-03-31T23:07:28.221 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-03-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-03-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi042.stdout:Host looks OK 2024-03-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi042.stdout:Cluster fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi042.stdout:Acquiring lock 139630981774112 on /run/cephadm/5a449cfe-efb3-11ee-b647-cb9ed24678a4.lock 2024-03-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi042.stdout:Lock 139630981774112 acquired on /run/cephadm/5a449cfe-efb3-11ee-b647-cb9ed24678a4.lock 2024-03-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 3300 ... 2024-03-31T23:07:28.223 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 6789 ... 2024-03-31T23:07:28.223 INFO:teuthology.orchestra.run.smithi042.stdout:Base mon IP(s) is [172.21.15.42:3300, 172.21.15.42:6789], mon addrv is [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-03-31T23:07:28.226 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.42 metric 100 2024-03-31T23:07:28.226 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.42 metric 100 2024-03-31T23:07:28.228 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-31T23:07:28.228 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-03-31T23:07:28.228 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-03-31T23:07:28.231 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-31T23:07:28.231 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-31T23:07:28.231 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-31T23:07:28.231 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-31T23:07:28.231 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-03-31T23:07:28.231 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-31T23:07:28.232 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-03-31T23:07:28.232 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-03-31T23:07:28.232 INFO:teuthology.orchestra.run.smithi042.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-31T23:07:28.232 INFO:teuthology.orchestra.run.smithi042.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-31T23:07:28.233 INFO:teuthology.orchestra.run.smithi042.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583... 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583... 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Getting image source signatures 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:bbb14f026003c3be33a985e165b4ecff104c8c0e04a9fce5f3c6b6743271902a 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:11da15500eca1f826c328eb3265caa30b0a3730510e2a32023084d6fe9cee20c 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying config sha256:ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 2024-03-31T23:07:28.962 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-31T23:07:29.927 INFO:teuthology.orchestra.run.smithi042.stdout:ceph: stdout ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev) 2024-03-31T23:07:29.927 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph version: ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev) 2024-03-31T23:07:29.927 INFO:teuthology.orchestra.run.smithi042.stdout:Extracting ceph user uid/gid from container image... 2024-03-31T23:07:30.830 INFO:teuthology.orchestra.run.smithi042.stdout:stat: stdout 167 167 2024-03-31T23:07:30.831 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial keys... 2024-03-31T23:07:31.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQCz7Almuj7RChAA+O8k36VMKMEucc4J9oUeGw== 2024-03-31T23:07:32.751 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQC07AlmA0RMCxAAYSzlXxyX1Vm8RMqNuJDycg== 2024-03-31T23:07:33.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQC17AlmPEcsBBAAil19rXiXsLGG9nFM/A8QnQ== 2024-03-31T23:07:33.667 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial monmap... 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool for a [v2:172.21.15.42:3300,v1:172.21.15.42:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: set fsid to 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:07:34.522 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mon... 2024-03-31T23:07:42.723 INFO:teuthology.orchestra.run.smithi042.stdout:create mon.a on 2024-03-31T23:07:43.206 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-31T23:07:43.558 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-31T23:07:44.012 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4.target. 2024-03-31T23:07:44.012 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4.target. 2024-03-31T23:07:44.235 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a 2024-03-31T23:07:44.235 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service: Unit ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service not loaded. 2024-03-31T23:07:44.430 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4.target.wants/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service → /etc/systemd/system/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@.service. 2024-03-31T23:07:45.000 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-31T23:07:45.001 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-03-31T23:07:45.007 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-31T23:07:45.007 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-03-31T23:07:45.007 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-03-31T23:07:45.007 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-03-31T23:07:45.008 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon to start... 2024-03-31T23:07:45.008 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon... 2024-03-31T23:07:45.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:44 smithi042 systemd[1]: Started Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:07:46.044 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-31T23:07:46.044 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: monmap epoch 1 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: last_changed 2024-03-31T23:07:33.997579+0000 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: min_mon_release 19 (squid) 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: election_strategy: 1 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:07:46.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: fsmap 2024-03-31T23:07:46.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: osdmap e1: 0 total, 0 up, 0 in 2024-03-31T23:07:46.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: mgrmap e1: no daemons active 2024-03-31T23:07:46.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:45 smithi042 ceph-mon[32011]: from='client.? 172.21.15.42:0/3130636924' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-31T23:07:46.059 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout cluster: 2024-03-31T23:07:46.059 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout id: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout services: 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.578814s) 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout data: 2024-03-31T23:07:46.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-31T23:07:46.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-31T23:07:46.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-31T23:07:46.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pgs: 2024-03-31T23:07:46.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:46.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.448+0000 7f4b0ebe4700 1 Processor -- start 2024-03-31T23:07:46.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.448+0000 7f4b0ebe4700 1 -- start start 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.448+0000 7f4b0ebe4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08108730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.448+0000 7f4b0ebe4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08108d00 con 0x7f4b08108310 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b0c980700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08108730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b0c980700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08108730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38782/0 (socket says 172.21.15.42:38782) 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b0c980700 1 -- 172.21.15.42:0/1688292785 learned_addr learned my addr 172.21.15.42:0/1688292785 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b0c980700 1 -- 172.21.15.42:0/1688292785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08106f70 con 0x7f4b08108310 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b0c980700 1 --2- 172.21.15.42:0/1688292785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08108730 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4af80098a0 tx=0x7f4af8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e9280e82e6617d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b077fe700 1 -- 172.21.15.42:0/1688292785 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8004160 con 0x7f4b08108310 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b077fe700 1 -- 172.21.15.42:0/1688292785 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8004300 con 0x7f4b08108310 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.449+0000 7f4b077fe700 1 -- 172.21.15.42:0/1688292785 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80036a0 con 0x7f4b08108310 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/1688292785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 msgr2=0x7f4b08108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:46.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 --2- 172.21.15.42:0/1688292785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08108730 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4af80098a0 tx=0x7f4af8009bb0 comp rx=0 tx=0).stop 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/1688292785 shutdown_connections 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 --2- 172.21.15.42:0/1688292785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08108730 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/1688292785 >> 172.21.15.42:0/1688292785 conn(0x7f4b08101a60 msgr2=0x7f4b08103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/1688292785 shutdown_connections 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.450+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/1688292785 wait complete. 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0ebe4700 1 Processor -- start 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0ebe4700 1 -- start start 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0ebe4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08106900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0ebe4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081074a0 con 0x7f4b08108310 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0c980700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0c980700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38794/0 (socket says 172.21.15.42:38794) 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0c980700 1 -- 172.21.15.42:0/3130636924 learned_addr learned my addr 172.21.15.42:0/3130636924 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:46.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0c980700 1 -- 172.21.15.42:0/3130636924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0819e250 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.451+0000 7f4b0c980700 1 --2- 172.21.15.42:0/3130636924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08106900 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4af8000c00 tx=0x7f4af8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8003db0 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8011630 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0819e420 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8011950 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0819e840 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4af8011af0 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.452+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4af801c450 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.453+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b08063870 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.455+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4af8032020 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.531+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f4b0802de30 con 0x7f4b08108310 2024-03-31T23:07:46.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.531+0000 7f4b05ffb700 1 -- 172.21.15.42:0/3130636924 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f4af8004260 con 0x7f4b08108310 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 msgr2=0x7f4b08106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 --2- 172.21.15.42:0/3130636924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08106900 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4af8000c00 tx=0x7f4af8004750 comp rx=0 tx=0).stop 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 shutdown_connections 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 --2- 172.21.15.42:0/3130636924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b08108310 0x7f4b08106900 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 >> 172.21.15.42:0/3130636924 conn(0x7f4b08101a60 msgr2=0x7f4b081910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 shutdown_connections 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:45.532+0000 7f4b0ebe4700 1 -- 172.21.15.42:0/3130636924 wait complete. 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:mon is available 2024-03-31T23:07:46.065 INFO:teuthology.orchestra.run.smithi042.stdout:Assimilating anything we can from ceph.conf... 2024-03-31T23:07:47.102 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:47.102 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-03-31T23:07:47.102 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:47.102 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-03-31T23:07:47.102 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-31T23:07:47.102 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-31T23:07:47.103 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.480+0000 7faf9f60e700 1 Processor -- start 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.480+0000 7faf9f60e700 1 -- start start 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.480+0000 7faf9f60e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf981075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.480+0000 7faf9f60e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf98107bb0 con 0x7faf981071c0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf9d3aa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf981075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf9d3aa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf981075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38804/0 (socket says 172.21.15.42:38804) 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf9d3aa700 1 -- 172.21.15.42:0/3905509766 learned_addr learned my addr 172.21.15.42:0/3905509766 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf9d3aa700 1 -- 172.21.15.42:0/3905509766 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf98107ee0 con 0x7faf981071c0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf9d3aa700 1 --2- 172.21.15.42:0/3905509766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf981075e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faf880098a0 tx=0x7faf88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3887a6a8417f237e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf8ffff700 1 -- 172.21.15.42:0/3905509766 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf88004160 con 0x7faf981071c0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf8ffff700 1 -- 172.21.15.42:0/3905509766 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf88004300 con 0x7faf981071c0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.481+0000 7faf8ffff700 1 -- 172.21.15.42:0/3905509766 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf880036a0 con 0x7faf981071c0 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 -- 172.21.15.42:0/3905509766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 msgr2=0x7faf981075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:47.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 --2- 172.21.15.42:0/3905509766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf981075e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faf880098a0 tx=0x7faf88009bb0 comp rx=0 tx=0).stop 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 -- 172.21.15.42:0/3905509766 shutdown_connections 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 --2- 172.21.15.42:0/3905509766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf981075e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 -- 172.21.15.42:0/3905509766 >> 172.21.15.42:0/3905509766 conn(0x7faf98101a60 msgr2=0x7faf98103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 -- 172.21.15.42:0/3905509766 shutdown_connections 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.482+0000 7faf9f60e700 1 -- 172.21.15.42:0/3905509766 wait complete. 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9f60e700 1 Processor -- start 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9f60e700 1 -- start start 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9f60e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf9818f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9f60e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf98108410 con 0x7faf981071c0 2024-03-31T23:07:47.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9d3aa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf9818f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9d3aa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf9818f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38812/0 (socket says 172.21.15.42:38812) 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9d3aa700 1 -- 172.21.15.42:0/1560273361 learned_addr learned my addr 172.21.15.42:0/1560273361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9d3aa700 1 -- 172.21.15.42:0/1560273361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9818fde0 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.483+0000 7faf9d3aa700 1 --2- 172.21.15.42:0/1560273361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf9818f8a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faf88000c00 tx=0x7faf88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf88003db0 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf88011630 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9818dfd0 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf88011950 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9818e510 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faf88011af0 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.484+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faf8801c790 con 0x7faf981071c0 2024-03-31T23:07:47.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.485+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf98063870 con 0x7faf981071c0 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.487+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7faf88032020 con 0x7faf981071c0 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.559+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7faf98194a80 con 0x7faf981071c0 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.563+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7faf98194a80 con 0x7faf981071c0 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.564+0000 7faf8e7fc700 1 -- 172.21.15.42:0/1560273361 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7faf88004260 con 0x7faf981071c0 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 msgr2=0x7faf9818f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 --2- 172.21.15.42:0/1560273361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf9818f8a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faf88000c00 tx=0x7faf88004750 comp rx=0 tx=0).stop 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 shutdown_connections 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 --2- 172.21.15.42:0/1560273361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf981071c0 0x7faf9818f8a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 >> 172.21.15.42:0/1560273361 conn(0x7faf98101a60 msgr2=0x7faf98192130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 shutdown_connections 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:46.565+0000 7faf9f60e700 1 -- 172.21.15.42:0/1560273361 wait complete. 2024-03-31T23:07:47.107 INFO:teuthology.orchestra.run.smithi042.stdout:Generating new minimal ceph.conf... 2024-03-31T23:07:47.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:46 smithi042 ceph-mon[32011]: from='client.? 172.21.15.42:0/1560273361' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-31T23:07:47.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:46 smithi042 ceph-mon[32011]: from='client.? 172.21.15.42:0/1560273361' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-31T23:07:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:47 smithi042 ceph-mon[32011]: from='client.? 172.21.15.42:0/1338969559' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:07:50.278 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.530+0000 7f45f5b78700 1 Processor -- start 2024-03-31T23:07:50.278 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.530+0000 7f45f5b78700 1 -- start start 2024-03-31T23:07:50.278 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.530+0000 7f45f5b78700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f010aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:50.278 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.530+0000 7f45f5b78700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45f007bdf0 con 0x7f45f01088b0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f010aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f010aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38816/0 (socket says 172.21.15.42:38816) 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ef7fe700 1 -- 172.21.15.42:0/617045241 learned_addr learned my addr 172.21.15.42:0/617045241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ef7fe700 1 -- 172.21.15.42:0/617045241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f010b1e0 con 0x7f45f01088b0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ef7fe700 1 --2- 172.21.15.42:0/617045241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f010aca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f45e00098a0 tx=0x7f45e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28515231449181d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ee7fc700 1 -- 172.21.15.42:0/617045241 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0004160 con 0x7f45f01088b0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ee7fc700 1 -- 172.21.15.42:0/617045241 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f45e0004300 con 0x7f45f01088b0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.531+0000 7f45ee7fc700 1 -- 172.21.15.42:0/617045241 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0011c00 con 0x7f45f01088b0 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 -- 172.21.15.42:0/617045241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 msgr2=0x7f45f010aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 --2- 172.21.15.42:0/617045241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f010aca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f45e00098a0 tx=0x7f45e0009bb0 comp rx=0 tx=0).stop 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 -- 172.21.15.42:0/617045241 shutdown_connections 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 --2- 172.21.15.42:0/617045241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f010aca0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:50.279 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 -- 172.21.15.42:0/617045241 >> 172.21.15.42:0/617045241 conn(0x7f45f01022a0 msgr2=0x7f45f01046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 -- 172.21.15.42:0/617045241 shutdown_connections 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.532+0000 7f45f5b78700 1 -- 172.21.15.42:0/617045241 wait complete. 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45f5b78700 1 Processor -- start 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45f5b78700 1 -- start start 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45f5b78700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45f5b78700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45f010c210 con 0x7f45f01088b0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38832/0 (socket says 172.21.15.42:38832) 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45ef7fe700 1 -- 172.21.15.42:0/1338969559 learned_addr learned my addr 172.21.15.42:0/1338969559 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.533+0000 7f45ef7fe700 1 -- 172.21.15.42:0/1338969559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f019c380 con 0x7f45f01088b0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45ef7fe700 1 --2- 172.21.15.42:0/1338969559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f019be40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011bd0 tx=0x7f45e0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0003b20 con 0x7f45f01088b0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f019c610 con 0x7f45f01088b0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f45e0003cc0 con 0x7f45f01088b0 2024-03-31T23:07:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0024930 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f019f300 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45e0022020 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.534+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f45e00193c0 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.535+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f0063870 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.537+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f45e001aca0 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.610+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f45f019f840 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.610+0000 7f45ecff9700 1 -- 172.21.15.42:0/1338969559 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f45e002d3f0 con 0x7f45f01088b0 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 msgr2=0x7f45f019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 --2- 172.21.15.42:0/1338969559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f019be40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011bd0 tx=0x7f45e0011cb0 comp rx=0 tx=0).stop 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 shutdown_connections 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 --2- 172.21.15.42:0/1338969559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f01088b0 0x7f45f019be40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 >> 172.21.15.42:0/1338969559 conn(0x7f45f01022a0 msgr2=0x7f45f0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 shutdown_connections 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:47.611+0000 7f45f5b78700 1 -- 172.21.15.42:0/1338969559 wait complete. 2024-03-31T23:07:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:Restarting the monitor... 2024-03-31T23:07:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:50 smithi042 systemd[1]: Stopping Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:07:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32007]: 2024-03-31T23:07:51.392+0000 7f0e51daa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:07:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32007]: 2024-03-31T23:07:51.392+0000 7f0e51daa700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-31T23:07:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:51 smithi042 podman[32255]: 2024-03-31 23:07:51.546456467 +0000 UTC m=+1.100675082 container died 73594ab8a02bf3bbda522603f3a8505f4d120a56c0416917ad584cebb589d6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-31T23:07:52.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:52 smithi042 podman[32255]: 2024-03-31 23:07:52.515277018 +0000 UTC m=+2.069495642 container cleanup 73594ab8a02bf3bbda522603f3a8505f4d120a56c0416917ad584cebb589d6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:07:52.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:52 smithi042 bash[32255]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a 2024-03-31T23:07:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:52 smithi042 podman[32269]: 2024-03-31 23:07:52.766363849 +0000 UTC m=+1.210329090 container remove 73594ab8a02bf3bbda522603f3a8505f4d120a56c0416917ad584cebb589d6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:07:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:52 smithi042 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-31T23:07:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:52 smithi042 systemd[1]: Stopped Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:07:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:52 smithi042 systemd[1]: Starting Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:07:53.353 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 podman[32362]: 2024-03-31 23:07:53.005503403 +0000 UTC m=+0.017473994 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:07:53.353 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 podman[32362]: 2024-03-31 23:07:53.118306009 +0000 UTC m=+0.130276630 container create 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0) 2024-03-31T23:07:53.353 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 podman[32362]: 2024-03-31 23:07:53.327794568 +0000 UTC m=+0.339765144 container init 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-31T23:07:53.353 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 podman[32362]: 2024-03-31 23:07:53.330593471 +0000 UTC m=+0.342564048 container start 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-31T23:07:53.415 INFO:teuthology.orchestra.run.smithi042.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-31T23:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: set uid:gid to 167:167 (ceph:ceph) 2024-03-31T23:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev), process ceph-mon, pid 2 2024-03-31T23:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: pidfile_write: ignore empty --pid-file 2024-03-31T23:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: load: jerasure load: lrc 2024-03-31T23:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: RocksDB version: 7.9.2 2024-03-31T23:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Git sha 0 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Compile date 2024-03-31 16:17:26 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: DB SUMMARY 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: DB Session ID: 2LZS8MDMBJCJXCAABDAP 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: CURRENT file: CURRENT 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: IDENTITY file: IDENTITY 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105796 ; 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.error_if_exists: 0 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.create_if_missing: 0 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.paranoid_checks: 1 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-31T23:07:53.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.env: 0x563f03007c60 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.fs: PosixFileSystem 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.info_log: 0x563f056ffae0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_file_opening_threads: 16 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.statistics: (nil) 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.use_fsync: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_log_file_size: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.keep_log_file_num: 1000 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.recycle_log_file_num: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.allow_fallocate: 1 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.allow_mmap_reads: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.allow_mmap_writes: 0 2024-03-31T23:07:53.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.use_direct_reads: 0 2024-03-31T23:07:53.632 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-31T23:07:53.632 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.create_missing_column_families: 0 2024-03-31T23:07:53.632 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.db_log_dir: 2024-03-31T23:07:53.632 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.wal_dir: 2024-03-31T23:07:53.632 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.advise_random_on_open: 1 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.db_write_buffer_size: 0 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.write_buffer_manager: 0x563f056d21e0 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-31T23:07:53.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.rate_limiter: (nil) 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.wal_recovery_mode: 2 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.enable_thread_tracking: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.enable_pipelined_write: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.unordered_write: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.row_cache: None 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.wal_filter: None 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.allow_ingest_behind: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.two_write_queues: 0 2024-03-31T23:07:53.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.manual_wal_flush: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.wal_compression: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.atomic_flush: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.log_readahead_size: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.best_efforts_recovery: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.allow_data_in_errors: 0 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.db_host_id: __hostname__ 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_background_jobs: 2 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_background_compactions: -1 2024-03-31T23:07:53.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_subcompactions: 1 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_total_wal_size: 0 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_open_files: -1 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bytes_per_sync: 0 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-31T23:07:53.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_readahead_size: 0 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_background_flushes: -1 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Compression algorithms supported: 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kZSTD supported: 0 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kXpressCompression supported: 0 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kLZ4HCCompression supported: 1 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kZlibCompression supported: 1 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kSnappyCompression supported: 1 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kLZ4Compression supported: 1 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: kBZip2Compression supported: 0 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-31T23:07:53.637 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.merge_operator: 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_filter: None 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_filter_factory: None 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.sst_partitioner_factory: None 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563f056ffbe0) 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_type: 0 2024-03-31T23:07:53.638 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_index_type: 0 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_shortening: 1 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: checksum: 4 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: no_block_cache: 0 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache: 0x563f05703090 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_options: 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: capacity : 536870912 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_shard_bits : 4 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: strict_capacity_limit : 0 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_compressed: (nil) 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: persistent_cache: (nil) 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size: 4096 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size_deviation: 10 2024-03-31T23:07:53.639 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_restart_interval: 16 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_block_restart_interval: 1 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: metadata_block_size: 4096 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: partition_filters: 0 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: use_delta_encoding: 1 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: filter_policy: bloomfilter 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: whole_key_filtering: 1 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: verify_compression: 0 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: format_version: 5 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_index_compression: 1 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_align: 0 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: max_auto_readahead_size: 262144 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: prepopulate_block_cache: 0 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: initial_auto_readahead_size: 8192 2024-03-31T23:07:53.640 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.write_buffer_size: 33554432 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_write_buffer_number: 2 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression: NoCompression 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression: Disabled 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.prefix_extractor: nullptr 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.num_levels: 7 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-31T23:07:53.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.level: 32767 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.strategy: 0 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.enabled: false 2024-03-31T23:07:53.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.target_file_size_base: 67108864 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-31T23:07:53.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.arena_block_size: 1048576 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.disable_auto_compactions: 0 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-31T23:07:53.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.table_properties_collectors: 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.inplace_update_support: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.bloom_locality: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.max_successive_merges: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.paranoid_file_checks: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.force_consistency_checks: 1 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.report_bg_io_stats: 0 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.ttl: 2592000 2024-03-31T23:07:53.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.enable_blob_files: false 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.min_blob_size: 0 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.blob_file_size: 268435456 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.blob_file_starting_level: 0 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-31T23:07:53.646 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-31T23:07:53.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f999f12b-01b0-4fc4-a276-4a701e256707 2024-03-31T23:07:53.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711926473359246, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-31T23:07:53.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-31T23:07:53.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711926473360199, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100763, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98673, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14425, "raw_average_key_size": 49, "raw_value_size": 90896, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711926473, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f999f12b-01b0-4fc4-a276-4a701e256707", "db_session_id": "2LZS8MDMBJCJXCAABDAP", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-31T23:07:53.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711926473360283, "job": 1, "event": "recovery_finished"} 2024-03-31T23:07:53.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563f057f4000 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: DB pointer 0x563f057de000 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** DB Stats ** 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-31T23:07:53.648 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: L0 2/0 100.24 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: Sum 2/0 100.24 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 161.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-03-31T23:07:53.649 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative compaction: 0.00 GB write, 32.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval compaction: 0.00 GB write, 32.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache BinnedLRUCache@0x563f05703090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-03-31T23:07:53.650 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: starting mon.a rank 0 at public addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] at bind addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???) e1 preinit fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).mds e1 new map 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).mds e1 print_map 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: e1 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: legacy client fscid: -1 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout: No filesystems configured 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:07:53.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 bash[32362]: 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 systemd[1]: Started Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: monmap epoch 1 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: last_changed 2024-03-31T23:07:33.997579+0000 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: min_mon_release 19 (squid) 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: election_strategy: 1 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: fsmap 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: osdmap e1: 0 total, 0 up, 0 in 2024-03-31T23:07:53.652 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:53 smithi042 ceph-mon[32380]: mgrmap e1: no daemons active 2024-03-31T23:07:54.474 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.842+0000 7fdd093f5700 1 Processor -- start 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.842+0000 7fdd093f5700 1 -- start start 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd093f5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd04108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd093f5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041087c0 con 0x7fdd04107e60 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd02ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd04108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd02ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd04108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41950/0 (socket says 172.21.15.42:41950) 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd02ffd700 1 -- 172.21.15.42:0/4250326211 learned_addr learned my addr 172.21.15.42:0/4250326211 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd02ffd700 1 -- 172.21.15.42:0/4250326211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd04108f70 con 0x7fdd04107e60 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.843+0000 7fdd02ffd700 1 --2- 172.21.15.42:0/4250326211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd04108280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40098a0 tx=0x7fdcf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2ccfcc5d4d29f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd01ffb700 1 -- 172.21.15.42:0/4250326211 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf4004160 con 0x7fdd04107e60 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd01ffb700 1 -- 172.21.15.42:0/4250326211 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdcf4004300 con 0x7fdd04107e60 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd01ffb700 1 -- 172.21.15.42:0/4250326211 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf4011c00 con 0x7fdd04107e60 2024-03-31T23:07:54.475 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 -- 172.21.15.42:0/4250326211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 msgr2=0x7fdd04108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 --2- 172.21.15.42:0/4250326211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd04108280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40098a0 tx=0x7fdcf4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 -- 172.21.15.42:0/4250326211 shutdown_connections 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 --2- 172.21.15.42:0/4250326211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd04108280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 -- 172.21.15.42:0/4250326211 >> 172.21.15.42:0/4250326211 conn(0x7fdd04103420 msgr2=0x7fdd04105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 -- 172.21.15.42:0/4250326211 shutdown_connections 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.844+0000 7fdd093f5700 1 -- 172.21.15.42:0/4250326211 wait complete. 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd093f5700 1 Processor -- start 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd093f5700 1 -- start start 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd093f5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd0407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd093f5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0410c3b0 con 0x7fdd04107e60 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd02ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd0407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd02ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd0407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41954/0 (socket says 172.21.15.42:41954) 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.845+0000 7fdd02ffd700 1 -- 172.21.15.42:0/3833239491 learned_addr learned my addr 172.21.15.42:0/3833239491 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdd02ffd700 1 -- 172.21.15.42:0/3833239491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0407e050 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdd02ffd700 1 --2- 172.21.15.42:0/3833239491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd0407db10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4011bd0 tx=0x7fdcf4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf4003970 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdcf4003b10 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0407c240 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf40245a0 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd0407c780 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdcf4024c50 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.846+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdcf4019700 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.847+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd04063870 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.849+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdcf4043dd0 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.920+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fdd041047f0 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.921+0000 7fdcebfff700 1 -- 172.21.15.42:0/3833239491 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fdcf4032030 con 0x7fdd04107e60 2024-03-31T23:07:54.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.922+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 msgr2=0x7fdd0407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.922+0000 7fdd093f5700 1 --2- 172.21.15.42:0/3833239491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd0407db10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4011bd0 tx=0x7fdcf4011cb0 comp rx=0 tx=0).stop 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.922+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 shutdown_connections 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.922+0000 7fdd093f5700 1 --2- 172.21.15.42:0/3833239491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd04107e60 0x7fdd0407db10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.922+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 >> 172.21.15.42:0/3833239491 conn(0x7fdd04103420 msgr2=0x7fdd04103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.923+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 shutdown_connections 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:53.923+0000 7fdd093f5700 1 -- 172.21.15.42:0/3833239491 wait complete. 2024-03-31T23:07:54.478 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-31T23:07:54.500 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:07:54.501 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mgr... 2024-03-31T23:07:54.501 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-31T23:07:54.501 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-31T23:07:54.750 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x 2024-03-31T23:07:54.750 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x.service: Unit ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x.service not loaded. 2024-03-31T23:07:54.900 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4.target.wants/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x.service → /etc/systemd/system/ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@.service. 2024-03-31T23:07:55.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:54 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3833239491' entity='client.admin' 2024-03-31T23:07:55.439 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:55 smithi042 podman[32599]: 2024-03-31 23:07:55.349996091 +0000 UTC m=+0.330372424 container start ba3aeb64305d8d4a3ff94bed96b151318a33beab70e1ee97b342b6be30591bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-31T23:07:55.439 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:55 smithi042 bash[32599]: ba3aeb64305d8d4a3ff94bed96b151318a33beab70e1ee97b342b6be30591bae 2024-03-31T23:07:55.454 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-31T23:07:55.455 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-03-31T23:07:55.463 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-31T23:07:55.463 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-03-31T23:07:55.463 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-03-31T23:07:55.463 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-03-31T23:07:55.473 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-31T23:07:55.473 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-03-31T23:07:55.481 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-31T23:07:55.481 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-03-31T23:07:55.481 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-03-31T23:07:55.482 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-31T23:07:55.482 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr to start... 2024-03-31T23:07:55.482 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr... 2024-03-31T23:07:55.689 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:55 smithi042 systemd[1]: Started Ceph mgr.x for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:07:55.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:55.925+0000 7f7396831200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:07:56.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1739481952' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-31T23:07:56.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:56.026+0000 7f7396831200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:07:56.492 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:56.492 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:07:56.492 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:07:56.492 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-03-31T23:07:56.492 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-31T23:07:56.493 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-31T23:07:56.494 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.494 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-31T23:07:56.494 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:56.494 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-31T23:07:56.494 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-31T23:07:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-31T23:07:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-31T23:07:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-31T23:07:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-31T23:07:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-31T23:07:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-03-31T23:07:44.954656+0000", 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:56.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.859+0000 7f99ba29a700 1 Processor -- start 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99ba29a700 1 -- start start 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99ba29a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99ba29a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99b407c890 con 0x7f99b407de60 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41980/0 (socket says 172.21.15.42:41980) 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99b3fff700 1 -- 172.21.15.42:0/1603438847 learned_addr learned my addr 172.21.15.42:0/1603438847 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99b3fff700 1 -- 172.21.15.42:0/1603438847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b407ca10 con 0x7f99b407de60 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.860+0000 7f99b3fff700 1 --2- 172.21.15.42:0/1603438847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b407c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f99a40098a0 tx=0x7f99a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23260d05a1aa3b71 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99b2ffd700 1 -- 172.21.15.42:0/1603438847 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a4004160 con 0x7f99b407de60 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99b2ffd700 1 -- 172.21.15.42:0/1603438847 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f99a4004300 con 0x7f99b407de60 2024-03-31T23:07:56.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99b2ffd700 1 -- 172.21.15.42:0/1603438847 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a4011c00 con 0x7f99b407de60 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 -- 172.21.15.42:0/1603438847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 msgr2=0x7f99b407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 --2- 172.21.15.42:0/1603438847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b407c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f99a40098a0 tx=0x7f99a4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 -- 172.21.15.42:0/1603438847 shutdown_connections 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 --2- 172.21.15.42:0/1603438847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b407c2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 -- 172.21.15.42:0/1603438847 >> 172.21.15.42:0/1603438847 conn(0x7f99b4103420 msgr2=0x7f99b4105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 -- 172.21.15.42:0/1603438847 shutdown_connections 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.861+0000 7f99ba29a700 1 -- 172.21.15.42:0/1603438847 wait complete. 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.862+0000 7f99ba29a700 1 Processor -- start 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.862+0000 7f99ba29a700 1 -- start start 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.862+0000 7f99ba29a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.862+0000 7f99ba29a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99b410e470 con 0x7f99b407de60 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.862+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.862+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b419e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41986/0 (socket says 172.21.15.42:41986) 2024-03-31T23:07:56.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b3fff700 1 -- 172.21.15.42:0/1739481952 learned_addr learned my addr 172.21.15.42:0/1739481952 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b3fff700 1 -- 172.21.15.42:0/1739481952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b419e610 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b3fff700 1 --2- 172.21.15.42:0/1739481952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b419e0d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009fb0 tx=0x7f99a4011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a40038b0 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b419e8a0 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f99a401a430 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a40195e0 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b41a1590 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.863+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99a4019c90 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.864+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f99a4024730 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.864+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9994005360 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.866+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f99a4043dd0 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.940+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9994005920 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.941+0000 7f99b17fa700 1 -- 172.21.15.42:0/1739481952 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f99a4032020 con 0x7f99b407de60 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 msgr2=0x7f99b419e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:56.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 --2- 172.21.15.42:0/1739481952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b419e0d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009fb0 tx=0x7f99a4011c60 comp rx=0 tx=0).stop 2024-03-31T23:07:56.508 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 shutdown_connections 2024-03-31T23:07:56.508 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 --2- 172.21.15.42:0/1739481952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b407de60 0x7f99b419e0d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:56.508 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 >> 172.21.15.42:0/1739481952 conn(0x7f99b4103420 msgr2=0x7f99b4103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:56.508 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 shutdown_connections 2024-03-31T23:07:56.508 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:55.942+0000 7f99ba29a700 1 -- 172.21.15.42:0/1739481952 wait complete. 2024-03-31T23:07:56.508 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (1/15)... 2024-03-31T23:07:56.789 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:56.694+0000 7f7396831200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:07:56.789 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:56.788+0000 7f7396831200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:07:57.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:56.932+0000 7f7396831200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:07:57.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.030+0000 7f7396831200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:07:57.392 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.114+0000 7f7396831200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:07:57.393 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.392+0000 7f7396831200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:07:57.691 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.504+0000 7f7396831200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:07:57.691 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.592+0000 7f7396831200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:07:57.691 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.689+0000 7f7396831200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:07:58.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:57.867+0000 7f7396831200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:07:58.882 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:58 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:58.867+0000 7f7396831200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:07:59.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:07:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3723641827' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-31T23:07:59.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:59.012+0000 7f7396831200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:07:59.566 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-31T23:07:59.567 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-31T23:07:59.568 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-31T23:07:59.568 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-31T23:07:59.568 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-31T23:07:59.568 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.568 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-31T23:07:59.568 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:59.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-03-31T23:07:44.954656+0000", 2024-03-31T23:07:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.904+0000 7f7d926e5700 1 Processor -- start 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.904+0000 7f7d926e5700 1 -- start start 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d926e5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c10aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d926e5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c07bdf0 con 0x7f7d8c1088b0 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c10aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c10aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41992/0 (socket says 172.21.15.42:41992) 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8bfff700 1 -- 172.21.15.42:0/2713950597 learned_addr learned my addr 172.21.15.42:0/2713950597 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8bfff700 1 -- 172.21.15.42:0/2713950597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c10b1e0 con 0x7f7d8c1088b0 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8bfff700 1 --2- 172.21.15.42:0/2713950597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c10aca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0098a0 tx=0x7f7d7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8122f09e367e0a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8affd700 1 -- 172.21.15.42:0/2713950597 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7c004160 con 0x7f7d8c1088b0 2024-03-31T23:07:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8affd700 1 -- 172.21.15.42:0/2713950597 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7d7c004300 con 0x7f7d8c1088b0 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.905+0000 7f7d8affd700 1 -- 172.21.15.42:0/2713950597 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7c011c00 con 0x7f7d8c1088b0 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 -- 172.21.15.42:0/2713950597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 msgr2=0x7f7d8c10aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 --2- 172.21.15.42:0/2713950597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c10aca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0098a0 tx=0x7f7d7c009bb0 comp rx=0 tx=0).stop 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 -- 172.21.15.42:0/2713950597 shutdown_connections 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 --2- 172.21.15.42:0/2713950597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c10aca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 -- 172.21.15.42:0/2713950597 >> 172.21.15.42:0/2713950597 conn(0x7f7d8c1022a0 msgr2=0x7f7d8c1046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 -- 172.21.15.42:0/2713950597 shutdown_connections 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.906+0000 7f7d926e5700 1 -- 172.21.15.42:0/2713950597 wait complete. 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d926e5700 1 Processor -- start 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d926e5700 1 -- start start 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d926e5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d926e5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c10c210 con 0x7f7d8c1088b0 2024-03-31T23:07:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41998/0 (socket says 172.21.15.42:41998) 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.907+0000 7f7d8bfff700 1 -- 172.21.15.42:0/3723641827 learned_addr learned my addr 172.21.15.42:0/3723641827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d8bfff700 1 -- 172.21.15.42:0/3723641827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c19c380 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d8bfff700 1 --2- 172.21.15.42:0/3723641827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c19be40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c011bd0 tx=0x7f7d7c011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7c003b20 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c19c610 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7d7c003cc0 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7c024930 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c19f300 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d7c022020 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.908+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d7c0193c0 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.909+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c063870 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.911+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7d7c01aca0 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.985+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7d8c19f840 con 0x7f7d8c1088b0 2024-03-31T23:07:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.985+0000 7f7d897fa700 1 -- 172.21.15.42:0/3723641827 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7d7c02d3f0 con 0x7f7d8c1088b0 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 msgr2=0x7f7d8c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 --2- 172.21.15.42:0/3723641827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c19be40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c011bd0 tx=0x7f7d7c011cb0 comp rx=0 tx=0).stop 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 shutdown_connections 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 --2- 172.21.15.42:0/3723641827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d8c1088b0 0x7f7d8c19be40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 >> 172.21.15.42:0/3723641827 conn(0x7f7d8c1022a0 msgr2=0x7f7d8c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 shutdown_connections 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:07:58.987+0000 7f7d926e5700 1 -- 172.21.15.42:0/3723641827 wait complete. 2024-03-31T23:07:59.580 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (2/15)... 2024-03-31T23:07:59.624 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:59.353+0000 7f7396831200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:07:59.624 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:59.445+0000 7f7396831200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:08:00.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:59.647+0000 7f7396831200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:08:00.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:07:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:07:59.835+0000 7f7396831200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:08:00.389 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:00.125+0000 7f7396831200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:08:00.389 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:00.387+0000 7f7396831200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:08:00.825 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:00.629+0000 7f7396831200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:08:01.612 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:01.460+0000 7f7396831200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:08:02.171 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:02 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1706104074' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-31T23:08:02.171 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:02.063+0000 7f7396831200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:08:02.171 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:02.169+0000 7f7396831200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:08:02.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:02.394+0000 7f7396831200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-31T23:08:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-31T23:08:02.715 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-31T23:08:02.716 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-31T23:08:02.717 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:02.718 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-03-31T23:07:44.954656+0000", 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.988+0000 7f7f01b4b700 1 Processor -- start 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.988+0000 7f7f01b4b700 1 -- start start 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.988+0000 7f7f01b4b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc108270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.988+0000 7f7f01b4b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1087b0 con 0x7f7efc107e50 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.989+0000 7f7efb7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:02.719 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.989+0000 7f7efb7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42008/0 (socket says 172.21.15.42:42008) 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.989+0000 7f7efb7fe700 1 -- 172.21.15.42:0/682891827 learned_addr learned my addr 172.21.15.42:0/682891827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.989+0000 7f7efb7fe700 1 -- 172.21.15.42:0/682891827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc108fb0 con 0x7f7efc107e50 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.989+0000 7f7efb7fe700 1 --2- 172.21.15.42:0/682891827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc108270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0098a0 tx=0x7f7eec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c229ae8c7461701e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.990+0000 7f7efa7fc700 1 -- 172.21.15.42:0/682891827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec004160 con 0x7f7efc107e50 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.990+0000 7f7efa7fc700 1 -- 172.21.15.42:0/682891827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7eec004300 con 0x7f7efc107e50 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.990+0000 7f7efa7fc700 1 -- 172.21.15.42:0/682891827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec011c00 con 0x7f7efc107e50 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 -- 172.21.15.42:0/682891827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 msgr2=0x7f7efc108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 --2- 172.21.15.42:0/682891827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc108270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0098a0 tx=0x7f7eec009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 -- 172.21.15.42:0/682891827 shutdown_connections 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 --2- 172.21.15.42:0/682891827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc108270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 -- 172.21.15.42:0/682891827 >> 172.21.15.42:0/682891827 conn(0x7f7efc103450 msgr2=0x7f7efc105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 -- 172.21.15.42:0/682891827 shutdown_connections 2024-03-31T23:08:02.720 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 -- 172.21.15.42:0/682891827 wait complete. 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.991+0000 7f7f01b4b700 1 Processor -- start 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7f01b4b700 1 -- start start 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7f01b4b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7f01b4b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc10c3f0 con 0x7f7efc107e50 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7efb7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7efb7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42010/0 (socket says 172.21.15.42:42010) 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7efb7fe700 1 -- 172.21.15.42:0/1706104074 learned_addr learned my addr 172.21.15.42:0/1706104074 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.992+0000 7f7efb7fe700 1 -- 172.21.15.42:0/1706104074 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc19c390 con 0x7f7efc107e50 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.993+0000 7f7efb7fe700 1 --2- 172.21.15.42:0/1706104074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc19be50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7eec011bd0 tx=0x7f7eec011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.993+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec003970 con 0x7f7efc107e50 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.993+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7eec003b10 con 0x7f7efc107e50 2024-03-31T23:08:02.721 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.993+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc19c620 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.994+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0245a0 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.994+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7eec024cb0 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.994+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc19f310 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.994+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7eec003cc0 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.994+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc063870 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:01.997+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7eec01a430 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.072+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7efc19f8b0 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.073+0000 7f7ef8ff9700 1 -- 172.21.15.42:0/1706104074 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7eec01a610 con 0x7f7efc107e50 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 msgr2=0x7f7efc19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 --2- 172.21.15.42:0/1706104074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc19be50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7eec011bd0 tx=0x7f7eec011cb0 comp rx=0 tx=0).stop 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 shutdown_connections 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 --2- 172.21.15.42:0/1706104074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7efc107e50 0x7f7efc19be50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:02.722 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 >> 172.21.15.42:0/1706104074 conn(0x7f7efc103450 msgr2=0x7f7efc103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:02.723 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 shutdown_connections 2024-03-31T23:08:02.723 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:02.074+0000 7f7f01b4b700 1 -- 172.21.15.42:0/1706104074 wait complete. 2024-03-31T23:08:02.723 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (3/15)... 2024-03-31T23:08:03.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: Activating manager daemon x 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: mgrmap e2: x(active, starting, since 0.00324824s) 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: Manager daemon x is now available 2024-03-31T23:08:03.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-31T23:08:03.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' 2024-03-31T23:08:03.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-31T23:08:03.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' 2024-03-31T23:08:03.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:03 smithi042 ceph-mon[32380]: from='mgr.14100 172.21.15.42:0/733203555' entity='mgr.x' 2024-03-31T23:08:04.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:04 smithi042 ceph-mon[32380]: mgrmap e3: x(active, since 1.0069s) 2024-03-31T23:08:05.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:05 smithi042 ceph-mon[32380]: mgrmap e4: x(active, since 2s) 2024-03-31T23:08:05.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:05 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2600674744' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-31T23:08:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-31T23:08:05.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-31T23:08:05.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-31T23:08:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-03-31T23:07:44.954656+0000", 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bfa417700 1 Processor -- start 2024-03-31T23:08:05.833 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bfa417700 1 -- start start 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bfa417700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf41082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bfa417700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4108800 con 0x7f9bf4107ea0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bf3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf41082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bf3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf41082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57200/0 (socket says 172.21.15.42:57200) 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.101+0000 7f9bf3fff700 1 -- 172.21.15.42:0/1700652199 learned_addr learned my addr 172.21.15.42:0/1700652199 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.102+0000 7f9bf3fff700 1 -- 172.21.15.42:0/1700652199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf4108f60 con 0x7f9bf4107ea0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.102+0000 7f9bf3fff700 1 --2- 172.21.15.42:0/1700652199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf41082c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9be40098a0 tx=0x7f9be4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d85b03b11d4daa4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.102+0000 7f9bf2ffd700 1 -- 172.21.15.42:0/1700652199 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9be4004160 con 0x7f9bf4107ea0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.102+0000 7f9bf2ffd700 1 -- 172.21.15.42:0/1700652199 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f9be4004300 con 0x7f9bf4107ea0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.102+0000 7f9bf2ffd700 1 -- 172.21.15.42:0/1700652199 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9be4011c00 con 0x7f9bf4107ea0 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 -- 172.21.15.42:0/1700652199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 msgr2=0x7f9bf41082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 --2- 172.21.15.42:0/1700652199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf41082c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9be40098a0 tx=0x7f9be4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:05.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 -- 172.21.15.42:0/1700652199 shutdown_connections 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 --2- 172.21.15.42:0/1700652199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf41082c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 -- 172.21.15.42:0/1700652199 >> 172.21.15.42:0/1700652199 conn(0x7f9bf41034a0 msgr2=0x7f9bf41058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 -- 172.21.15.42:0/1700652199 shutdown_connections 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 -- 172.21.15.42:0/1700652199 wait complete. 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 Processor -- start 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.103+0000 7f9bfa417700 1 -- start start 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bfa417700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bfa417700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf410c3a0 con 0x7f9bf4107ea0 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57202/0 (socket says 172.21.15.42:57202) 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf3fff700 1 -- 172.21.15.42:0/2600674744 learned_addr learned my addr 172.21.15.42:0/2600674744 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf3fff700 1 -- 172.21.15.42:0/2600674744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf419c3d0 con 0x7f9bf4107ea0 2024-03-31T23:08:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf3fff700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf419be90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009fb0 tx=0x7f9be4011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9be40038b0 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf419c660 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f9be401a430 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9be4019630 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.104+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf419f350 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.105+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46105+0+0 (secure 0 0 0) 0x7f9be4019930 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.105+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf4063870 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.105+0000 7f9bf17fa700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f9bdc038d60 0x7f9bdc03b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.106+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9be404cff0 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.106+0000 7f9bf37fe700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f9bdc038d60 0x7f9bdc03b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.106+0000 7f9bf37fe700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f9bdc038d60 0x7f9bdc03b220 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006fd0 tx=0x7f9be8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.111+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9be4020240 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.400+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9bf419f570 con 0x7f9bf4107ea0 2024-03-31T23:08:05.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.400+0000 7f9bf17fa700 1 -- 172.21.15.42:0/2600674744 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f9be400bc40 con 0x7f9bf4107ea0 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f9bdc038d60 msgr2=0x7f9bdc03b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f9bdc038d60 0x7f9bdc03b220 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006fd0 tx=0x7f9be8006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 msgr2=0x7f9bf419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf419be90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009fb0 tx=0x7f9be4011c60 comp rx=0 tx=0).stop 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 shutdown_connections 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f9bdc038d60 0x7f9bdc03b220 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 --2- 172.21.15.42:0/2600674744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bf4107ea0 0x7f9bf419be90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 >> 172.21.15.42:0/2600674744 conn(0x7f9bf41034a0 msgr2=0x7f9bf4104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 shutdown_connections 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:05.404+0000 7f9bfa417700 1 -- 172.21.15.42:0/2600674744 wait complete. 2024-03-31T23:08:05.837 INFO:teuthology.orchestra.run.smithi042.stdout:mgr is available 2024-03-31T23:08:06.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:06 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/437259269' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-31T23:08:06.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-31T23:08:06.999 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa70be92700 1 Processor -- start 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa70be92700 1 -- start start 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa70be92700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa7041082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa70be92700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa704108800 con 0x7fa704107ea0 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa709c2e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa7041082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa709c2e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa7041082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57214/0 (socket says 172.21.15.42:57214) 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.252+0000 7fa709c2e700 1 -- 172.21.15.42:0/1693858115 learned_addr learned my addr 172.21.15.42:0/1693858115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.253+0000 7fa709c2e700 1 -- 172.21.15.42:0/1693858115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa704108f60 con 0x7fa704107ea0 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.253+0000 7fa709c2e700 1 --2- 172.21.15.42:0/1693858115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa7041082c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098a0 tx=0x7fa700009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccd784c97f5a376 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.253+0000 7fa708c2c700 1 -- 172.21.15.42:0/1693858115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa700004160 con 0x7fa704107ea0 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.253+0000 7fa708c2c700 1 -- 172.21.15.42:0/1693858115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa700004300 con 0x7fa704107ea0 2024-03-31T23:08:07.000 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.253+0000 7fa708c2c700 1 -- 172.21.15.42:0/1693858115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa700011c00 con 0x7fa704107ea0 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.253+0000 7fa70be92700 1 -- 172.21.15.42:0/1693858115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 msgr2=0x7fa7041082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 --2- 172.21.15.42:0/1693858115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa7041082c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098a0 tx=0x7fa700009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 -- 172.21.15.42:0/1693858115 shutdown_connections 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 --2- 172.21.15.42:0/1693858115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa7041082c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 -- 172.21.15.42:0/1693858115 >> 172.21.15.42:0/1693858115 conn(0x7fa7041034a0 msgr2=0x7fa7041058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 -- 172.21.15.42:0/1693858115 shutdown_connections 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 -- 172.21.15.42:0/1693858115 wait complete. 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 Processor -- start 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 -- start start 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa70407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.254+0000 7fa70be92700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa70410c3a0 con 0x7fa704107ea0 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa709c2e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa70407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa709c2e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa70407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57224/0 (socket says 172.21.15.42:57224) 2024-03-31T23:08:07.001 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa709c2e700 1 -- 172.21.15.42:0/437259269 learned_addr learned my addr 172.21.15.42:0/437259269 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa709c2e700 1 -- 172.21.15.42:0/437259269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70407e050 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa709c2e700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa70407db10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa700009fb0 tx=0x7fa700011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7000038b0 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa70001a430 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa700019630 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70407c240 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.255+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa70407c780 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.256+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46105+0+0 (secure 0 0 0) 0x7fa70001aa10 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.256+0000 7fa6faffd700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7fa6f0038db0 0x7fa6f003b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.256+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa704063870 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.256+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa70004cfa0 con 0x7fa704107ea0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.256+0000 7fa70942d700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7fa6f0038db0 0x7fa6f003b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:07.002 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.257+0000 7fa70942d700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7fa6f0038db0 0x7fa6f003b270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4006fd0 tx=0x7fa6f4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.262+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa700029260 con 0x7fa704107ea0 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.462+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa70407d080 con 0x7fa704107ea0 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.463+0000 7fa6faffd700 1 -- 172.21.15.42:0/437259269 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7fa70004c9c0 con 0x7fa704107ea0 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7fa6f0038db0 msgr2=0x7fa6f003b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7fa6f0038db0 0x7fa6f003b270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4006fd0 tx=0x7fa6f4006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 msgr2=0x7fa70407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa70407db10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa700009fb0 tx=0x7fa700011c60 comp rx=0 tx=0).stop 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 shutdown_connections 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7fa6f0038db0 0x7fa6f003b270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 --2- 172.21.15.42:0/437259269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa704107ea0 0x7fa70407db10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 >> 172.21.15.42:0/437259269 conn(0x7fa7041034a0 msgr2=0x7fa704104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 shutdown_connections 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:06.465+0000 7fa70be92700 1 -- 172.21.15.42:0/437259269 wait complete. 2024-03-31T23:08:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling cephadm module... 2024-03-31T23:08:08.003 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:07 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3892270289' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-31T23:08:08.004 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: ignoring --setuser ceph since I am not root 2024-03-31T23:08:08.004 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: ignoring --setgroup ceph since I am not root 2024-03-31T23:08:08.269 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e0a477700 1 Processor -- start 2024-03-31T23:08:08.269 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e0a477700 1 -- start start 2024-03-31T23:08:08.269 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e0a477700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e04106510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:08.269 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e0a477700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04106ae0 con 0x7f3e041060f0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e04106510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e04106510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57240/0 (socket says 172.21.15.42:57240) 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e03fff700 1 -- 172.21.15.42:0/1372442619 learned_addr learned my addr 172.21.15.42:0/1372442619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.424+0000 7f3e03fff700 1 -- 172.21.15.42:0/1372442619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e04109080 con 0x7f3e041060f0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e03fff700 1 --2- 172.21.15.42:0/1372442619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e04106510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098a0 tx=0x7f3df4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1487ef5c7ec7dcf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e02ffd700 1 -- 172.21.15.42:0/1372442619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4004160 con 0x7f3e041060f0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e02ffd700 1 -- 172.21.15.42:0/1372442619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3df4004300 con 0x7f3e041060f0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e02ffd700 1 -- 172.21.15.42:0/1372442619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4011c00 con 0x7f3e041060f0 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 -- 172.21.15.42:0/1372442619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 msgr2=0x7f3e04106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 --2- 172.21.15.42:0/1372442619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e04106510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098a0 tx=0x7f3df4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 -- 172.21.15.42:0/1372442619 shutdown_connections 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 --2- 172.21.15.42:0/1372442619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e04106510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:08.270 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 -- 172.21.15.42:0/1372442619 >> 172.21.15.42:0/1372442619 conn(0x7f3e04101a60 msgr2=0x7f3e04103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 -- 172.21.15.42:0/1372442619 shutdown_connections 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.425+0000 7f3e0a477700 1 -- 172.21.15.42:0/1372442619 wait complete. 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e0a477700 1 Processor -- start 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e0a477700 1 -- start start 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e0a477700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e0419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e0a477700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0410c430 con 0x7f3e041060f0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e0419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e0419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57242/0 (socket says 172.21.15.42:57242) 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.426+0000 7f3e03fff700 1 -- 172.21.15.42:0/3892270289 learned_addr learned my addr 172.21.15.42:0/3892270289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e03fff700 1 -- 172.21.15.42:0/3892270289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0419c3d0 con 0x7f3e041060f0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e03fff700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e0419be90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009fb0 tx=0x7f3df4011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df40038b0 con 0x7f3e041060f0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3df401a430 con 0x7f3e041060f0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0419c660 con 0x7f3e041060f0 2024-03-31T23:08:08.271 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df40195e0 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.427+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0419f350 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.428+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46105+0+0 (secure 0 0 0) 0x7f3df4019890 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.428+0000 7f3e017fa700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f3dec038db0 0x7f3dec03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.428+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3df404cfe0 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.428+0000 7f3e037fe700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f3dec038db0 0x7f3dec03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.428+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e04063870 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.429+0000 7f3e037fe700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f3dec038db0 0x7f3dec03b270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3df8006fd0 tx=0x7f3df8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.434+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3df4020240 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.696+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f3e0419f520 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.747+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f3df400bc40 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e017fa700 1 -- 172.21.15.42:0/3892270289 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 5) ==== 46116+0+0 (secure 0 0 0) 0x7f3df402d960 con 0x7f3e041060f0 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f3dec038db0 msgr2=0x7f3dec03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f3dec038db0 0x7f3dec03b270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3df8006fd0 tx=0x7f3df8006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:08.272 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 msgr2=0x7f3e0419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e0419be90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009fb0 tx=0x7f3df4011c60 comp rx=0 tx=0).stop 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 shutdown_connections 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7f3dec038db0 0x7f3dec03b270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 --2- 172.21.15.42:0/3892270289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041060f0 0x7f3e0419be90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 >> 172.21.15.42:0/3892270289 conn(0x7f3e04101a60 msgr2=0x7f3e041025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 shutdown_connections 2024-03-31T23:08:08.273 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:07.750+0000 7f3e0a477700 1 -- 172.21.15.42:0/3892270289 wait complete. 2024-03-31T23:08:08.565 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:08.325+0000 7fe23e34f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:08:08.565 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:08.423+0000 7fe23e34f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:08:08.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:08 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3892270289' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-31T23:08:08.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:08 smithi042 ceph-mon[32380]: mgrmap e5: x(active, since 5s) 2024-03-31T23:08:09.452 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.119+0000 7fe23e34f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:08:09.452 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.215+0000 7fe23e34f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:08:09.452 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.359+0000 7fe23e34f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.662+0000 7ff4357c2700 1 Processor -- start 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.662+0000 7ff4357c2700 1 -- start start 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff4357c2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff430106530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff4357c2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff430106b00 con 0x7ff430106110 2024-03-31T23:08:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff42effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff430106530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff42effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff430106530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57276/0 (socket says 172.21.15.42:57276) 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff42effd700 1 -- 172.21.15.42:0/4036710767 learned_addr learned my addr 172.21.15.42:0/4036710767 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff42effd700 1 -- 172.21.15.42:0/4036710767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff430106c80 con 0x7ff430106110 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff42effd700 1 --2- 172.21.15.42:0/4036710767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff430106530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4200098a0 tx=0x7ff420009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907e551e6a159613 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.663+0000 7ff42dffb700 1 -- 172.21.15.42:0/4036710767 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff420004160 con 0x7ff430106110 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff42dffb700 1 -- 172.21.15.42:0/4036710767 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff420004300 con 0x7ff430106110 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff42dffb700 1 -- 172.21.15.42:0/4036710767 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff420011c00 con 0x7ff430106110 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff4357c2700 1 -- 172.21.15.42:0/4036710767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 msgr2=0x7ff430106530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff4357c2700 1 --2- 172.21.15.42:0/4036710767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff430106530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4200098a0 tx=0x7ff420009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff4357c2700 1 -- 172.21.15.42:0/4036710767 shutdown_connections 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff4357c2700 1 --2- 172.21.15.42:0/4036710767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff430106530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff4357c2700 1 -- 172.21.15.42:0/4036710767 >> 172.21.15.42:0/4036710767 conn(0x7ff430101a90 msgr2=0x7ff430103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.664+0000 7ff4357c2700 1 -- 172.21.15.42:0/4036710767 shutdown_connections 2024-03-31T23:08:09.461 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.665+0000 7ff4357c2700 1 -- 172.21.15.42:0/4036710767 wait complete. 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.665+0000 7ff4357c2700 1 Processor -- start 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.665+0000 7ff4357c2700 1 -- start start 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff4357c2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff43019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff4357c2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff43010c3c0 con 0x7ff430106110 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff42effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff43019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff42effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff43019be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57280/0 (socket says 172.21.15.42:57280) 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff42effd700 1 -- 172.21.15.42:0/2423908167 learned_addr learned my addr 172.21.15.42:0/2423908167 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff42effd700 1 -- 172.21.15.42:0/2423908167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43019c390 con 0x7ff430106110 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff42effd700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff43019be50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff420009fb0 tx=0x7ff420011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:09.462 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4200038b0 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff42001a430 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.666+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43019c680 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.667+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4200195e0 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.667+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43019f310 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.667+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 46116+0+0 (secure 0 0 0) 0x7ff420019900 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.668+0000 7ff427fff700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 0x7ff41c03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.668+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff420054060 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.668+0000 7ff42e7fc700 1 -- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 msgr2=0x7ff41c03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.668+0000 7ff42e7fc700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 0x7ff41c03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.668+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff430063870 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.673+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff420022340 con 0x7ff430106110 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.869+0000 7ff42e7fc700 1 -- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 msgr2=0x7ff41c03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.869+0000 7ff42e7fc700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 0x7ff41c03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-31T23:08:09.463 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.956+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff43019f4e0 con 0x7ff430106110 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.956+0000 7ff427fff700 1 -- 172.21.15.42:0/2423908167 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7ff43019f4e0 con 0x7ff430106110 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 msgr2=0x7ff41c03b2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 0x7ff41c03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 msgr2=0x7ff43019be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff43019be50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff420009fb0 tx=0x7ff420011c60 comp rx=0 tx=0).stop 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 shutdown_connections 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7ff41c038e00 0x7ff41c03b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 --2- 172.21.15.42:0/2423908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff430106110 0x7ff43019be50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 >> 172.21.15.42:0/2423908167 conn(0x7ff430101a90 msgr2=0x7ff430102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 shutdown_connections 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:08.960+0000 7ff4357c2700 1 -- 172.21.15.42:0/2423908167 wait complete. 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-03-31T23:08:09.464 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 5... 2024-03-31T23:08:09.754 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.459+0000 7fe23e34f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:08:09.754 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.547+0000 7fe23e34f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:08:10.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2423908167' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-31T23:08:10.031 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.826+0000 7fe23e34f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:08:10.032 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:09.941+0000 7fe23e34f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:08:10.032 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:10.029+0000 7fe23e34f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:08:10.305 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:10.126+0000 7fe23e34f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:08:10.305 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:10.303+0000 7fe23e34f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:08:11.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:11.286+0000 7fe23e34f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:08:11.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:11.420+0000 7fe23e34f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:08:12.051 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:11.758+0000 7fe23e34f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:08:12.051 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:11.849+0000 7fe23e34f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:08:12.051 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:12.050+0000 7fe23e34f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:08:12.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:12.241+0000 7fe23e34f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:08:12.796 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:12.531+0000 7fe23e34f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:08:12.797 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:12.796+0000 7fe23e34f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:08:13.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:13.040+0000 7fe23e34f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:08:14.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:13.868+0000 7fe23e34f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:08:14.772 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:14.449+0000 7fe23e34f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:08:14.773 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:14.549+0000 7fe23e34f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:08:14.773 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:14.771+0000 7fe23e34f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:08:15.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: Active manager daemon x restarted 2024-03-31T23:08:15.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: Activating manager daemon x 2024-03-31T23:08:15.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: osdmap e2: 0 total, 0 up, 0 in 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: mgrmap e6: x(active, starting, since 0.00351681s) 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: Manager daemon x is now available 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-31T23:08:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:14 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-31T23:08:16.285 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.854+0000 7efd37ca1700 1 Processor -- start 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.854+0000 7efd37ca1700 1 -- start start 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd37ca1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3010ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd37ca1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efd3007be50 con 0x7efd30108850 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd35a3d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3010ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd35a3d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3010ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57284/0 (socket says 172.21.15.42:57284) 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd35a3d700 1 -- 172.21.15.42:0/1149439240 learned_addr learned my addr 172.21.15.42:0/1149439240 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd35a3d700 1 -- 172.21.15.42:0/1149439240 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3010b180 con 0x7efd30108850 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd35a3d700 1 --2- 172.21.15.42:0/1149439240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3010ac40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efd200098a0 tx=0x7efd20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd22aa64293a21df server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:16.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd34a3b700 1 -- 172.21.15.42:0/1149439240 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd20004160 con 0x7efd30108850 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd34a3b700 1 -- 172.21.15.42:0/1149439240 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efd20004300 con 0x7efd30108850 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.855+0000 7efd34a3b700 1 -- 172.21.15.42:0/1149439240 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd20011c00 con 0x7efd30108850 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 -- 172.21.15.42:0/1149439240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 msgr2=0x7efd3010ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1149439240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3010ac40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efd200098a0 tx=0x7efd20009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 -- 172.21.15.42:0/1149439240 shutdown_connections 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1149439240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3010ac40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 -- 172.21.15.42:0/1149439240 >> 172.21.15.42:0/1149439240 conn(0x7efd301022a0 msgr2=0x7efd301046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 -- 172.21.15.42:0/1149439240 shutdown_connections 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.856+0000 7efd37ca1700 1 -- 172.21.15.42:0/1149439240 wait complete. 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd37ca1700 1 Processor -- start 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd37ca1700 1 -- start start 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd37ca1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:16.294 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd37ca1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efd3010c210 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd35a3d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd35a3d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57296/0 (socket says 172.21.15.42:57296) 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.857+0000 7efd35a3d700 1 -- 172.21.15.42:0/1514705296 learned_addr learned my addr 172.21.15.42:0/1514705296 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd35a3d700 1 -- 172.21.15.42:0/1514705296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3019c380 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd35a3d700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3019be40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efd20003fb0 tx=0x7efd20011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd200039c0 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efd20003b60 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3019c610 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd2001a6b0 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.858+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3019f300 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.859+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 46116+0+0 (secure 0 0 0) 0x7efd2001aa30 con 0x7efd30108850 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.859+0000 7efd26ffd700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:16.295 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.859+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 --> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efd1c03b980 con 0x7efd1c038db0 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.859+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efd2004d200 con 0x7efd30108850 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.859+0000 7efd3523c700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 msgr2=0x7efd1c03b270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:09.859+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:10.060+0000 7efd3523c700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 msgr2=0x7efd1c03b270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:10.060+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:10.461+0000 7efd3523c700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 msgr2=0x7efd1c03b270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:10.461+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:11.263+0000 7efd3523c700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 msgr2=0x7efd1c03b270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:11.263+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:12.864+0000 7efd3523c700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 msgr2=0x7efd1c03b270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/3342764964 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:12.864+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:14.775+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 6) ==== 45883+0+0 (secure 0 0 0) 0x7efd2002d910 con 0x7efd30108850 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:14.775+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 msgr2=0x7efd1c03b270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:08:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:14.775+0000 7efd26ffd700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.776+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 7) ==== 46010+0+0 (secure 0 0 0) 0x7efd2004f420 con 0x7efd30108850 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.776+0000 7efd26ffd700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7efd1c03c6e0 0x7efd1c03ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.776+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efd1c03b980 con 0x7efd1c03c6e0 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.776+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7efd1c03c6e0 0x7efd1c03ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.777+0000 7efd3523c700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7efd1c03c6e0 0x7efd1c03ead0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efd2c003a10 tx=0x7efd2c009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.778+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7efd1c03b980 con 0x7efd1c03c6e0 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.784+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7efd30063870 con 0x7efd1c03c6e0 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd26ffd700 1 -- 172.21.15.42:0/1514705296 <== mgr.14120 v2:172.21.15.42:6800/1517474041 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7efd30063870 con 0x7efd1c03c6e0 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7efd1c03c6e0 msgr2=0x7efd1c03ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7efd1c03c6e0 0x7efd1c03ead0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efd2c003a10 tx=0x7efd2c009290 comp rx=0 tx=0).stop 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 msgr2=0x7efd3019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3019be40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efd20003fb0 tx=0x7efd20011bd0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.297 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 shutdown_connections 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7efd1c03c6e0 0x7efd1c03ead0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd30108850 0x7efd3019be40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 --2- 172.21.15.42:0/1514705296 >> [v2:172.21.15.42:6800/3342764964,v1:172.21.15.42:6801/3342764964] conn(0x7efd1c038db0 0x7efd1c03b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 >> 172.21.15.42:0/1514705296 conn(0x7efd301022a0 msgr2=0x7efd30102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 shutdown_connections 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:15.785+0000 7efd37ca1700 1 -- 172.21.15.42:0/1514705296 wait complete. 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 5 is available 2024-03-31T23:08:16.298 INFO:teuthology.orchestra.run.smithi042.stdout:Setting orchestrator backend to cephadm... 2024-03-31T23:08:16.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:16 smithi042 ceph-mon[32380]: Found migration_current of "None". Setting to last migration. 2024-03-31T23:08:16.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:16 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:16.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:16 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:16.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:16 smithi042 ceph-mon[32380]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-31T23:08:16.671 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:16 smithi042 ceph-mon[32380]: mgrmap e7: x(active, since 1.005s) 2024-03-31T23:08:16.671 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:16 smithi042 ceph-mon[32380]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-31T23:08:17.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44fbb25700 1 Processor -- start 2024-03-31T23:08:17.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44fbb25700 1 -- start start 2024-03-31T23:08:17.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44fbb25700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:17.550 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44fbb25700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44f407c7c0 con 0x7f44f407ddd0 2024-03-31T23:08:17.550 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44f98c1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:17.550 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44f98c1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60496/0 (socket says 172.21.15.42:60496) 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.703+0000 7f44f98c1700 1 -- 172.21.15.42:0/3621151774 learned_addr learned my addr 172.21.15.42:0/3621151774 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.704+0000 7f44f98c1700 1 -- 172.21.15.42:0/3621151774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f407c940 con 0x7f44f407ddd0 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.704+0000 7f44f98c1700 1 --2- 172.21.15.42:0/3621151774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f407c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f44e40098a0 tx=0x7f44e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231c5932a7d74769 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.704+0000 7f44f88bf700 1 -- 172.21.15.42:0/3621151774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e4004160 con 0x7f44f407ddd0 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.704+0000 7f44f88bf700 1 -- 172.21.15.42:0/3621151774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f44e4004300 con 0x7f44f407ddd0 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.704+0000 7f44f88bf700 1 -- 172.21.15.42:0/3621151774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e4011c00 con 0x7f44f407ddd0 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 -- 172.21.15.42:0/3621151774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 msgr2=0x7f44f407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 --2- 172.21.15.42:0/3621151774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f407c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f44e40098a0 tx=0x7f44e4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 -- 172.21.15.42:0/3621151774 shutdown_connections 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 --2- 172.21.15.42:0/3621151774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f407c280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:17.551 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 -- 172.21.15.42:0/3621151774 >> 172.21.15.42:0/3621151774 conn(0x7f44f4103460 msgr2=0x7f44f4105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 -- 172.21.15.42:0/3621151774 shutdown_connections 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 -- 172.21.15.42:0/3621151774 wait complete. 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 Processor -- start 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.705+0000 7f44fbb25700 1 -- start start 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44fbb25700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44fbb25700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44f410e490 con 0x7f44f407ddd0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44f98c1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44f98c1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60498/0 (socket says 172.21.15.42:60498) 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44f98c1700 1 -- 172.21.15.42:0/3958074968 learned_addr learned my addr 172.21.15.42:0/3958074968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44f98c1700 1 -- 172.21.15.42:0/3958074968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f419e540 con 0x7f44f407ddd0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44f98c1700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f419e000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44e4003fb0 tx=0x7f44e4011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e40039c0 con 0x7f44f407ddd0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f44e4003b60 con 0x7f44f407ddd0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f419e7d0 con 0x7f44f407ddd0 2024-03-31T23:08:17.552 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e401a6b0 con 0x7f44f407ddd0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.706+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f41a14c0 con 0x7f44f407ddd0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.707+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 7) ==== 46010+0+0 (secure 0 0 0) 0x7f44e4024430 con 0x7f44f407ddd0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.707+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f4063870 con 0x7f44f407ddd0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.708+0000 7f44eaffd700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f44e0038ca0 0x7f44e003b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.708+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f44e404cfb0 con 0x7f44f407ddd0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.708+0000 7f44f90c0700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f44e0038ca0 0x7f44e003b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.708+0000 7f44f90c0700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f44e0038ca0 0x7f44e003b160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f44f0006fd0 tx=0x7f44f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.713+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f44e400f2e0 con 0x7f44f407ddd0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.934+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f44f4104720 con 0x7f44e0038ca0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.939+0000 7f44eaffd700 1 -- 172.21.15.42:0/3958074968 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f44f4104720 con 0x7f44e0038ca0 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f44e0038ca0 msgr2=0x7f44e003b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f44e0038ca0 0x7f44e003b160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f44f0006fd0 tx=0x7f44f0006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 msgr2=0x7f44f419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f419e000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44e4003fb0 tx=0x7f44e4011bd0 comp rx=0 tx=0).stop 2024-03-31T23:08:17.553 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 shutdown_connections 2024-03-31T23:08:17.554 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f44e0038ca0 0x7f44e003b160 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:17.554 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 --2- 172.21.15.42:0/3958074968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f407ddd0 0x7f44f419e000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:17.554 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 >> 172.21.15.42:0/3958074968 conn(0x7f44f4103460 msgr2=0x7f44f4104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:17.554 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 shutdown_connections 2024-03-31T23:08:17.554 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:16.942+0000 7f44fbb25700 1 -- 172.21.15.42:0/3958074968 wait complete. 2024-03-31T23:08:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: mgrmap e8: x(active, since 2s) 2024-03-31T23:08:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:17] ENGINE Bus STARTING 2024-03-31T23:08:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:17] ENGINE Serving on http://172.21.15.42:8765 2024-03-31T23:08:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:17 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:18.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-31T23:08:18.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.992+0000 7fc557c2a700 1 Processor -- start 2024-03-31T23:08:18.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc557c2a700 1 -- start start 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc557c2a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc557c2a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc55007c800 con 0x7fc55007ddc0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc5559c6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc5559c6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55007c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60500/0 (socket says 172.21.15.42:60500) 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc5559c6700 1 -- 172.21.15.42:0/1708249673 learned_addr learned my addr 172.21.15.42:0/1708249673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.993+0000 7fc5559c6700 1 -- 172.21.15.42:0/1708249673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55007c980 con 0x7fc55007ddc0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc5559c6700 1 --2- 172.21.15.42:0/1708249673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55007c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0098a0 tx=0x7fc54c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9821cc97457911e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc5549c4700 1 -- 172.21.15.42:0/1708249673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c004160 con 0x7fc55007ddc0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc5549c4700 1 -- 172.21.15.42:0/1708249673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fc54c004300 con 0x7fc55007ddc0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc5549c4700 1 -- 172.21.15.42:0/1708249673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c011c00 con 0x7fc55007ddc0 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc557c2a700 1 -- 172.21.15.42:0/1708249673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 msgr2=0x7fc55007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc557c2a700 1 --2- 172.21.15.42:0/1708249673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55007c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0098a0 tx=0x7fc54c009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc557c2a700 1 -- 172.21.15.42:0/1708249673 shutdown_connections 2024-03-31T23:08:18.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc557c2a700 1 --2- 172.21.15.42:0/1708249673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55007c2c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc557c2a700 1 -- 172.21.15.42:0/1708249673 >> 172.21.15.42:0/1708249673 conn(0x7fc5501034a0 msgr2=0x7fc5501058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.994+0000 7fc557c2a700 1 -- 172.21.15.42:0/1708249673 shutdown_connections 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc557c2a700 1 -- 172.21.15.42:0/1708249673 wait complete. 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc557c2a700 1 Processor -- start 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc557c2a700 1 -- start start 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc557c2a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc557c2a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc55010e490 con 0x7fc55007ddc0 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc5559c6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc5559c6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55019e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60514/0 (socket says 172.21.15.42:60514) 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.995+0000 7fc5559c6700 1 -- 172.21.15.42:0/2721909543 learned_addr learned my addr 172.21.15.42:0/2721909543 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc5559c6700 1 -- 172.21.15.42:0/2721909543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55019e5c0 con 0x7fc55007ddc0 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc5559c6700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55019e080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009fb0 tx=0x7fc54c011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c0038b0 con 0x7fc55007ddc0 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fc54c01a430 con 0x7fc55007ddc0 2024-03-31T23:08:18.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55019e850 con 0x7fc55007ddc0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5501a1540 con 0x7fc55007ddc0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.996+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c019630 con 0x7fc55007ddc0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.997+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7fc54c019950 con 0x7fc55007ddc0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.997+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc534005360 con 0x7fc55007ddc0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.997+0000 7fc546ffd700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fc53c038db0 0x7fc53c03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.997+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc54c04cff0 con 0x7fc55007ddc0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.997+0000 7fc5551c5700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fc53c038db0 0x7fc53c03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:18.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:17.998+0000 7fc5551c5700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fc53c038db0 0x7fc53c03b270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc540006fd0 tx=0x7fc540006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.002+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc54c00f2e0 con 0x7fc55007ddc0 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.210+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fc534000bf0 con 0x7fc53c038db0 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.210+0000 7fc546ffd700 1 -- 172.21.15.42:0/2721909543 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fc534000bf0 con 0x7fc53c038db0 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fc53c038db0 msgr2=0x7fc53c03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fc53c038db0 0x7fc53c03b270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc540006fd0 tx=0x7fc540006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 msgr2=0x7fc55019e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55019e080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009fb0 tx=0x7fc54c011c60 comp rx=0 tx=0).stop 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 shutdown_connections 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fc53c038db0 0x7fc53c03b270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 --2- 172.21.15.42:0/2721909543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc55007ddc0 0x7fc55019e080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 >> 172.21.15.42:0/2721909543 conn(0x7fc5501034a0 msgr2=0x7fc550104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 shutdown_connections 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:18.212+0000 7fc557c2a700 1 -- 172.21.15.42:0/2721909543 wait complete. 2024-03-31T23:08:18.768 INFO:teuthology.orchestra.run.smithi042.stdout:Generating ssh key... 2024-03-31T23:08:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:18 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:17] ENGINE Serving on https://172.21.15.42:7150 2024-03-31T23:08:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:18 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:17] ENGINE Bus STARTED 2024-03-31T23:08:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:18 smithi042 ceph-mon[32380]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: Generating public/private rsa key pair. 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: Your identification has been saved in /tmp/tmp6um2atms/key. 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: Your public key has been saved in /tmp/tmp6um2atms/key.pub. 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: The key fingerprint is: 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: SHA256:yG/vmL2FS6eTz9uOLI0m9Njjj+qNvLRu1gtdKwYjpf4 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: The key's randomart image is: 2024-03-31T23:08:20.020 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: +---[RSA 3072]----+ 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | . | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | . + | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | = S . | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | . o.+ o . | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | ..==*++ | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | ==%@X.o | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: | =EB%OBoo | 2024-03-31T23:08:20.021 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: +----[SHA256]-----+ 2024-03-31T23:08:20.303 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.182+0000 7f1f02473700 1 Processor -- start 2024-03-31T23:08:20.303 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1f02473700 1 -- start start 2024-03-31T23:08:20.303 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1f02473700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc10aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:20.303 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1f02473700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc07be50 con 0x7f1efc1088b0 2024-03-31T23:08:20.303 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1efbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc10aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1efbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc10aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60518/0 (socket says 172.21.15.42:60518) 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1efbfff700 1 -- 172.21.15.42:0/2829301776 learned_addr learned my addr 172.21.15.42:0/2829301776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1efbfff700 1 -- 172.21.15.42:0/2829301776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc10b1e0 con 0x7f1efc1088b0 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.183+0000 7f1efbfff700 1 --2- 172.21.15.42:0/2829301776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc10aca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00098a0 tx=0x7f1ef0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab10bcab03861d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1efaffd700 1 -- 172.21.15.42:0/2829301776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0004160 con 0x7f1efc1088b0 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1efaffd700 1 -- 172.21.15.42:0/2829301776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1ef0004300 con 0x7f1efc1088b0 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1efaffd700 1 -- 172.21.15.42:0/2829301776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0011c00 con 0x7f1efc1088b0 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 -- 172.21.15.42:0/2829301776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 msgr2=0x7f1efc10aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 --2- 172.21.15.42:0/2829301776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc10aca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00098a0 tx=0x7f1ef0009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 -- 172.21.15.42:0/2829301776 shutdown_connections 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 --2- 172.21.15.42:0/2829301776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc10aca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:20.304 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 -- 172.21.15.42:0/2829301776 >> 172.21.15.42:0/2829301776 conn(0x7f1efc102320 msgr2=0x7f1efc104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 -- 172.21.15.42:0/2829301776 shutdown_connections 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.184+0000 7f1f02473700 1 -- 172.21.15.42:0/2829301776 wait complete. 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1f02473700 1 Processor -- start 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1f02473700 1 -- start start 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1f02473700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1f02473700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc10c270 con 0x7f1efc1088b0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1efbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1efbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60524/0 (socket says 172.21.15.42:60524) 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.185+0000 7f1efbfff700 1 -- 172.21.15.42:0/3320273210 learned_addr learned my addr 172.21.15.42:0/3320273210 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1efbfff700 1 -- 172.21.15.42:0/3320273210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc19c390 con 0x7f1efc1088b0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1efbfff700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc19be50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0003fb0 tx=0x7f1ef0011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef00039c0 con 0x7f1efc1088b0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1ef0003b60 con 0x7f1efc1088b0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1efc19c620 con 0x7f1efc1088b0 2024-03-31T23:08:20.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef001a6b0 con 0x7f1efc1088b0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.186+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1efc19f310 con 0x7f1efc1088b0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.187+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f1ef001a9d0 con 0x7f1efc1088b0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.187+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1efc063870 con 0x7f1efc1088b0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.187+0000 7f1ef97fa700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f1ee4038db0 0x7f1ee403b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.187+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1ef004d190 con 0x7f1efc1088b0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.187+0000 7f1efb7fe700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f1ee4038db0 0x7f1ee403b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.188+0000 7f1efb7fe700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f1ee4038db0 0x7f1ee403b270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1eec006fd0 tx=0x7f1eec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.192+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1ef0019c70 con 0x7f1efc1088b0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.397+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f1efc103500 con 0x7f1ee4038db0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.719+0000 7f1ef97fa700 1 -- 172.21.15.42:0/3320273210 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1efc103500 con 0x7f1ee4038db0 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f1ee4038db0 msgr2=0x7f1ee403b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f1ee4038db0 0x7f1ee403b270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1eec006fd0 tx=0x7f1eec006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 msgr2=0x7f1efc19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc19be50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0003fb0 tx=0x7f1ef0011bd0 comp rx=0 tx=0).stop 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 shutdown_connections 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f1ee4038db0 0x7f1ee403b270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 --2- 172.21.15.42:0/3320273210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1efc1088b0 0x7f1efc19be50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 >> 172.21.15.42:0/3320273210 conn(0x7f1efc102320 msgr2=0x7f1efc102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 shutdown_connections 2024-03-31T23:08:20.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:19.721+0000 7f1f02473700 1 -- 172.21.15.42:0/3320273210 wait complete. 2024-03-31T23:08:20.897 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:20 smithi042 ceph-mon[32380]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:20.897 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:20 smithi042 ceph-mon[32380]: Generating ssh key... 2024-03-31T23:08:20.897 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:20 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:20.897 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:20 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.682+0000 7f17da01b700 1 Processor -- start 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.682+0000 7f17da01b700 1 -- start start 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.682+0000 7f17da01b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d410ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.682+0000 7f17da01b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17d407bdf0 con 0x7f17d4108920 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d410ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d410ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60534/0 (socket says 172.21.15.42:60534) 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d37fe700 1 -- 172.21.15.42:0/1261707848 learned_addr learned my addr 172.21.15.42:0/1261707848 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:21.377 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d37fe700 1 -- 172.21.15.42:0/1261707848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d410b250 con 0x7f17d4108920 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d37fe700 1 --2- 172.21.15.42:0/1261707848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d410ad10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17c40098a0 tx=0x7f17c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc4975be84a9614 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d27fc700 1 -- 172.21.15.42:0/1261707848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c4004160 con 0x7f17d4108920 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d27fc700 1 -- 172.21.15.42:0/1261707848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f17c4004300 con 0x7f17d4108920 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.683+0000 7f17d27fc700 1 -- 172.21.15.42:0/1261707848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c4011c00 con 0x7f17d4108920 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 -- 172.21.15.42:0/1261707848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 msgr2=0x7f17d410ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 --2- 172.21.15.42:0/1261707848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d410ad10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17c40098a0 tx=0x7f17c4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 -- 172.21.15.42:0/1261707848 shutdown_connections 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 --2- 172.21.15.42:0/1261707848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d410ad10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 -- 172.21.15.42:0/1261707848 >> 172.21.15.42:0/1261707848 conn(0x7f17d4102370 msgr2=0x7f17d4104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 -- 172.21.15.42:0/1261707848 shutdown_connections 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 -- 172.21.15.42:0/1261707848 wait complete. 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.684+0000 7f17da01b700 1 Processor -- start 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17da01b700 1 -- start start 2024-03-31T23:08:21.378 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17da01b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17da01b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17d410c280 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60550/0 (socket says 172.21.15.42:60550) 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d37fe700 1 -- 172.21.15.42:0/1535031523 learned_addr learned my addr 172.21.15.42:0/1535031523 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d37fe700 1 -- 172.21.15.42:0/1535031523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d419c3f0 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d37fe700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d419beb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17c4011bd0 tx=0x7f17c4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c4003970 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.685+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f17c4003b10 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.686+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d419c680 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.686+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c40245a0 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.686+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d419f370 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.686+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f17c4024870 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.687+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d4063870 con 0x7f17d4108920 2024-03-31T23:08:21.379 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.687+0000 7f17d0ff9700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f17bc038e50 0x7f17bc03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.687+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f17c404cf20 con 0x7f17d4108920 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.687+0000 7f17d2ffd700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f17bc038e50 0x7f17bc03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.687+0000 7f17d2ffd700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f17bc038e50 0x7f17bc03b310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006fd0 tx=0x7f17c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.692+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f17c40212a0 con 0x7f17d4108920 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.896+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f17d41035e0 con 0x7f17bc038e50 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.897+0000 7f17d0ff9700 1 -- 172.21.15.42:0/1535031523 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f17d41035e0 con 0x7f17bc038e50 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f17bc038e50 msgr2=0x7f17bc03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f17bc038e50 0x7f17bc03b310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006fd0 tx=0x7f17c8006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 msgr2=0x7f17d419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:21.380 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d419beb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17c4011bd0 tx=0x7f17c4011cb0 comp rx=0 tx=0).stop 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 shutdown_connections 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f17bc038e50 0x7f17bc03b310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 --2- 172.21.15.42:0/1535031523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17d4108920 0x7f17d419beb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 >> 172.21.15.42:0/1535031523 conn(0x7f17d4102370 msgr2=0x7f17d4102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 shutdown_connections 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:20.899+0000 7f17da01b700 1 -- 172.21.15.42:0/1535031523 wait complete. 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:Adding key to root@localhost authorized_keys... 2024-03-31T23:08:21.381 INFO:teuthology.orchestra.run.smithi042.stdout:Adding host smithi042... 2024-03-31T23:08:22.028 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:21 smithi042 ceph-mon[32380]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:23.004 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:22 smithi042 ceph-mon[32380]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:23.004 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:22 smithi042 ceph-mon[32380]: Deploying cephadm binary to smithi042 2024-03-31T23:08:26.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Added host 'smithi042' with addr '172.21.15.42' 2024-03-31T23:08:26.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.806+0000 7f5165044700 1 Processor -- start 2024-03-31T23:08:26.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.806+0000 7f5165044700 1 -- start start 2024-03-31T23:08:26.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f5165044700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f5160108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f5165044700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51601087c0 con 0x7f5160107e60 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f5160108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f5160108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60564/0 (socket says 172.21.15.42:60564) 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515ed9d700 1 -- 172.21.15.42:0/2963486956 learned_addr learned my addr 172.21.15.42:0/2963486956 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515ed9d700 1 -- 172.21.15.42:0/2963486956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5160108f70 con 0x7f5160107e60 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515ed9d700 1 --2- 172.21.15.42:0/2963486956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f5160108280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51500098a0 tx=0x7f5150009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656c7016ceb59a48 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515dd9b700 1 -- 172.21.15.42:0/2963486956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5150004160 con 0x7f5160107e60 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515dd9b700 1 -- 172.21.15.42:0/2963486956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5150004300 con 0x7f5160107e60 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.807+0000 7f515dd9b700 1 -- 172.21.15.42:0/2963486956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5150011c00 con 0x7f5160107e60 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 -- 172.21.15.42:0/2963486956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 msgr2=0x7f5160108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 --2- 172.21.15.42:0/2963486956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f5160108280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51500098a0 tx=0x7f5150009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 -- 172.21.15.42:0/2963486956 shutdown_connections 2024-03-31T23:08:26.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 --2- 172.21.15.42:0/2963486956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f5160108280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 -- 172.21.15.42:0/2963486956 >> 172.21.15.42:0/2963486956 conn(0x7f5160103420 msgr2=0x7f5160105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 -- 172.21.15.42:0/2963486956 shutdown_connections 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.808+0000 7f5165044700 1 -- 172.21.15.42:0/2963486956 wait complete. 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f5165044700 1 Processor -- start 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f5165044700 1 -- start start 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f5165044700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f516019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f5165044700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f516010c3b0 con 0x7f5160107e60 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f515ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f516019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f515ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f516019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60570/0 (socket says 172.21.15.42:60570) 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.809+0000 7f515ed9d700 1 -- 172.21.15.42:0/1975515317 learned_addr learned my addr 172.21.15.42:0/1975515317 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f515ed9d700 1 -- 172.21.15.42:0/1975515317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516019c3f0 con 0x7f5160107e60 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f515ed9d700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f516019beb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5150011bd0 tx=0x7f5150011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:26.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5150003970 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5150003b10 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516019c680 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51500245a0 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.810+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516019f370 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.811+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f5150024850 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.811+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5160063870 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.811+0000 7f5147fff700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f5148038e50 0x7f514803b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.811+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f515004cf30 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.811+0000 7f515e59c700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f5148038e50 0x7f514803b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.812+0000 7f515e59c700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f5148038e50 0x7f514803b310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5154006fd0 tx=0x7f5154006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:21.816+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5150003cc0 con 0x7f5160107e60 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:22.027+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}) -- 0x7f5160104660 con 0x7f5148038e50 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.306+0000 7f5147fff700 1 -- 172.21.15.42:0/1975515317 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5160104660 con 0x7f5148038e50 2024-03-31T23:08:26.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f5148038e50 msgr2=0x7f514803b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f5148038e50 0x7f514803b310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5154006fd0 tx=0x7f5154006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 msgr2=0x7f516019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f516019beb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5150011bd0 tx=0x7f5150011cb0 comp rx=0 tx=0).stop 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 shutdown_connections 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f5148038e50 0x7f514803b310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 --2- 172.21.15.42:0/1975515317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5160107e60 0x7f516019beb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.308+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 >> 172.21.15.42:0/1975515317 conn(0x7f5160103420 msgr2=0x7f5160103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.309+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 shutdown_connections 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:26.309+0000 7f5165044700 1 -- 172.21.15.42:0/1975515317 wait complete. 2024-03-31T23:08:26.913 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mon service... 2024-03-31T23:08:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:27 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:27 smithi042 ceph-mon[32380]: Added host smithi042 2024-03-31T23:08:27.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:27 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:28.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1c1509700 1 Processor -- start 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1c1509700 1 -- start start 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1c1509700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc1064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1c1509700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc106a70 con 0x7ff1bc106080 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1baffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc1064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1baffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc1064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43872/0 (socket says 172.21.15.42:43872) 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.359+0000 7ff1baffd700 1 -- 172.21.15.42:0/1729454796 learned_addr learned my addr 172.21.15.42:0/1729454796 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1baffd700 1 -- 172.21.15.42:0/1729454796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc106bf0 con 0x7ff1bc106080 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1baffd700 1 --2- 172.21.15.42:0/1729454796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc1064a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40098a0 tx=0x7ff1b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a550f0e834af11d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1b9ffb700 1 -- 172.21.15.42:0/1729454796 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4004160 con 0x7ff1bc106080 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1b9ffb700 1 -- 172.21.15.42:0/1729454796 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff1b4004300 con 0x7ff1bc106080 2024-03-31T23:08:28.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1b9ffb700 1 -- 172.21.15.42:0/1729454796 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4011c00 con 0x7ff1bc106080 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1c1509700 1 -- 172.21.15.42:0/1729454796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 msgr2=0x7ff1bc1064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.360+0000 7ff1c1509700 1 --2- 172.21.15.42:0/1729454796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc1064a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40098a0 tx=0x7ff1b4009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 -- 172.21.15.42:0/1729454796 shutdown_connections 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 --2- 172.21.15.42:0/1729454796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc1064a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 -- 172.21.15.42:0/1729454796 >> 172.21.15.42:0/1729454796 conn(0x7ff1bc101a60 msgr2=0x7ff1bc103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 -- 172.21.15.42:0/1729454796 shutdown_connections 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 -- 172.21.15.42:0/1729454796 wait complete. 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 Processor -- start 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 -- start start 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.361+0000 7ff1c1509700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc10c330 con 0x7ff1bc106080 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1baffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1baffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43886/0 (socket says 172.21.15.42:43886) 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1baffd700 1 -- 172.21.15.42:0/3811463398 learned_addr learned my addr 172.21.15.42:0/3811463398 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:28.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1baffd700 1 -- 172.21.15.42:0/3811463398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc19c390 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1baffd700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc19be50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4003fb0 tx=0x7ff1b4011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b40039c0 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff1b4003b60 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc19c620 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b401a6d0 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.362+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc19f310 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.363+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7ff1b40249a0 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.363+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1bc10c4b0 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.363+0000 7ff1b3fff700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff1a8038db0 0x7ff1a803b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.363+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff1b404d150 con 0x7ff1bc106080 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.363+0000 7ff1ba7fc700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff1a8038db0 0x7ff1a803b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.364+0000 7ff1ba7fc700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff1a8038db0 0x7ff1a803b270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4006fd0 tx=0x7ff1a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:28.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.368+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff1b400f2e0 con 0x7ff1bc106080 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.591+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff1bc102d00 con 0x7ff1a8038db0 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.596+0000 7ff1b3fff700 1 -- 172.21.15.42:0/3811463398 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff1bc102d00 con 0x7ff1a8038db0 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff1a8038db0 msgr2=0x7ff1a803b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff1a8038db0 0x7ff1a803b270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4006fd0 tx=0x7ff1a4006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 msgr2=0x7ff1bc19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc19be50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4003fb0 tx=0x7ff1b4011bd0 comp rx=0 tx=0).stop 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 shutdown_connections 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff1a8038db0 0x7ff1a803b270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 --2- 172.21.15.42:0/3811463398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1bc106080 0x7ff1bc19be50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 >> 172.21.15.42:0/3811463398 conn(0x7ff1bc101a60 msgr2=0x7ff1bc1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 shutdown_connections 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:27.598+0000 7ff1c1509700 1 -- 172.21.15.42:0/3811463398 wait complete. 2024-03-31T23:08:28.147 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mgr service... 2024-03-31T23:08:28.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:28 smithi042 ceph-mon[32380]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:28.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:28 smithi042 ceph-mon[32380]: Saving service mon spec with placement count:5 2024-03-31T23:08:28.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:28 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:29.344 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-31T23:08:29.344 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4876d6a700 1 Processor -- start 2024-03-31T23:08:29.344 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4876d6a700 1 -- start start 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4876d6a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f487010acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4876d6a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f487007be10 con 0x7f48701088e0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4874b06700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f487010acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4874b06700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f487010acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43894/0 (socket says 172.21.15.42:43894) 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4874b06700 1 -- 172.21.15.42:0/16643800 learned_addr learned my addr 172.21.15.42:0/16643800 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.558+0000 7f4874b06700 1 -- 172.21.15.42:0/16643800 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487010b210 con 0x7f48701088e0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4874b06700 1 --2- 172.21.15.42:0/16643800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f487010acd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48640098a0 tx=0x7f4864009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd198653b921a609 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f486f7fe700 1 -- 172.21.15.42:0/16643800 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864004160 con 0x7f48701088e0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f486f7fe700 1 -- 172.21.15.42:0/16643800 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4864004300 con 0x7f48701088e0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f486f7fe700 1 -- 172.21.15.42:0/16643800 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864011c00 con 0x7f48701088e0 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 -- 172.21.15.42:0/16643800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 msgr2=0x7f487010acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 --2- 172.21.15.42:0/16643800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f487010acd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48640098a0 tx=0x7f4864009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:29.345 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 -- 172.21.15.42:0/16643800 shutdown_connections 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 --2- 172.21.15.42:0/16643800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f487010acd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 -- 172.21.15.42:0/16643800 >> 172.21.15.42:0/16643800 conn(0x7f48701022f0 msgr2=0x7f4870104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 -- 172.21.15.42:0/16643800 shutdown_connections 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.559+0000 7f4876d6a700 1 -- 172.21.15.42:0/16643800 wait complete. 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4876d6a700 1 Processor -- start 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4876d6a700 1 -- start start 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4876d6a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f4870108160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4876d6a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f487010c290 con 0x7f48701088e0 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4874b06700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f4870108160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4874b06700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f4870108160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43902/0 (socket says 172.21.15.42:43902) 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4874b06700 1 -- 172.21.15.42:0/83065763 learned_addr learned my addr 172.21.15.42:0/83065763 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.560+0000 7f4874b06700 1 -- 172.21.15.42:0/83065763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48701086a0 con 0x7f48701088e0 2024-03-31T23:08:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.561+0000 7f4874b06700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f4870108160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4864011bd0 tx=0x7f4864011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.561+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864003b20 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.561+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4864003cc0 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.561+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864024930 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.561+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4870106890 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.561+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4870106dd0 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.562+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f4864022020 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.562+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4870063870 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.562+0000 7f486dffb700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f4860038e50 0x7f486003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.562+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f486404cdb0 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.562+0000 7f486ffff700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f4860038e50 0x7f486003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.563+0000 7f486ffff700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f4860038e50 0x7f486003b310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f485c006fd0 tx=0x7f485c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.567+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f486401aca0 con 0x7f48701088e0 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.792+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f48701034d0 con 0x7f4860038e50 2024-03-31T23:08:29.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.796+0000 7f486dffb700 1 -- 172.21.15.42:0/83065763 <== mgr.14120 v2:172.21.15.42:6800/1517474041 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f48701034d0 con 0x7f4860038e50 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f4860038e50 msgr2=0x7f486003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f4860038e50 0x7f486003b310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f485c006fd0 tx=0x7f485c006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 msgr2=0x7f4870108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f4870108160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4864011bd0 tx=0x7f4864011cb0 comp rx=0 tx=0).stop 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 shutdown_connections 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f4860038e50 0x7f486003b310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 --2- 172.21.15.42:0/83065763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48701088e0 0x7f4870108160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.798+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 >> 172.21.15.42:0/83065763 conn(0x7f48701022f0 msgr2=0x7f4870102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.799+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 shutdown_connections 2024-03-31T23:08:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:28.799+0000 7f4876d6a700 1 -- 172.21.15.42:0/83065763 wait complete. 2024-03-31T23:08:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:29 smithi042 ceph-mon[32380]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:29 smithi042 ceph-mon[32380]: Saving service mgr spec with placement count:2 2024-03-31T23:08:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:29 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:31.305 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.284+0000 7f360adf7700 1 Processor -- start 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.284+0000 7f360adf7700 1 -- start start 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f360adf7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360410ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f360adf7700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f360407be50 con 0x7f3604108850 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f3608b93700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360410ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f3608b93700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360410ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43918/0 (socket says 172.21.15.42:43918) 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f3608b93700 1 -- 172.21.15.42:0/3140259602 learned_addr learned my addr 172.21.15.42:0/3140259602 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f3608b93700 1 -- 172.21.15.42:0/3140259602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360410b180 con 0x7f3604108850 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f3608b93700 1 --2- 172.21.15.42:0/3140259602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360410ac40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35f80098a0 tx=0x7f35f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41a0d0f443928da server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f36037fe700 1 -- 172.21.15.42:0/3140259602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35f8004160 con 0x7f3604108850 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f36037fe700 1 -- 172.21.15.42:0/3140259602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f35f8004300 con 0x7f3604108850 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.285+0000 7f36037fe700 1 -- 172.21.15.42:0/3140259602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35f8011c00 con 0x7f3604108850 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 -- 172.21.15.42:0/3140259602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 msgr2=0x7f360410ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:31.306 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 --2- 172.21.15.42:0/3140259602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360410ac40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35f80098a0 tx=0x7f35f8009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 -- 172.21.15.42:0/3140259602 shutdown_connections 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 --2- 172.21.15.42:0/3140259602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360410ac40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 -- 172.21.15.42:0/3140259602 >> 172.21.15.42:0/3140259602 conn(0x7f36041022a0 msgr2=0x7f36041046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 -- 172.21.15.42:0/3140259602 shutdown_connections 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.286+0000 7f360adf7700 1 -- 172.21.15.42:0/3140259602 wait complete. 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f360adf7700 1 Processor -- start 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f360adf7700 1 -- start start 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f360adf7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360419be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f360adf7700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f360410c210 con 0x7f3604108850 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f3608b93700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360419be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f3608b93700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360419be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43924/0 (socket says 172.21.15.42:43924) 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f3608b93700 1 -- 172.21.15.42:0/2744468951 learned_addr learned my addr 172.21.15.42:0/2744468951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.287+0000 7f3608b93700 1 -- 172.21.15.42:0/2744468951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360419c380 con 0x7f3604108850 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.288+0000 7f3608b93700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360419be40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f35f8003fb0 tx=0x7f35f8011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:31.307 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.288+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35f80039c0 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.288+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360419c610 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.288+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f35f8003b60 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.288+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35f801a6b0 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.288+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f360419f300 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.289+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f35f8024430 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.289+0000 7f3601ffb700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f35f4038db0 0x7f35f403b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.289+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3604063870 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.289+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f35f804d130 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.289+0000 7f3603fff700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f35f4038db0 0x7f35f403b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.290+0000 7f3603fff700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f35f4038db0 0x7f35f403b270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35f0006fd0 tx=0x7f35f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.294+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f35f800f2e0 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.498+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f360419f940 con 0x7f3604108850 2024-03-31T23:08:31.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.500+0000 7f3601ffb700 1 -- 172.21.15.42:0/2744468951 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f35f8003d10 con 0x7f3604108850 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f35f4038db0 msgr2=0x7f35f403b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f35f4038db0 0x7f35f403b270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35f0006fd0 tx=0x7f35f0006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 msgr2=0x7f360419be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360419be40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f35f8003fb0 tx=0x7f35f8011bd0 comp rx=0 tx=0).stop 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 shutdown_connections 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f35f4038db0 0x7f35f403b270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 --2- 172.21.15.42:0/2744468951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3604108850 0x7f360419be40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 >> 172.21.15.42:0/2744468951 conn(0x7f36041022a0 msgr2=0x7f3604102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 shutdown_connections 2024-03-31T23:08:31.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:30.503+0000 7f360adf7700 1 -- 172.21.15.42:0/2744468951 wait complete. 2024-03-31T23:08:31.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:31 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2744468951' entity='client.admin' 2024-03-31T23:08:31.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:31 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:32.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.750+0000 7f45c816f700 1 Processor -- start 2024-03-31T23:08:32.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c816f700 1 -- start start 2024-03-31T23:08:32.503 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c816f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c007c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c816f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45c007c7e0 con 0x7f45c007dd30 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c5f0b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c007c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c5f0b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c007c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43926/0 (socket says 172.21.15.42:43926) 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c5f0b700 1 -- 172.21.15.42:0/1650367930 learned_addr learned my addr 172.21.15.42:0/1650367930 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.751+0000 7f45c5f0b700 1 -- 172.21.15.42:0/1650367930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c007c960 con 0x7f45c007dd30 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.752+0000 7f45c5f0b700 1 --2- 172.21.15.42:0/1650367930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c007c2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0098a0 tx=0x7f45bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6cb7c7d97ae3cf server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.752+0000 7f45c4f09700 1 -- 172.21.15.42:0/1650367930 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45bc004160 con 0x7f45c007dd30 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.752+0000 7f45c4f09700 1 -- 172.21.15.42:0/1650367930 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45bc004300 con 0x7f45c007dd30 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.752+0000 7f45c4f09700 1 -- 172.21.15.42:0/1650367930 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45bc011bb0 con 0x7f45c007dd30 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 -- 172.21.15.42:0/1650367930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 msgr2=0x7f45c007c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 --2- 172.21.15.42:0/1650367930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c007c2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0098a0 tx=0x7f45bc009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 -- 172.21.15.42:0/1650367930 shutdown_connections 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 --2- 172.21.15.42:0/1650367930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c007c2a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:32.504 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 -- 172.21.15.42:0/1650367930 >> 172.21.15.42:0/1650367930 conn(0x7f45c01034c0 msgr2=0x7f45c01058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 -- 172.21.15.42:0/1650367930 shutdown_connections 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 -- 172.21.15.42:0/1650367930 wait complete. 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 Processor -- start 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.753+0000 7f45c816f700 1 -- start start 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c816f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c816f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45c010e3d0 con 0x7f45c007dd30 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c5f0b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c5f0b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c019e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43942/0 (socket says 172.21.15.42:43942) 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c5f0b700 1 -- 172.21.15.42:0/4196973568 learned_addr learned my addr 172.21.15.42:0/4196973568 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c5f0b700 1 -- 172.21.15.42:0/4196973568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c019e580 con 0x7f45c007dd30 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c5f0b700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c019e040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45bc000c00 tx=0x7f45bc011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45bc011e60 con 0x7f45c007dd30 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45bc020070 con 0x7f45c007dd30 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c019e810 con 0x7f45c007dd30 2024-03-31T23:08:32.505 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.754+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c019ec70 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.755+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45bc019550 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.755+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a4005360 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.756+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f45bc019860 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.756+0000 7f45b6ffd700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f45ac038e50 0x7f45ac03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.756+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f45bc04cfa0 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.756+0000 7f45c570a700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f45ac038e50 0x7f45ac03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.756+0000 7f45c570a700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f45ac038e50 0x7f45ac03b310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f45b0006fd0 tx=0x7f45b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.765+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f45bc019b50 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.970+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f45a4005650 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.973+0000 7f45b6ffd700 1 -- 172.21.15.42:0/4196973568 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f45bc024e50 con 0x7f45c007dd30 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f45ac038e50 msgr2=0x7f45ac03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f45ac038e50 0x7f45ac03b310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f45b0006fd0 tx=0x7f45b0006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:32.506 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 msgr2=0x7f45c019e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c019e040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45bc000c00 tx=0x7f45bc011c30 comp rx=0 tx=0).stop 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 shutdown_connections 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f45ac038e50 0x7f45ac03b310 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 --2- 172.21.15.42:0/4196973568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45c007dd30 0x7f45c019e040 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 >> 172.21.15.42:0/4196973568 conn(0x7f45c01034c0 msgr2=0x7f45c0103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.975+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 shutdown_connections 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:31.976+0000 7f45c816f700 1 -- 172.21.15.42:0/4196973568 wait complete. 2024-03-31T23:08:32.507 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling the dashboard module... 2024-03-31T23:08:32.890 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:32 smithi042 ceph-mon[32380]: from='mgr.14120 172.21.15.42:0/2327319441' entity='mgr.x' 2024-03-31T23:08:32.890 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:32 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4196973568' entity='client.admin' 2024-03-31T23:08:33.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:33 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3389187263' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-31T23:08:33.826 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:33 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: ignoring --setuser ceph since I am not root 2024-03-31T23:08:33.826 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:33 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: ignoring --setgroup ceph since I am not root 2024-03-31T23:08:34.181 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.925+0000 7fca399e0700 1 Processor -- start 2024-03-31T23:08:34.181 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca399e0700 1 -- start start 2024-03-31T23:08:34.181 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca399e0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca341064d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:34.181 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca399e0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca34106aa0 con 0x7fca341060b0 2024-03-31T23:08:34.181 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca32ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca341064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca32ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca341064d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43950/0 (socket says 172.21.15.42:43950) 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca32ffd700 1 -- 172.21.15.42:0/902517148 learned_addr learned my addr 172.21.15.42:0/902517148 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca32ffd700 1 -- 172.21.15.42:0/902517148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca34109040 con 0x7fca341060b0 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.926+0000 7fca32ffd700 1 --2- 172.21.15.42:0/902517148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca341064d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fca240098a0 tx=0x7fca24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba1ae86590e039f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca31ffb700 1 -- 172.21.15.42:0/902517148 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca24004160 con 0x7fca341060b0 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca31ffb700 1 -- 172.21.15.42:0/902517148 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca24004300 con 0x7fca341060b0 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca31ffb700 1 -- 172.21.15.42:0/902517148 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca24011bb0 con 0x7fca341060b0 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 -- 172.21.15.42:0/902517148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 msgr2=0x7fca341064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 --2- 172.21.15.42:0/902517148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca341064d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fca240098a0 tx=0x7fca24009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 -- 172.21.15.42:0/902517148 shutdown_connections 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 --2- 172.21.15.42:0/902517148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca341064d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:34.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 -- 172.21.15.42:0/902517148 >> 172.21.15.42:0/902517148 conn(0x7fca34101a60 msgr2=0x7fca34103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 -- 172.21.15.42:0/902517148 shutdown_connections 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.927+0000 7fca399e0700 1 -- 172.21.15.42:0/902517148 wait complete. 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.928+0000 7fca399e0700 1 Processor -- start 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.928+0000 7fca399e0700 1 -- start start 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.928+0000 7fca399e0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca3419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.928+0000 7fca399e0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca3410c3f0 con 0x7fca341060b0 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca32ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca3419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca32ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca3419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43964/0 (socket says 172.21.15.42:43964) 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca32ffd700 1 -- 172.21.15.42:0/3389187263 learned_addr learned my addr 172.21.15.42:0/3389187263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca32ffd700 1 -- 172.21.15.42:0/3389187263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3419c320 con 0x7fca341060b0 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca32ffd700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca3419bde0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca24011690 tx=0x7fca24011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca24003b70 con 0x7fca341060b0 2024-03-31T23:08:34.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3419c5b0 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3419ca10 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca2401a930 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.929+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca24019920 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.930+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7fca24022020 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.931+0000 7fca389de700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fca1c038db0 0x7fca1c03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.931+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca20005360 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.931+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fca2404cf50 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.931+0000 7fca327fc700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fca1c038db0 0x7fca1c03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.931+0000 7fca327fc700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fca1c038db0 0x7fca1c03b270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca28006fd0 tx=0x7fca28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:32.936+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fca24010e90 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.214+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fca20005650 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.627+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fca2400fd80 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca389de700 1 -- 172.21.15.42:0/3389187263 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 9) ==== 46129+0+0 (secure 0 0 0) 0x7fca2402c8c0 con 0x7fca341060b0 2024-03-31T23:08:34.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fca1c038db0 msgr2=0x7fca1c03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fca1c038db0 0x7fca1c03b270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca28006fd0 tx=0x7fca28006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 msgr2=0x7fca3419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca3419bde0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca24011690 tx=0x7fca24011ca0 comp rx=0 tx=0).stop 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 shutdown_connections 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7fca1c038db0 0x7fca1c03b270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 --2- 172.21.15.42:0/3389187263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca341060b0 0x7fca3419bde0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 >> 172.21.15.42:0/3389187263 conn(0x7fca34101a60 msgr2=0x7fca34102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 shutdown_connections 2024-03-31T23:08:34.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:33.630+0000 7fca399e0700 1 -- 172.21.15.42:0/3389187263 wait complete. 2024-03-31T23:08:34.510 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:34 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:34.232+0000 7fe6fa060200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:08:34.510 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:34 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:34.330+0000 7fe6fa060200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:08:34.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:34 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3389187263' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-31T23:08:34.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:34 smithi042 ceph-mon[32380]: mgrmap e9: x(active, since 18s) 2024-03-31T23:08:35.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.002+0000 7fe6fa060200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:08:35.427 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.098+0000 7fe6fa060200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:08:35.428 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.243+0000 7fe6fa060200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:08:35.428 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.341+0000 7fe6fa060200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:08:35.428 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.427+0000 7fe6fa060200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c03eaa700 1 Processor -- start 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c03eaa700 1 -- start start 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c03eaa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1064d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c03eaa700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc106aa0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c01c46700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c01c46700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1064d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49440/0 (socket says 172.21.15.42:49440) 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.609+0000 7f7c01c46700 1 -- 172.21.15.42:0/3200271518 learned_addr learned my addr 172.21.15.42:0/3200271518 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.610+0000 7f7c01c46700 1 -- 172.21.15.42:0/3200271518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc109040 con 0x7f7bfc1060b0 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.610+0000 7f7c01c46700 1 --2- 172.21.15.42:0/3200271518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1064d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80098a0 tx=0x7f7bf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644eee7962dcd80 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.610+0000 7f7c00c44700 1 -- 172.21.15.42:0/3200271518 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bf8004160 con 0x7f7bfc1060b0 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.610+0000 7f7c00c44700 1 -- 172.21.15.42:0/3200271518 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bf8004300 con 0x7f7bfc1060b0 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.610+0000 7f7c00c44700 1 -- 172.21.15.42:0/3200271518 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bf8011bb0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 -- 172.21.15.42:0/3200271518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 msgr2=0x7f7bfc1064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 --2- 172.21.15.42:0/3200271518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1064d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80098a0 tx=0x7f7bf8009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 -- 172.21.15.42:0/3200271518 shutdown_connections 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 --2- 172.21.15.42:0/3200271518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1064d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 -- 172.21.15.42:0/3200271518 >> 172.21.15.42:0/3200271518 conn(0x7f7bfc101a60 msgr2=0x7f7bfc103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 -- 172.21.15.42:0/3200271518 shutdown_connections 2024-03-31T23:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.611+0000 7f7c03eaa700 1 -- 172.21.15.42:0/3200271518 wait complete. 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c03eaa700 1 Processor -- start 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c03eaa700 1 -- start start 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c03eaa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1088c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c03eaa700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc10c3f0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c01c46700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c01c46700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1088c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49452/0 (socket says 172.21.15.42:49452) 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c01c46700 1 -- 172.21.15.42:0/4061972982 learned_addr learned my addr 172.21.15.42:0/4061972982 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c01c46700 1 -- 172.21.15.42:0/4061972982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc108e00 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c01c46700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1088c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8011690 tx=0x7f7bf8011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bf8003b70 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bf801a930 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc106ff0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bf8019920 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.612+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc1074b0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.613+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 46129+0+0 (secure 0 0 0) 0x7f7bf8022020 con 0x7f7bfc1060b0 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.613+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc063870 con 0x7f7bfc1060b0 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.613+0000 7f7bf2ffd700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 0x7f7be803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.614+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7bf804cfd0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.614+0000 7f7c01445700 1 -- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 msgr2=0x7f7be803b320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.614+0000 7f7c01445700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 0x7f7be803b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.619+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7bf80172b0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.815+0000 7f7c01445700 1 -- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 msgr2=0x7f7be803b320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.815+0000 7f7c01445700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 0x7f7be803b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.880+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7bfc1077f0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.880+0000 7f7bf2ffd700 1 -- 172.21.15.42:0/4061972982 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7bfc1077f0 con 0x7f7bfc1060b0 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 msgr2=0x7f7be803b320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 0x7f7be803b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 msgr2=0x7f7bfc1088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1088c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8011690 tx=0x7f7bf8011ca0 comp rx=0 tx=0).stop 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 shutdown_connections 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7f7be8038e60 0x7f7be803b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 --2- 172.21.15.42:0/4061972982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bfc1060b0 0x7f7bfc1088c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 >> 172.21.15.42:0/4061972982 conn(0x7f7bfc101a60 msgr2=0x7f7bfc102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 shutdown_connections 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:34.882+0000 7f7c03eaa700 1 -- 172.21.15.42:0/4061972982 wait complete. 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-03-31T23:08:35.451 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 9... 2024-03-31T23:08:35.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4061972982' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-31T23:08:36.009 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.706+0000 7fe6fa060200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:08:36.009 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.824+0000 7fe6fa060200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:08:36.010 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:35.912+0000 7fe6fa060200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:08:36.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:36 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:36.008+0000 7fe6fa060200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:08:36.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:36 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:36.187+0000 7fe6fa060200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:08:37.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:37 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:37.175+0000 7fe6fa060200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:08:37.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:37 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:37.309+0000 7fe6fa060200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:08:37.949 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:37 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:37.654+0000 7fe6fa060200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:08:37.949 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:37 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:37.747+0000 7fe6fa060200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:08:37.949 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:37 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:37.948+0000 7fe6fa060200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:08:38.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:38 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:38.139+0000 7fe6fa060200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:08:38.696 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:38 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:38.433+0000 7fe6fa060200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:08:38.696 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:38 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:38.695+0000 7fe6fa060200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:08:39.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:38 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:38.941+0000 7fe6fa060200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:08:40.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:39 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:39.771+0000 7fe6fa060200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:08:40.679 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:40.353+0000 7fe6fa060200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:08:40.679 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:40.455+0000 7fe6fa060200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:08:40.680 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:08:40.678+0000 7fe6fa060200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:08:41.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: Active manager daemon x restarted 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: Activating manager daemon x 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: osdmap e3: 0 total, 0 up, 0 in 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: mgrmap e10: x(active, starting, since 0.00320716s) 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: Manager daemon x is now available 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-31T23:08:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff8205b4700 1 Processor -- start 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff8205b4700 1 -- start start 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff8205b4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff818107100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff8205b4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181076d0 con 0x7ff818106ce0 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff81e350700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff818107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff81e350700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff818107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49460/0 (socket says 172.21.15.42:49460) 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.809+0000 7ff81e350700 1 -- 172.21.15.42:0/3142605292 learned_addr learned my addr 172.21.15.42:0/3142605292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:42.215 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.810+0000 7ff81e350700 1 -- 172.21.15.42:0/3142605292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff818107ee0 con 0x7ff818106ce0 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.810+0000 7ff81e350700 1 --2- 172.21.15.42:0/3142605292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff818107100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8140098a0 tx=0x7ff814009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e213212f2736d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.810+0000 7ff81d34e700 1 -- 172.21.15.42:0/3142605292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff814004160 con 0x7ff818106ce0 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.810+0000 7ff81d34e700 1 -- 172.21.15.42:0/3142605292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff814004300 con 0x7ff818106ce0 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.810+0000 7ff81d34e700 1 -- 172.21.15.42:0/3142605292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff814011bb0 con 0x7ff818106ce0 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 -- 172.21.15.42:0/3142605292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 msgr2=0x7ff818107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 --2- 172.21.15.42:0/3142605292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff818107100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8140098a0 tx=0x7ff814009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 -- 172.21.15.42:0/3142605292 shutdown_connections 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 --2- 172.21.15.42:0/3142605292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff818107100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 -- 172.21.15.42:0/3142605292 >> 172.21.15.42:0/3142605292 conn(0x7ff8181022a0 msgr2=0x7ff8181046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 -- 172.21.15.42:0/3142605292 shutdown_connections 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 -- 172.21.15.42:0/3142605292 wait complete. 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.811+0000 7ff8205b4700 1 Processor -- start 2024-03-31T23:08:42.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff8205b4700 1 -- start start 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff8205b4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff81819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff8205b4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff81810b290 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff81e350700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff81819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff81e350700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff81819ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49468/0 (socket says 172.21.15.42:49468) 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff81e350700 1 -- 172.21.15.42:0/1941838949 learned_addr learned my addr 172.21.15.42:0/1941838949 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff81e350700 1 -- 172.21.15.42:0/1941838949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81819b280 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff81e350700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff81819ad40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff814000c00 tx=0x7ff814003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.812+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff814011e60 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.813+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff814003bd0 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.813+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81819b510 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.813+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81401c7f0 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.813+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81819b970 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.814+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 46129+0+0 (secure 0 0 0) 0x7ff81401ca30 con 0x7ff818106ce0 2024-03-31T23:08:42.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.814+0000 7ff80f7fe700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.814+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 --> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff80403ba20 con 0x7ff804038e50 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.814+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff81404f9a0 con 0x7ff818106ce0 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.814+0000 7ff81db4f700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 msgr2=0x7ff80403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:35.814+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:36.015+0000 7ff81db4f700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 msgr2=0x7ff80403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:36.015+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:36.416+0000 7ff81db4f700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 msgr2=0x7ff80403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:36.416+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:37.217+0000 7ff81db4f700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 msgr2=0x7ff80403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:37.217+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:38.818+0000 7ff81db4f700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 msgr2=0x7ff80403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517474041 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:38.818+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-31T23:08:42.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:40.682+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 10) ==== 45896+0+0 (secure 0 0 0) 0x7ff81402e960 con 0x7ff818106ce0 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:40.682+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 msgr2=0x7ff80403b310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:40.682+0000 7ff80f7fe700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.683+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 11) ==== 46023+0+0 (secure 0 0 0) 0x7ff814050d80 con 0x7ff818106ce0 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.683+0000 7ff80f7fe700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff80403c910 0x7ff80403ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.684+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff814001d30 con 0x7ff80403c910 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.684+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff80403c910 0x7ff80403ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.685+0000 7ff81db4f700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff80403c910 0x7ff80403ed00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff808003a10 tx=0x7ff8080092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.685+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff814001d30 con 0x7ff80403c910 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff81810b410 con 0x7ff80403c910 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff80f7fe700 1 -- 172.21.15.42:0/1941838949 <== mgr.14152 v2:172.21.15.42:6800/2637331812 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff81810b410 con 0x7ff80403c910 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff80403c910 msgr2=0x7ff80403ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff80403c910 0x7ff80403ed00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff808003a10 tx=0x7ff8080092b0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 msgr2=0x7ff81819ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:42.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff81819ad40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff814000c00 tx=0x7ff814003980 comp rx=0 tx=0).stop 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 shutdown_connections 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff80403c910 0x7ff80403ed00 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff818106ce0 0x7ff81819ad40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.692+0000 7ff8205b4700 1 --2- 172.21.15.42:0/1941838949 >> [v2:172.21.15.42:6800/1517474041,v1:172.21.15.42:6801/1517474041] conn(0x7ff804038e50 0x7ff80403b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.693+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 >> 172.21.15.42:0/1941838949 conn(0x7ff8181022a0 msgr2=0x7ff818102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.693+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 shutdown_connections 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:41.693+0000 7ff8205b4700 1 -- 172.21.15.42:0/1941838949 wait complete. 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 9 is available 2024-03-31T23:08:42.220 INFO:teuthology.orchestra.run.smithi042.stdout:Generating a dashboard self-signed certificate... 2024-03-31T23:08:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:42 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:41] ENGINE Bus STARTING 2024-03-31T23:08:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:42 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:41] ENGINE Serving on https://172.21.15.42:7150 2024-03-31T23:08:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:42 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:41] ENGINE Serving on http://172.21.15.42:8765 2024-03-31T23:08:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:42 smithi042 ceph-mon[32380]: [31/Mar/2024:23:08:41] ENGINE Bus STARTED 2024-03-31T23:08:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:42 smithi042 ceph-mon[32380]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-31T23:08:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:42 smithi042 ceph-mon[32380]: mgrmap e11: x(active, since 1.00563s) 2024-03-31T23:08:43.454 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-31T23:08:43.454 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.648+0000 7f4e0fc9d700 1 Processor -- start 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.648+0000 7f4e0fc9d700 1 -- start start 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.648+0000 7f4e0fc9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e08106550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.648+0000 7f4e0fc9d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08106b20 con 0x7f4e08106130 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.649+0000 7f4e0da39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e08106550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.649+0000 7f4e0da39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e08106550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49534/0 (socket says 172.21.15.42:49534) 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.649+0000 7f4e0da39700 1 -- 172.21.15.42:0/3347674299 learned_addr learned my addr 172.21.15.42:0/3347674299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.649+0000 7f4e0da39700 1 -- 172.21.15.42:0/3347674299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e081090c0 con 0x7f4e08106130 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.650+0000 7f4e0da39700 1 --2- 172.21.15.42:0/3347674299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e08106550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e80 tx=0x7f4e0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9017d811dab0b6e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.650+0000 7f4e0ca37700 1 -- 172.21.15.42:0/3347674299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00017070 con 0x7f4e08106130 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.650+0000 7f4e0ca37700 1 -- 172.21.15.42:0/3347674299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e0000b8c0 con 0x7f4e08106130 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.650+0000 7f4e0ca37700 1 -- 172.21.15.42:0/3347674299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00004580 con 0x7f4e08106130 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/3347674299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 msgr2=0x7f4e08106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 --2- 172.21.15.42:0/3347674299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e08106550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e80 tx=0x7f4e0000b330 comp rx=0 tx=0).stop 2024-03-31T23:08:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/3347674299 shutdown_connections 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 --2- 172.21.15.42:0/3347674299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e08106550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/3347674299 >> 172.21.15.42:0/3347674299 conn(0x7f4e08101ae0 msgr2=0x7f4e08103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/3347674299 shutdown_connections 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/3347674299 wait complete. 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 Processor -- start 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.651+0000 7f4e0fc9d700 1 -- start start 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0fc9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e0819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0fc9d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0810c470 con 0x7f4e08106130 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0da39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e0819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0da39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e0819bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49538/0 (socket says 172.21.15.42:49538) 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0da39700 1 -- 172.21.15.42:0/22956062 learned_addr learned my addr 172.21.15.42:0/22956062 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0da39700 1 -- 172.21.15.42:0/22956062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0819c3e0 con 0x7f4e08106130 2024-03-31T23:08:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0da39700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e0819bea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e50 tx=0x7f4e000049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00021020 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0819c670 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e0001d470 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00017040 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.652+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0819f360 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.653+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 11) ==== 46023+0+0 (secure 0 0 0) 0x7f4e00024020 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.653+0000 7f4e06ffd700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f4df0038d40 0x7f4df003b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.653+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e08063870 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.653+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4e0000f050 con 0x7f4e08106130 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.653+0000 7f4e0d238700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f4df0038d40 0x7f4df003b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.654+0000 7f4e0d238700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f4df0038d40 0x7f4df003b200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc006fd0 tx=0x7f4dfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.659+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4e0002b020 con 0x7f4e08106130 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.687+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 12) ==== 46129+0+0 (secure 0 0 0) 0x7f4e0001bc90 con 0x7f4e08106130 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.873+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4e08102d00 con 0x7f4df0038d40 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.908+0000 7f4e06ffd700 1 -- 172.21.15.42:0/22956062 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4e08102d00 con 0x7f4df0038d40 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f4df0038d40 msgr2=0x7f4df003b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f4df0038d40 0x7f4df003b200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc006fd0 tx=0x7f4dfc006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 msgr2=0x7f4e0819bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e0819bea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e50 tx=0x7f4e000049d0 comp rx=0 tx=0).stop 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 shutdown_connections 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f4df0038d40 0x7f4df003b200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 --2- 172.21.15.42:0/22956062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e08106130 0x7f4e0819bea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 >> 172.21.15.42:0/22956062 conn(0x7f4e08101ae0 msgr2=0x7f4e081025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:43.459 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 shutdown_connections 2024-03-31T23:08:43.459 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:42.911+0000 7f4e0fc9d700 1 -- 172.21.15.42:0/22956062 wait complete. 2024-03-31T23:08:43.459 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial admin user... 2024-03-31T23:08:43.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:43 smithi042 ceph-mon[32380]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-31T23:08:43.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:43 smithi042 ceph-mon[32380]: mgrmap e12: x(active, since 2s) 2024-03-31T23:08:43.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:43 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:43.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:43 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:43.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:43 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:44.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ridKjHv2n0B0M02QQwprZesUqbbKMm2SZr/yTcEcCvHCtIXpVONQS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711926524, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.841+0000 7feda3e96700 1 Processor -- start 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.841+0000 7feda3e96700 1 -- start start 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda3e96700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c07c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda3e96700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c07c870 con 0x7fed9c07ddf0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda1c32700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c07c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda1c32700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c07c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54624/0 (socket says 172.21.15.42:54624) 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda1c32700 1 -- 172.21.15.42:0/2763248371 learned_addr learned my addr 172.21.15.42:0/2763248371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda1c32700 1 -- 172.21.15.42:0/2763248371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c07c9f0 con 0x7fed9c07ddf0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda1c32700 1 --2- 172.21.15.42:0/2763248371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c07c2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed980098a0 tx=0x7fed98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d4730c9e4a641e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda0c30700 1 -- 172.21.15.42:0/2763248371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed98004160 con 0x7fed9c07ddf0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda0c30700 1 -- 172.21.15.42:0/2763248371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed98004300 con 0x7fed9c07ddf0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.842+0000 7feda0c30700 1 -- 172.21.15.42:0/2763248371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed98011bb0 con 0x7fed9c07ddf0 2024-03-31T23:08:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 -- 172.21.15.42:0/2763248371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 msgr2=0x7fed9c07c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 --2- 172.21.15.42:0/2763248371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c07c2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed980098a0 tx=0x7fed98009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 -- 172.21.15.42:0/2763248371 shutdown_connections 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 --2- 172.21.15.42:0/2763248371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c07c2a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 -- 172.21.15.42:0/2763248371 >> 172.21.15.42:0/2763248371 conn(0x7fed9c103460 msgr2=0x7fed9c105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 -- 172.21.15.42:0/2763248371 shutdown_connections 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.843+0000 7feda3e96700 1 -- 172.21.15.42:0/2763248371 wait complete. 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda3e96700 1 Processor -- start 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda3e96700 1 -- start start 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda3e96700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda3e96700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c10e4c0 con 0x7fed9c07ddf0 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda1c32700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda1c32700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54638/0 (socket says 172.21.15.42:54638) 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.844+0000 7feda1c32700 1 -- 172.21.15.42:0/3540240219 learned_addr learned my addr 172.21.15.42:0/3540240219 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:44.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7feda1c32700 1 -- 172.21.15.42:0/3540240219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c19e510 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7feda1c32700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c19dfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed98000c00 tx=0x7fed98011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed98011e60 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed98003b20 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed980247a0 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c19e7a0 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.845+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c19ec00 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.846+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c063870 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.846+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46129+0+0 (secure 0 0 0) 0x7fed98022020 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.846+0000 7fed8effd700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed88038eb0 0x7fed8803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.846+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fed9804cdd0 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.847+0000 7feda1431700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed88038eb0 0x7fed8803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.847+0000 7feda1431700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed88038eb0 0x7fed8803b370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed90006fd0 tx=0x7fed90006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:43.852+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fed98050030 con 0x7fed9c07ddf0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.074+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fed9c1a1630 con 0x7fed88038eb0 2024-03-31T23:08:44.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.323+0000 7fed8effd700 1 -- 172.21.15.42:0/3540240219 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fed9c1a1630 con 0x7fed88038eb0 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed88038eb0 msgr2=0x7fed8803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed88038eb0 0x7fed8803b370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed90006fd0 tx=0x7fed90006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 msgr2=0x7fed9c19dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c19dfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed98000c00 tx=0x7fed98011ca0 comp rx=0 tx=0).stop 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 shutdown_connections 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed88038eb0 0x7fed8803b370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 --2- 172.21.15.42:0/3540240219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed9c07ddf0 0x7fed9c19dfd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 >> 172.21.15.42:0/3540240219 conn(0x7fed9c103460 msgr2=0x7fed9c103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 shutdown_connections 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:44.325+0000 7feda3e96700 1 -- 172.21.15.42:0/3540240219 wait complete. 2024-03-31T23:08:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:Fetching dashboard port number... 2024-03-31T23:08:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:44 smithi042 ceph-mon[32380]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:45.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:45 smithi042 ceph-mon[32380]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:45.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:45 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3664928155' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-31T23:08:46.176 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 8443 2024-03-31T23:08:46.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f593b7e8700 1 Processor -- start 2024-03-31T23:08:46.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f593b7e8700 1 -- start start 2024-03-31T23:08:46.182 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f593b7e8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f593b7e8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f593407c890 con 0x7f593407de10 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f5939584700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f5939584700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54644/0 (socket says 172.21.15.42:54644) 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f5939584700 1 -- 172.21.15.42:0/443855478 learned_addr learned my addr 172.21.15.42:0/443855478 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.260+0000 7f5939584700 1 -- 172.21.15.42:0/443855478 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593407ca10 con 0x7f593407de10 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f5939584700 1 --2- 172.21.15.42:0/443855478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593407c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f59300098a0 tx=0x7f5930009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18614cac565cca06 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f592bfff700 1 -- 172.21.15.42:0/443855478 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5930004160 con 0x7f593407de10 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f592bfff700 1 -- 172.21.15.42:0/443855478 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5930004300 con 0x7f593407de10 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f592bfff700 1 -- 172.21.15.42:0/443855478 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5930011bb0 con 0x7f593407de10 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f593b7e8700 1 -- 172.21.15.42:0/443855478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 msgr2=0x7f593407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f593b7e8700 1 --2- 172.21.15.42:0/443855478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593407c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f59300098a0 tx=0x7f5930009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:46.183 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f593b7e8700 1 -- 172.21.15.42:0/443855478 shutdown_connections 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f593b7e8700 1 --2- 172.21.15.42:0/443855478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593407c2c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f593b7e8700 1 -- 172.21.15.42:0/443855478 >> 172.21.15.42:0/443855478 conn(0x7f5934103420 msgr2=0x7f5934105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.261+0000 7f593b7e8700 1 -- 172.21.15.42:0/443855478 shutdown_connections 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f593b7e8700 1 -- 172.21.15.42:0/443855478 wait complete. 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f593b7e8700 1 Processor -- start 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f593b7e8700 1 -- start start 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f593b7e8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f593b7e8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f593410e4a0 con 0x7f593407de10 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f5939584700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f5939584700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54656/0 (socket says 172.21.15.42:54656) 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.262+0000 7f5939584700 1 -- 172.21.15.42:0/3664928155 learned_addr learned my addr 172.21.15.42:0/3664928155 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:46.184 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f5939584700 1 -- 172.21.15.42:0/3664928155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593419e530 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f5939584700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593419dff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5930011690 tx=0x7f5930011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5930003930 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5930003ad0 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5930019730 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593419e7c0 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.263+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593419ec20 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.264+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46129+0+0 (secure 0 0 0) 0x7f593001ab50 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.264+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934063870 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.264+0000 7f592a7fc700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5920038eb0 0x7f592003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.264+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f593004d350 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.264+0000 7f5938d83700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5920038eb0 0x7f592003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.265+0000 7f5938d83700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5920038eb0 0x7f592003b370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5924006fd0 tx=0x7f5924006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.269+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5930029d50 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.483+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f59341a14b0 con 0x7f593407de10 2024-03-31T23:08:46.185 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.483+0000 7f592a7fc700 1 -- 172.21.15.42:0/3664928155 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f593001a430 con 0x7f593407de10 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5920038eb0 msgr2=0x7f592003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5920038eb0 0x7f592003b370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5924006fd0 tx=0x7f5924006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 msgr2=0x7f593419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593419dff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5930011690 tx=0x7f5930011ca0 comp rx=0 tx=0).stop 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 shutdown_connections 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5920038eb0 0x7f592003b370 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 --2- 172.21.15.42:0/3664928155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f593407de10 0x7f593419dff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 >> 172.21.15.42:0/3664928155 conn(0x7f5934103420 msgr2=0x7f5934103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 shutdown_connections 2024-03-31T23:08:46.186 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:45.485+0000 7f593b7e8700 1 -- 172.21.15.42:0/3664928155 wait complete. 2024-03-31T23:08:46.188 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-31T23:08:46.188 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-03-31T23:08:46.194 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-31T23:08:46.195 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-03-31T23:08:46.195 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-03-31T23:08:46.195 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-31T23:08:46.197 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph Dashboard is now available at: 2024-03-31T23:08:46.197 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:46.198 INFO:teuthology.orchestra.run.smithi042.stdout: URL: https://smithi042.front.sepia.ceph.com:8443/ 2024-03-31T23:08:46.198 INFO:teuthology.orchestra.run.smithi042.stdout: User: admin 2024-03-31T23:08:46.198 INFO:teuthology.orchestra.run.smithi042.stdout: Password: nufmoerz5v 2024-03-31T23:08:46.198 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:46.198 INFO:teuthology.orchestra.run.smithi042.stdout:Saving cluster configuration to /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config directory 2024-03-31T23:08:46.201 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling autotune for osd_memory_target 2024-03-31T23:08:47.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:47 smithi042 ceph-mon[32380]: mgrmap e13: x(active, since 6s) 2024-03-31T23:08:47.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f5718b0a700 1 Processor -- start 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f5718b0a700 1 -- start start 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f5718b0a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714108740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f5718b0a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5714108d10 con 0x7f5714108320 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f571259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714108740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f571259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714108740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54672/0 (socket says 172.21.15.42:54672) 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.587+0000 7f571259c700 1 -- 172.21.15.42:0/42916673 learned_addr learned my addr 172.21.15.42:0/42916673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.588+0000 7f571259c700 1 -- 172.21.15.42:0/42916673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5714106fd0 con 0x7f5714108320 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.588+0000 7f571259c700 1 --2- 172.21.15.42:0/42916673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714108740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57040098a0 tx=0x7f5704009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9080d66bb2f95d57 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.588+0000 7f571159a700 1 -- 172.21.15.42:0/42916673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5704004160 con 0x7f5714108320 2024-03-31T23:08:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.588+0000 7f571159a700 1 -- 172.21.15.42:0/42916673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5704004300 con 0x7f5714108320 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.588+0000 7f571159a700 1 -- 172.21.15.42:0/42916673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5704011bb0 con 0x7f5714108320 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 -- 172.21.15.42:0/42916673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 msgr2=0x7f5714108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 --2- 172.21.15.42:0/42916673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714108740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57040098a0 tx=0x7f5704009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 -- 172.21.15.42:0/42916673 shutdown_connections 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 --2- 172.21.15.42:0/42916673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714108740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 -- 172.21.15.42:0/42916673 >> 172.21.15.42:0/42916673 conn(0x7f5714101aa0 msgr2=0x7f5714103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 -- 172.21.15.42:0/42916673 shutdown_connections 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 -- 172.21.15.42:0/42916673 wait complete. 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 Processor -- start 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.589+0000 7f5718b0a700 1 -- start start 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f5718b0a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714191fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f5718b0a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f571410b390 con 0x7f5714108320 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f571259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714191fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:47.835 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f571259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714191fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54688/0 (socket says 172.21.15.42:54688) 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f571259c700 1 -- 172.21.15.42:0/1566065313 learned_addr learned my addr 172.21.15.42:0/1566065313 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f571259c700 1 -- 172.21.15.42:0/1566065313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57141924f0 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f571259c700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714191fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5704009520 tx=0x7f5704011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5704011e60 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57141906e0 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f570401a430 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5704019550 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.590+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5714190ba0 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.591+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46129+0+0 (secure 0 0 0) 0x7f57040197f0 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.591+0000 7f57037fe700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f56fc038e50 0x7f56fc03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.591+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f570404d180 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.591+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5714063870 con 0x7f5714108320 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.591+0000 7f5711d9b700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f56fc038e50 0x7f56fc03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.592+0000 7f5711d9b700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f56fc038e50 0x7f56fc03b310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5708006fd0 tx=0x7f5708006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:47.836 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.597+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5704020240 con 0x7f5714108320 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.689+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f570402d960 con 0x7f5714108320 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.803+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f5714195c90 con 0x7f5714108320 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.804+0000 7f57037fe700 1 -- 172.21.15.42:0/1566065313 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f5704010380 con 0x7f5714108320 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f56fc038e50 msgr2=0x7f56fc03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f56fc038e50 0x7f56fc03b310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5708006fd0 tx=0x7f5708006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 msgr2=0x7f5714191fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714191fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5704009520 tx=0x7f5704011c30 comp rx=0 tx=0).stop 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 shutdown_connections 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f56fc038e50 0x7f56fc03b310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 --2- 172.21.15.42:0/1566065313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5714108320 0x7f5714191fb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 >> 172.21.15.42:0/1566065313 conn(0x7f5714101aa0 msgr2=0x7f5714102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 shutdown_connections 2024-03-31T23:08:47.837 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:46.806+0000 7f5718b0a700 1 -- 172.21.15.42:0/1566065313 wait complete. 2024-03-31T23:08:49.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f3054519700 1 Processor -- start 2024-03-31T23:08:49.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f3054519700 1 -- start start 2024-03-31T23:08:49.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f3054519700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c107150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:49.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f3054519700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f304c107720 con 0x7f304c106d30 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f30522b5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c107150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f30522b5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c107150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54704/0 (socket says 172.21.15.42:54704) 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.263+0000 7f30522b5700 1 -- 172.21.15.42:0/3621774241 learned_addr learned my addr 172.21.15.42:0/3621774241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.264+0000 7f30522b5700 1 -- 172.21.15.42:0/3621774241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c107f30 con 0x7f304c106d30 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.264+0000 7f30522b5700 1 --2- 172.21.15.42:0/3621774241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c107150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30480098a0 tx=0x7f3048009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeba61a661dc34a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.264+0000 7f30512b3700 1 -- 172.21.15.42:0/3621774241 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3048004160 con 0x7f304c106d30 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.264+0000 7f30512b3700 1 -- 172.21.15.42:0/3621774241 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3048004300 con 0x7f304c106d30 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.264+0000 7f30512b3700 1 -- 172.21.15.42:0/3621774241 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3048011bb0 con 0x7f304c106d30 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 -- 172.21.15.42:0/3621774241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 msgr2=0x7f304c107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 --2- 172.21.15.42:0/3621774241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c107150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30480098a0 tx=0x7f3048009bb0 comp rx=0 tx=0).stop 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 -- 172.21.15.42:0/3621774241 shutdown_connections 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 --2- 172.21.15.42:0/3621774241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c107150 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 -- 172.21.15.42:0/3621774241 >> 172.21.15.42:0/3621774241 conn(0x7f304c1022b0 msgr2=0x7f304c104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:49.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 -- 172.21.15.42:0/3621774241 shutdown_connections 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 -- 172.21.15.42:0/3621774241 wait complete. 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 Processor -- start 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.265+0000 7f3054519700 1 -- start start 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f3054519700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f3054519700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f304c07b0f0 con 0x7f304c106d30 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30522b5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30522b5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54708/0 (socket says 172.21.15.42:54708) 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30522b5700 1 -- 172.21.15.42:0/46516546 learned_addr learned my addr 172.21.15.42:0/46516546 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30522b5700 1 -- 172.21.15.42:0/46516546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c19a120 con 0x7f304c106d30 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30522b5700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c199be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3048011690 tx=0x7f3048011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3048003b70 con 0x7f304c106d30 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f304801a930 con 0x7f304c106d30 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304c19a3b0 con 0x7f304c106d30 2024-03-31T23:08:49.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3048019920 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.266+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f304c19a810 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.267+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f3048022020 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.267+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f304c063870 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.268+0000 7f30437fe700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f303803b0d0 0x7f303803d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.268+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f304804d2c0 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.268+0000 7f3051ab4700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f303803b0d0 0x7f303803d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.268+0000 7f3051ab4700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f303803b0d0 0x7f303803d590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f303c006fd0 tx=0x7f303c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.273+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3048019c90 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.591+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f304c062e50 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.593+0000 7f30437fe700 1 -- 172.21.15.42:0/46516546 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f304802c8c0 con 0x7f304c106d30 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f303803b0d0 msgr2=0x7f303803d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f303803b0d0 0x7f303803d590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f303c006fd0 tx=0x7f303c006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 msgr2=0x7f304c199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c199be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3048011690 tx=0x7f3048011ca0 comp rx=0 tx=0).stop 2024-03-31T23:08:49.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 shutdown_connections 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f303803b0d0 0x7f303803d590 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 --2- 172.21.15.42:0/46516546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304c106d30 0x7f304c199be0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 >> 172.21.15.42:0/46516546 conn(0x7f304c1022b0 msgr2=0x7f304c190700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 shutdown_connections 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-03-31T23:08:48.595+0000 7f3054519700 1 -- 172.21.15.42:0/46516546 wait complete. 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:Or, if you are only running a single cluster on this host: 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout: ceph telemetry on 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:For more information see: 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:08:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:Bootstrap complete. 2024-03-31T23:08:49.179 INFO:tasks.cephadm:Fetching config... 2024-03-31T23:08:49.179 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:08:49.179 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-31T23:08:49.195 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-31T23:08:49.195 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:08:49.195 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-31T23:08:49.250 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-31T23:08:49.250 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:08:49.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-03-31T23:08:49.318 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-31T23:08:49.318 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:08:49.318 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-31T23:08:49.373 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-31T23:08:49.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-31T23:08:49.451 INFO:teuthology.orchestra.run.smithi042.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:08:49.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-31T23:08:49.522 INFO:teuthology.orchestra.run.smithi094.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:08:49.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-31T23:08:49.583 INFO:teuthology.orchestra.run.smithi188.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDahgEucBdI8HvY9B9Gu41FUM2fLIXbWrQzoTs24+8M+vTyZhHYDN0kC050I0bRN9cX4ZiKli8ciB0lhxCmUza1mTZfs0tnIj851rz/n80aXOjBLhX/ScYp5Vs1jb++gKdeGVs0aMtpif0dEk4VpDqkH7837lZhdzatov84LgUd5gNsiVQ2odthxOqf4X/ONFiZoMlFx6x79UOcw2H8Irrua7CA5UpfZu/NpNTwt3UEjYRLFD0L3HDG5fcJetXnC7BR24Bdgc4FcyzFInQyNoDk0q+tuKPtp+VcAPLhZmBwZx4+5Or9Xl2xCHEH7gNzi4dSVyV57h39n2a3zlP7Oq98k/cqJx9FPdBe4+2BmWDjnRjbDMxK2PbZutxlQ3m4zhR2xHiePmBE8WkmA1DbGKsYbiyb83YHmMO7gqfcFmLWYu19cuyE4KY2rP3ffuLtIMmL4TbN4HGpK3+ggwWIx9AI4ZJO9JXcS6gr5n90CCoSnHPezytSm+gp6LPcQCJcgo0= ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:08:49.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-31T23:08:49.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:49 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/46516546' entity='client.admin' 2024-03-31T23:08:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:08:51.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.963+0000 7f753f26b700 1 -- 172.21.15.42:0/415842101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 msgr2=0x7f7538100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:51.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.963+0000 7f753f26b700 1 --2- 172.21.15.42:0/415842101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f7538100f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7534009910 tx=0x7f7534009c20 comp rx=0 tx=0).stop 2024-03-31T23:08:51.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.963+0000 7f753f26b700 1 -- 172.21.15.42:0/415842101 shutdown_connections 2024-03-31T23:08:51.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.963+0000 7f753f26b700 1 --2- 172.21.15.42:0/415842101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f7538100f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:51.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.963+0000 7f753f26b700 1 -- 172.21.15.42:0/415842101 >> 172.21.15.42:0/415842101 conn(0x7f75380fc110 msgr2=0x7f75380fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:51.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753f26b700 1 -- 172.21.15.42:0/415842101 shutdown_connections 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753f26b700 1 -- 172.21.15.42:0/415842101 wait complete. 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753f26b700 1 Processor -- start 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753f26b700 1 -- start start 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753f26b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f753806a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753f26b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7538106d40 con 0x7f7538100b70 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753d007700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f753806a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753d007700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f753806a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54716/0 (socket says 172.21.15.42:54716) 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.964+0000 7f753d007700 1 -- 172.21.15.42:0/1997885511 learned_addr learned my addr 172.21.15.42:0/1997885511 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f753d007700 1 -- 172.21.15.42:0/1997885511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753819a080 con 0x7f7538100b70 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f753d007700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f753806a9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7534005840 tx=0x7f75340050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7534027070 con 0x7f7538100b70 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7534022470 con 0x7f7538100b70 2024-03-31T23:08:51.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753400f5f0 con 0x7f7538100b70 2024-03-31T23:08:51.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753819a250 con 0x7f7538100b70 2024-03-31T23:08:51.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.965+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753819a670 con 0x7f7538100b70 2024-03-31T23:08:51.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.966+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f753402a070 con 0x7f7538100b70 2024-03-31T23:08:51.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.966+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75381074c0 con 0x7f7538100b70 2024-03-31T23:08:51.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.966+0000 7f752e7fc700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7524038ea0 0x7f752403b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:51.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.966+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f753401e030 con 0x7f7538100b70 2024-03-31T23:08:51.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.966+0000 7f753c806700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7524038ea0 0x7f752403b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:51.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.967+0000 7f753c806700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7524038ea0 0x7f752403b360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7528006fd0 tx=0x7f7528006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:51.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:51.971+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7534013070 con 0x7f7538100b70 2024-03-31T23:08:52.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.173+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f753802dd60 con 0x7f7538100b70 2024-03-31T23:08:52.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.174+0000 7f752e7fc700 1 -- 172.21.15.42:0/1997885511 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f753400de00 con 0x7f7538100b70 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7524038ea0 msgr2=0x7f752403b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7524038ea0 0x7f752403b360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7528006fd0 tx=0x7f7528006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 msgr2=0x7f753806a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f753806a9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7534005840 tx=0x7f75340050b0 comp rx=0 tx=0).stop 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 shutdown_connections 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7524038ea0 0x7f752403b360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 --2- 172.21.15.42:0/1997885511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538100b70 0x7f753806a9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 >> 172.21.15.42:0/1997885511 conn(0x7f75380fc110 msgr2=0x7f75380fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 shutdown_connections 2024-03-31T23:08:52.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:52.177+0000 7f753f26b700 1 -- 172.21.15.42:0/1997885511 wait complete. 2024-03-31T23:08:52.479 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:52.479 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:52.479 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:08:52.479 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:52.479 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:52.479 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:52.773 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-31T23:08:52.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-31T23:08:53.010 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:08:53.408 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1997885511' entity='client.admin' 2024-03-31T23:08:53.409 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:53.409 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 -- 172.21.15.42:0/1307360496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 msgr2=0x7eff341025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 --2- 172.21.15.42:0/1307360496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff341025c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff30009910 tx=0x7eff30009c20 comp rx=0 tx=0).stop 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 -- 172.21.15.42:0/1307360496 shutdown_connections 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 --2- 172.21.15.42:0/1307360496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff341025c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 -- 172.21.15.42:0/1307360496 >> 172.21.15.42:0/1307360496 conn(0x7eff340fb8d0 msgr2=0x7eff340fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 -- 172.21.15.42:0/1307360496 shutdown_connections 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.291+0000 7eff3b825700 1 -- 172.21.15.42:0/1307360496 wait complete. 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff3b825700 1 Processor -- start 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff3b825700 1 -- start start 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff3b825700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff34199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff3b825700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff34109fb0 con 0x7eff341021a0 2024-03-31T23:08:54.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff395c1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff34199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff395c1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff34199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60540/0 (socket says 172.21.15.42:60540) 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff395c1700 1 -- 172.21.15.42:0/2730539459 learned_addr learned my addr 172.21.15.42:0/2730539459 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.292+0000 7eff395c1700 1 -- 172.21.15.42:0/2730539459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff34199a50 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff395c1700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff34199510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff30005840 tx=0x7eff300050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff30027070 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff34199d40 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff30022470 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3000f5f0 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3419c9d0 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.293+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7eff3002a070 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.294+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3410a730 con 0x7eff341021a0 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.294+0000 7eff2a7fc700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7eff20038ea0 0x7eff2003b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.294+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7eff3001e030 con 0x7eff341021a0 2024-03-31T23:08:54.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.294+0000 7eff38dc0700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7eff20038ea0 0x7eff2003b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:54.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.294+0000 7eff38dc0700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7eff20038ea0 0x7eff2003b360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff24006fd0 tx=0x7eff24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:54.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.299+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7eff30013070 con 0x7eff341021a0 2024-03-31T23:08:54.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.508+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7eff3402dd60 con 0x7eff20038ea0 2024-03-31T23:08:54.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.512+0000 7eff2a7fc700 1 -- 172.21.15.42:0/2730539459 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7eff3402dd60 con 0x7eff20038ea0 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7eff20038ea0 msgr2=0x7eff2003b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7eff20038ea0 0x7eff2003b360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff24006fd0 tx=0x7eff24006e40 comp rx=0 tx=0).stop 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 msgr2=0x7eff34199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff34199510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff30005840 tx=0x7eff300050b0 comp rx=0 tx=0).stop 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 shutdown_connections 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7eff20038ea0 0x7eff2003b360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 --2- 172.21.15.42:0/2730539459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff341021a0 0x7eff34199510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 >> 172.21.15.42:0/2730539459 conn(0x7eff340fb8d0 msgr2=0x7eff340fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 shutdown_connections 2024-03-31T23:08:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:54.514+0000 7eff3b825700 1 -- 172.21.15.42:0/2730539459 wait complete. 2024-03-31T23:08:55.217 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi094 2024-03-31T23:08:55.218 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:08:55.218 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/etc/ceph/ceph.conf 2024-03-31T23:08:55.237 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:08:55.238 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:08:55.295 INFO:tasks.cephadm:Adding host smithi094 to orchestrator... 2024-03-31T23:08:55.295 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi094 2024-03-31T23:08:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:55.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:08:56.660 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:56 smithi042 ceph-mon[32380]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:08:56.660 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:56 smithi042 ceph-mon[32380]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:08:56.660 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:56 smithi042 ceph-mon[32380]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 -- 172.21.15.42:0/3917615794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 msgr2=0x7fb874101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 --2- 172.21.15.42:0/3917615794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb874101180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb86400b0a0 tx=0x7fb86400b3b0 comp rx=0 tx=0).stop 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 -- 172.21.15.42:0/3917615794 shutdown_connections 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 --2- 172.21.15.42:0/3917615794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb874101180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 -- 172.21.15.42:0/3917615794 >> 172.21.15.42:0/3917615794 conn(0x7fb8740fc690 msgr2=0x7fb8740feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 -- 172.21.15.42:0/3917615794 shutdown_connections 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.929+0000 7fb87b5b1700 1 -- 172.21.15.42:0/3917615794 wait complete. 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87b5b1700 1 Processor -- start 2024-03-31T23:08:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87b5b1700 1 -- start start 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87b5b1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb87419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87b5b1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb87410b2b0 con 0x7fb874100da0 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87934d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb87419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87934d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb87419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60566/0 (socket says 172.21.15.42:60566) 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87934d700 1 -- 172.21.15.42:0/2764640445 learned_addr learned my addr 172.21.15.42:0/2764640445 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87934d700 1 -- 172.21.15.42:0/2764640445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87419fbb0 con 0x7fb874100da0 2024-03-31T23:08:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.930+0000 7fb87934d700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb87419f670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb864015040 tx=0x7fb86400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.931+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb864017040 con 0x7fb874100da0 2024-03-31T23:08:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.931+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87419fe40 con 0x7fb874100da0 2024-03-31T23:08:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.931+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb864022070 con 0x7fb874100da0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.931+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86401d440 con 0x7fb874100da0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.931+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8741997f0 con 0x7fb874100da0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.932+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fb86401d740 con 0x7fb874100da0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.932+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb874102280 con 0x7fb874100da0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.932+0000 7fb8727fc700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb85c038ea0 0x7fb85c03b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.932+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb86400f050 con 0x7fb874100da0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.932+0000 7fb878b4c700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb85c038ea0 0x7fb85c03b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:08:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.932+0000 7fb878b4c700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb85c038ea0 0x7fb85c03b360 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb868006fd0 tx=0x7fb868006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:08:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:56.937+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb864025be0 con 0x7fb874100da0 2024-03-31T23:08:57.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:08:57.143+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi094", "target": ["mon-mgr", ""]}) -- 0x7fb87419ad20 con 0x7fb85c038ea0 2024-03-31T23:08:58.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:57 smithi042 ceph-mon[32380]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi094", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:08:59.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:08:58 smithi042 ceph-mon[32380]: Deploying cephadm binary to smithi094 2024-03-31T23:09:01.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.338+0000 7fb8727fc700 1 -- 172.21.15.42:0/2764640445 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fb87419ad20 con 0x7fb85c038ea0 2024-03-31T23:09:01.339 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi094' with addr '172.21.15.94' 2024-03-31T23:09:01.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb85c038ea0 msgr2=0x7fb85c03b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:01.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb85c038ea0 0x7fb85c03b360 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb868006fd0 tx=0x7fb868006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:01.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 msgr2=0x7fb87419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:01.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb87419f670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb864015040 tx=0x7fb86400bd40 comp rx=0 tx=0).stop 2024-03-31T23:09:01.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 shutdown_connections 2024-03-31T23:09:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb85c038ea0 0x7fb85c03b360 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 --2- 172.21.15.42:0/2764640445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb874100da0 0x7fb87419f670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.340+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 >> 172.21.15.42:0/2764640445 conn(0x7fb8740fc690 msgr2=0x7fb87406a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.341+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 shutdown_connections 2024-03-31T23:09:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:01.341+0000 7fb87b5b1700 1 -- 172.21.15.42:0/2764640445 wait complete. 2024-03-31T23:09:01.911 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:01 smithi042 ceph-mon[32380]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:01.912 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:01.912 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:01.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-03-31T23:09:02.154 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:02 smithi042 ceph-mon[32380]: Added host smithi094 2024-03-31T23:09:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:02 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:02 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.598+0000 7f930cfbc700 1 -- 172.21.15.42:0/2134794878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 msgr2=0x7f9308106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.598+0000 7f930cfbc700 1 --2- 172.21.15.42:0/2134794878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f9308106fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92f800b0a0 tx=0x7f92f800b3b0 comp rx=0 tx=0).stop 2024-03-31T23:09:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 -- 172.21.15.42:0/2134794878 shutdown_connections 2024-03-31T23:09:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 --2- 172.21.15.42:0/2134794878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f9308106fc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 -- 172.21.15.42:0/2134794878 >> 172.21.15.42:0/2134794878 conn(0x7f93080fc600 msgr2=0x7f93080fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 -- 172.21.15.42:0/2134794878 shutdown_connections 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 -- 172.21.15.42:0/2134794878 wait complete. 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 Processor -- start 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.599+0000 7f930cfbc700 1 -- start start 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930cfbc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f930819d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930cfbc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f930810b2e0 con 0x7f9308106be0 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f930819d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f930819d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40858/0 (socket says 172.21.15.42:40858) 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930659c700 1 -- 172.21.15.42:0/1134245794 learned_addr learned my addr 172.21.15.42:0/1134245794 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930659c700 1 -- 172.21.15.42:0/1134245794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930819d970 con 0x7f9308106be0 2024-03-31T23:09:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930659c700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f930819d430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92f80093e0 tx=0x7f92f800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92f801f020 con 0x7f9308106be0 2024-03-31T23:09:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92f8003b30 con 0x7f9308106be0 2024-03-31T23:09:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930819dc00 con 0x7f9308106be0 2024-03-31T23:09:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92f8007e60 con 0x7f9308106be0 2024-03-31T23:09:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.600+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93081975f0 con 0x7f9308106be0 2024-03-31T23:09:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.601+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f92f8022020 con 0x7f9308106be0 2024-03-31T23:09:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.601+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93081021e0 con 0x7f9308106be0 2024-03-31T23:09:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.601+0000 7f92ff7fe700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92f4038ea0 0x7f92f403b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.602+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f92f800f050 con 0x7f9308106be0 2024-03-31T23:09:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.602+0000 7f9305d9b700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92f4038ea0 0x7f92f403b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.602+0000 7f9305d9b700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92f4038ea0 0x7f92f403b360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92f0006fd0 tx=0x7f92f0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.607+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f92f8029020 con 0x7f9308106be0 2024-03-31T23:09:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.817+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9308198b20 con 0x7f92f4038ea0 2024-03-31T23:09:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.818+0000 7f92ff7fe700 1 -- 172.21.15.42:0/1134245794 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f9308198b20 con 0x7f92f4038ea0 2024-03-31T23:09:03.819 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:09:03.819 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.94", "hostname": "smithi094", "labels": [], "status": ""}] 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92f4038ea0 msgr2=0x7f92f403b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92f4038ea0 0x7f92f403b360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92f0006fd0 tx=0x7f92f0006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 msgr2=0x7f930819d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f930819d430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92f80093e0 tx=0x7f92f800bd40 comp rx=0 tx=0).stop 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 shutdown_connections 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92f4038ea0 0x7f92f403b360 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 --2- 172.21.15.42:0/1134245794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9308106be0 0x7f930819d430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 >> 172.21.15.42:0/1134245794 conn(0x7f93080fc600 msgr2=0x7f93080fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 shutdown_connections 2024-03-31T23:09:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:03.820+0000 7f930cfbc700 1 -- 172.21.15.42:0/1134245794 wait complete. 2024-03-31T23:09:04.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:03 smithi042 ceph-mon[32380]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:04.418 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi188 2024-03-31T23:09:04.418 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:09:04.418 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.conf 2024-03-31T23:09:04.438 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:09:04.438 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:04.495 INFO:tasks.cephadm:Adding host smithi188 to orchestrator... 2024-03-31T23:09:04.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi188 2024-03-31T23:09:04.732 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:05.177 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:04 smithi042 ceph-mon[32380]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:09:05.177 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:05.177 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:04 smithi042 ceph-mon[32380]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 -- 172.21.15.42:0/1066235774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 msgr2=0x7f93501031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 --2- 172.21.15.42:0/1066235774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f93501031c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9340009910 tx=0x7f9340009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 -- 172.21.15.42:0/1066235774 shutdown_connections 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 --2- 172.21.15.42:0/1066235774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f93501031c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 -- 172.21.15.42:0/1066235774 >> 172.21.15.42:0/1066235774 conn(0x7f93500fc630 msgr2=0x7f93500fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 -- 172.21.15.42:0/1066235774 shutdown_connections 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.381+0000 7f9355d7c700 1 -- 172.21.15.42:0/1066235774 wait complete. 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.382+0000 7f9355d7c700 1 Processor -- start 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.382+0000 7f9355d7c700 1 -- start start 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.382+0000 7f9355d7c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f935019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.382+0000 7f9355d7c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f935010c410 con 0x7f9350102de0 2024-03-31T23:09:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f935019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f935019d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40876/0 (socket says 172.21.15.42:40876) 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934f7fe700 1 -- 172.21.15.42:0/2460381245 learned_addr learned my addr 172.21.15.42:0/2460381245 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934f7fe700 1 -- 172.21.15.42:0/2460381245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935019d9a0 con 0x7f9350102de0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934f7fe700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f935019d460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9340004c10 tx=0x7f9340004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9340026070 con 0x7f9350102de0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9340004370 con 0x7f9350102de0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935019dc30 con 0x7f9350102de0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9340003bf0 con 0x7f9350102de0 2024-03-31T23:09:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.383+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9350197620 con 0x7f9350102de0 2024-03-31T23:09:06.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.384+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f9340029070 con 0x7f9350102de0 2024-03-31T23:09:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.384+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935006a980 con 0x7f9350102de0 2024-03-31T23:09:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.384+0000 7f934cff9700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9338038ea0 0x7f933803b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.384+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f934001e070 con 0x7f9350102de0 2024-03-31T23:09:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.384+0000 7f934effd700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9338038ea0 0x7f933803b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.385+0000 7f934effd700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9338038ea0 0x7f933803b360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9344006fd0 tx=0x7f9344006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:06.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.389+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9340013070 con 0x7f9350102de0 2024-03-31T23:09:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:06.597+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}) -- 0x7f9350198b50 con 0x7f9338038ea0 2024-03-31T23:09:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:06 smithi042 ceph-mon[32380]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:06 smithi042 ceph-mon[32380]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:08.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:08.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:08.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:08.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi094", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: Deploying cephadm binary to smithi188 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: Updating smithi094:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:07 smithi042 ceph-mon[32380]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:09:09.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:08 smithi042 ceph-mon[32380]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:10.784 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi188' with addr '172.21.15.188' 2024-03-31T23:09:10.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.783+0000 7f934cff9700 1 -- 172.21.15.42:0/2460381245 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f9350198b50 con 0x7f9338038ea0 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9338038ea0 msgr2=0x7f933803b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9338038ea0 0x7f933803b360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9344006fd0 tx=0x7f9344006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 msgr2=0x7f935019d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f935019d460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9340004c10 tx=0x7f9340004cf0 comp rx=0 tx=0).stop 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 shutdown_connections 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9338038ea0 0x7f933803b360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 --2- 172.21.15.42:0/2460381245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350102de0 0x7f935019d460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:10.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 >> 172.21.15.42:0/2460381245 conn(0x7f93500fc630 msgr2=0x7f9350103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:10.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 shutdown_connections 2024-03-31T23:09:10.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:10.786+0000 7f9355d7c700 1 -- 172.21.15.42:0/2460381245 wait complete. 2024-03-31T23:09:11.353 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:11.354 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:11.354 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:11.354 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:11 smithi042 ceph-mon[32380]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:11.354 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:11.354 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:11.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-03-31T23:09:11.598 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:12.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:12 smithi042 ceph-mon[32380]: Added host smithi188 2024-03-31T23:09:12.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:12.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 -- 172.21.15.42:0/995197829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 msgr2=0x7f73581031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 --2- 172.21.15.42:0/995197829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f73581031b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7348009910 tx=0x7f7348009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 -- 172.21.15.42:0/995197829 shutdown_connections 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 --2- 172.21.15.42:0/995197829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f73581031b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 -- 172.21.15.42:0/995197829 >> 172.21.15.42:0/995197829 conn(0x7f7358077780 msgr2=0x7f73580fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 -- 172.21.15.42:0/995197829 shutdown_connections 2024-03-31T23:09:13.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.025+0000 7f735e885700 1 -- 172.21.15.42:0/995197829 wait complete. 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f735e885700 1 Processor -- start 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f735e885700 1 -- start start 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f735e885700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f735819d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f735e885700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f735810c400 con 0x7f7358102dd0 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f7357fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f735819d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f7357fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f735819d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40888/0 (socket says 172.21.15.42:40888) 2024-03-31T23:09:13.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f7357fff700 1 -- 172.21.15.42:0/2018860818 learned_addr learned my addr 172.21.15.42:0/2018860818 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.026+0000 7f7357fff700 1 -- 172.21.15.42:0/2018860818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735819dac0 con 0x7f7358102dd0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.027+0000 7f7357fff700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f735819d580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7348004c10 tx=0x7f7348004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.027+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7348026070 con 0x7f7358102dd0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.027+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7348004370 con 0x7f7358102dd0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.027+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f735819dd50 con 0x7f7358102dd0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.027+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7348003bf0 con 0x7f7358102dd0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.027+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7358197650 con 0x7f7358102dd0 2024-03-31T23:09:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.028+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f7348029070 con 0x7f7358102dd0 2024-03-31T23:09:13.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.028+0000 7f73557fa700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7340038f00 0x7f734003b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:13.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.028+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f734801e070 con 0x7f7358102dd0 2024-03-31T23:09:13.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.028+0000 7f73577fe700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7340038f00 0x7f734003b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:13.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.028+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7358069f10 con 0x7f7358102dd0 2024-03-31T23:09:13.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.028+0000 7f73577fe700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7340038f00 0x7f734003b3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f734c006fd0 tx=0x7f734c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:13.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.033+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7348013070 con 0x7f7358102dd0 2024-03-31T23:09:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.243+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7358198b80 con 0x7f7340038f00 2024-03-31T23:09:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.244+0000 7f73557fa700 1 -- 172.21.15.42:0/2018860818 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f7358198b80 con 0x7f7340038f00 2024-03-31T23:09:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:09:13.245 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.94", "hostname": "smithi094", "labels": [], "status": ""}, {"addr": "172.21.15.188", "hostname": "smithi188", "labels": [], "status": ""}] 2024-03-31T23:09:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.246+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7340038f00 msgr2=0x7f734003b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.246+0000 7f735e885700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7340038f00 0x7f734003b3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f734c006fd0 tx=0x7f734c006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.246+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 msgr2=0x7f735819d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.246+0000 7f735e885700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f735819d580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7348004c10 tx=0x7f7348004cf0 comp rx=0 tx=0).stop 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.247+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 shutdown_connections 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.247+0000 7f735e885700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7340038f00 0x7f734003b3c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.247+0000 7f735e885700 1 --2- 172.21.15.42:0/2018860818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7358102dd0 0x7f735819d580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.247+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 >> 172.21.15.42:0/2018860818 conn(0x7f7358077780 msgr2=0x7f7358103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.247+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 shutdown_connections 2024-03-31T23:09:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:13.247+0000 7f735e885700 1 -- 172.21.15.42:0/2018860818 wait complete. 2024-03-31T23:09:13.542 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:13 smithi042 ceph-mon[32380]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:13.864 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-31T23:09:13.865 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd crush tunables default 2024-03-31T23:09:14.102 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:14.529 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:14 smithi042 ceph-mon[32380]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:09:14.529 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:15.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:15 smithi042 ceph-mon[32380]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:15.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 -- 172.21.15.42:0/3446749466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 msgr2=0x7f2f4c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 --2- 172.21.15.42:0/3446749466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c1031c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009910 tx=0x7f2f3c009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 -- 172.21.15.42:0/3446749466 shutdown_connections 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 --2- 172.21.15.42:0/3446749466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c1031c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 -- 172.21.15.42:0/3446749466 >> 172.21.15.42:0/3446749466 conn(0x7f2f4c0fc630 msgr2=0x7f2f4c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 -- 172.21.15.42:0/3446749466 shutdown_connections 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.583+0000 7f2f5143c700 1 -- 172.21.15.42:0/3446749466 wait complete. 2024-03-31T23:09:15.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.584+0000 7f2f5143c700 1 Processor -- start 2024-03-31T23:09:15.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.584+0000 7f2f5143c700 1 -- start start 2024-03-31T23:09:15.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.584+0000 7f2f5143c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c19d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:15.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.584+0000 7f2f5143c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c10c410 con 0x7f2f4c102de0 2024-03-31T23:09:15.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f4affd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c19d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:15.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f4affd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c19d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56896/0 (socket says 172.21.15.42:56896) 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f4affd700 1 -- 172.21.15.42:0/1107398819 learned_addr learned my addr 172.21.15.42:0/1107398819 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f4affd700 1 -- 172.21.15.42:0/1107398819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c19d980 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f4affd700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c19d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004c10 tx=0x7f2f3c004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c026070 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c19dc10 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f3c004370 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c003bf0 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.585+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c197600 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.586+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f2f3c029070 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.586+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4c06a9a0 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.586+0000 7f2f33fff700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2f3403d2b0 0x7f2f3403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.586+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2f3c01e070 con 0x7f2f4c102de0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.586+0000 7f2f4a7fc700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2f3403d2b0 0x7f2f3403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:15.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.587+0000 7f2f4a7fc700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2f3403d2b0 0x7f2f3403f770 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f40006fd0 tx=0x7f2f40006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:15.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.591+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2f3c013070 con 0x7f2f4c102de0 2024-03-31T23:09:15.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:15.805+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2f4c063870 con 0x7f2f4c102de0 2024-03-31T23:09:16.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.358+0000 7f2f33fff700 1 -- 172.21.15.42:0/1107398819 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f2f3c030090 con 0x7f2f4c102de0 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2f3403d2b0 msgr2=0x7f2f3403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2f3403d2b0 0x7f2f3403f770 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f40006fd0 tx=0x7f2f40006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 msgr2=0x7f2f4c19d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c19d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004c10 tx=0x7f2f3c004cf0 comp rx=0 tx=0).stop 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 shutdown_connections 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2f3403d2b0 0x7f2f3403f770 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 --2- 172.21.15.42:0/1107398819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f4c102de0 0x7f2f4c19d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 >> 172.21.15.42:0/1107398819 conn(0x7f2f4c0fc630 msgr2=0x7f2f4c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 shutdown_connections 2024-03-31T23:09:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:16.362+0000 7f2f5143c700 1 -- 172.21.15.42:0/1107398819 wait complete. 2024-03-31T23:09:16.364 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-03-31T23:09:16.690 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:16 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1107398819' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-31T23:09:16.979 INFO:tasks.cephadm:Adding mon.a on smithi042 2024-03-31T23:09:16.980 INFO:tasks.cephadm:Adding mon.b on smithi094 2024-03-31T23:09:16.980 INFO:tasks.cephadm:Adding mon.c on smithi188 2024-03-31T23:09:16.980 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch apply mon '3;smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c' 2024-03-31T23:09:17.216 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:17.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1107398819' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:09:17.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:17 smithi042 ceph-mon[32380]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 -- 172.21.15.188:0/3018160608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 msgr2=0x7ff030106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 --2- 172.21.15.188:0/3018160608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff030106fd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff024009910 tx=0x7ff024009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 -- 172.21.15.188:0/3018160608 shutdown_connections 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 --2- 172.21.15.188:0/3018160608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff030106fd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 -- 172.21.15.188:0/3018160608 >> 172.21.15.188:0/3018160608 conn(0x7ff0300fc630 msgr2=0x7ff0300fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 -- 172.21.15.188:0/3018160608 shutdown_connections 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.553+0000 7ff036bb2700 1 -- 172.21.15.188:0/3018160608 wait complete. 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff036bb2700 1 Processor -- start 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff036bb2700 1 -- start start 2024-03-31T23:09:18.555 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff036bb2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff0300fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:18.556 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff036bb2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff03010b2f0 con 0x7ff030106bf0 2024-03-31T23:09:18.557 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff03494e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff0300fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:18.557 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff03494e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff0300fcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.188:41596/0 (socket says 172.21.15.188:41596) 2024-03-31T23:09:18.557 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.554+0000 7ff03494e700 1 -- 172.21.15.188:0/2813456013 learned_addr learned my addr 172.21.15.188:0/2813456013 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff03494e700 1 -- 172.21.15.188:0/2813456013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0300fe9d0 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff03494e700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff0300fcae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff0240052a0 tx=0x7ff024004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff024026070 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0300fd020 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff02400bc50 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff024003a20 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.555+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0300fd4e0 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.556+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0301021f0 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.556+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7ff024029070 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.557+0000 7ff02dffb700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff020038ea0 0x7ff02003b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.557+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff02401e070 con 0x7ff030106bf0 2024-03-31T23:09:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.557+0000 7ff02ffff700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff020038ea0 0x7ff02003b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:18.559 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.557+0000 7ff02ffff700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff020038ea0 0x7ff02003b360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006fd0 tx=0x7ff01c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:18.562 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.562+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff024013070 con 0x7ff030106bf0 2024-03-31T23:09:18.769 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.769+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c", "target": ["mon-mgr", ""]}) -- 0x7ff0300fd710 con 0x7ff020038ea0 2024-03-31T23:09:18.776 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.775+0000 7ff02dffb700 1 -- 172.21.15.188:0/2813456013 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff0300fd710 con 0x7ff020038ea0 2024-03-31T23:09:18.776 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mon update... 2024-03-31T23:09:18.778 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.777+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff020038ea0 msgr2=0x7ff02003b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:18.778 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.777+0000 7ff036bb2700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff020038ea0 0x7ff02003b360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006fd0 tx=0x7ff01c006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.777+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 msgr2=0x7ff0300fcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff0300fcae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff0240052a0 tx=0x7ff024004cc0 comp rx=0 tx=0).stop 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 shutdown_connections 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff020038ea0 0x7ff02003b360 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 --2- 172.21.15.188:0/2813456013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030106bf0 0x7ff0300fcae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 >> 172.21.15.188:0/2813456013 conn(0x7ff0300fc630 msgr2=0x7ff03006a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 shutdown_connections 2024-03-31T23:09:18.779 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:18.778+0000 7ff036bb2700 1 -- 172.21.15.188:0/2813456013 wait complete. 2024-03-31T23:09:18.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:18 smithi042 ceph-mon[32380]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:18.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:18 smithi042 ceph-mon[32380]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:18.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:18 smithi042 ceph-mon[32380]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:09:18.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:18.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:18.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:19.287 DEBUG:teuthology.orchestra.run.smithi094:mon.b> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.b.service 2024-03-31T23:09:19.289 DEBUG:teuthology.orchestra.run.smithi188:mon.c> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.c.service 2024-03-31T23:09:19.292 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-31T23:09:19.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-31T23:09:19.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:19.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:19.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:19.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:19.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:19.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:19.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:19.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:19 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:20.272 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:20.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:20 smithi042 ceph-mon[32380]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:20.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:20 smithi042 ceph-mon[32380]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c;count:3 2024-03-31T23:09:20.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:20 smithi042 ceph-mon[32380]: Deploying daemon mon.c on smithi188 2024-03-31T23:09:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:21 smithi042 ceph-mon[32380]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:22.877 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 -- 172.21.15.188:0/1827236964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 msgr2=0x7f20c4102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:22.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 --2- 172.21.15.188:0/1827236964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c4102270 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009910 tx=0x7f20b4009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:22.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 -- 172.21.15.188:0/1827236964 shutdown_connections 2024-03-31T23:09:22.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 --2- 172.21.15.188:0/1827236964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c4102270 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:22.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 -- 172.21.15.188:0/1827236964 >> 172.21.15.188:0/1827236964 conn(0x7f20c40fd740 msgr2=0x7f20c40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:22.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 -- 172.21.15.188:0/1827236964 shutdown_connections 2024-03-31T23:09:22.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.874+0000 7f20c8f48700 1 -- 172.21.15.188:0/1827236964 wait complete. 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.875+0000 7f20c8f48700 1 Processor -- start 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.875+0000 7f20c8f48700 1 -- start start 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.875+0000 7f20c8f48700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.875+0000 7f20c8f48700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20c410c3a0 con 0x7f20c4101e90 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20c259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20c259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c419d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.188:41608/0 (socket says 172.21.15.188:41608) 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20c259c700 1 -- 172.21.15.188:0/2859202296 learned_addr learned my addr 172.21.15.188:0/2859202296 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20c259c700 1 -- 172.21.15.188:0/2859202296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c419d950 con 0x7f20c4101e90 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20c259c700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c419d410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20b40052a0 tx=0x7f20b4004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b4026070 con 0x7f20c4101e90 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c419dc40 con 0x7f20c4101e90 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20b400bbf0 con 0x7f20c4101e90 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.876+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b4003a30 con 0x7f20c4101e90 2024-03-31T23:09:22.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.877+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c41975d0 con 0x7f20c4101e90 2024-03-31T23:09:22.880 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.878+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f20b4029070 con 0x7f20c4101e90 2024-03-31T23:09:22.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.878+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c4103370 con 0x7f20c4101e90 2024-03-31T23:09:22.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.878+0000 7f20b37fe700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f20ac038ea0 0x7f20ac03b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:22.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.878+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f20b401e070 con 0x7f20c4101e90 2024-03-31T23:09:22.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.878+0000 7f20c1d9b700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f20ac038ea0 0x7f20ac03b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:22.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.879+0000 7f20c1d9b700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f20ac038ea0 0x7f20ac03b360 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006fd0 tx=0x7f20b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:22.884 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:22.883+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f20b4013070 con 0x7f20c4101e90 2024-03-31T23:09:23.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:22 smithi042 ceph-mon[32380]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.180 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.179+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f20c4198b00 con 0x7f20c4101e90 2024-03-31T23:09:23.181 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.180+0000 7f20b37fe700 1 -- 172.21.15.188:0/2859202296 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f20b4030090 con 0x7f20c4101e90 2024-03-31T23:09:23.181 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:09:23.181 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":1,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","modified":"2024-03-31T23:07:33.997579Z","created":"2024-03-31T23:07:33.997579Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f20ac038ea0 msgr2=0x7f20ac03b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f20ac038ea0 0x7f20ac03b360 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006fd0 tx=0x7f20b8006e40 comp rx=0 tx=0).stop 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 msgr2=0x7f20c419d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c419d410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20b40052a0 tx=0x7f20b4004cc0 comp rx=0 tx=0).stop 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 shutdown_connections 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f20ac038ea0 0x7f20ac03b360 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 --2- 172.21.15.188:0/2859202296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c4101e90 0x7f20c419d410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 >> 172.21.15.188:0/2859202296 conn(0x7f20c40fd740 msgr2=0x7f20c4104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:23.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 shutdown_connections 2024-03-31T23:09:23.185 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:23.183+0000 7f20c8f48700 1 -- 172.21.15.188:0/2859202296 wait complete. 2024-03-31T23:09:23.185 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 1 2024-03-31T23:09:23.342 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 podman[36036]: 2024-03-31 23:09:23.318601228 +0000 UTC m=+0.347936144 container start 50bcb0a98509865fbd70587142d472855478d9e3caaf795cca0848506c6a5729 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux ) 2024-03-31T23:09:23.343 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: set uid:gid to 167:167 (ceph:ceph) 2024-03-31T23:09:23.343 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev), process ceph-mon, pid 2 2024-03-31T23:09:23.685 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pidfile_write: ignore empty --pid-file 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: load: jerasure load: lrc 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: RocksDB version: 7.9.2 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Git sha 0 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Compile date 2024-03-31 16:17:26 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: DB SUMMARY 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: DB Session ID: SHSFCO5P9HLWH13WXKQ0 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: CURRENT file: CURRENT 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: IDENTITY file: IDENTITY 2024-03-31T23:09:23.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.error_if_exists: 0 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.create_if_missing: 0 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.paranoid_checks: 1 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.env: 0x55a43055bc60 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.fs: PosixFileSystem 2024-03-31T23:09:23.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.info_log: 0x55a431075ae0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_file_opening_threads: 16 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.statistics: (nil) 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.use_fsync: 0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_log_file_size: 0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.keep_log_file_num: 1000 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.recycle_log_file_num: 0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.allow_fallocate: 1 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.allow_mmap_reads: 0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.allow_mmap_writes: 0 2024-03-31T23:09:23.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.use_direct_reads: 0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.create_missing_column_families: 0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.db_log_dir: 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.wal_dir: 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.advise_random_on_open: 1 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.db_write_buffer_size: 0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.write_buffer_manager: 0x55a4310481e0 2024-03-31T23:09:23.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.rate_limiter: (nil) 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.wal_recovery_mode: 2 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.enable_thread_tracking: 0 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.enable_pipelined_write: 0 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.unordered_write: 0 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-31T23:09:23.690 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.row_cache: None 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.wal_filter: None 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.allow_ingest_behind: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.two_write_queues: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.manual_wal_flush: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.wal_compression: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.atomic_flush: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.log_readahead_size: 0 2024-03-31T23:09:23.691 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.best_efforts_recovery: 0 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.allow_data_in_errors: 0 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.db_host_id: __hostname__ 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_background_jobs: 2 2024-03-31T23:09:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_background_compactions: -1 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_subcompactions: 1 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_total_wal_size: 0 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_open_files: -1 2024-03-31T23:09:23.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bytes_per_sync: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_readahead_size: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_background_flushes: -1 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Compression algorithms supported: 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kZSTD supported: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kXpressCompression supported: 0 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kLZ4HCCompression supported: 1 2024-03-31T23:09:23.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kZlibCompression supported: 1 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kSnappyCompression supported: 1 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kLZ4Compression supported: 1 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: kBZip2Compression supported: 0 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.merge_operator: 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_filter: None 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_filter_factory: None 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.sst_partitioner_factory: None 2024-03-31T23:09:23.696 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a431075be0) 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: cache_index_and_filter_blocks: 1 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: pin_top_level_index_and_filter: 1 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_type: 0 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: data_block_index_type: 0 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_shortening: 1 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-31T23:09:23.697 INFO:journalctl@ceph.mon.c.smithi188.stdout: checksum: 4 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: no_block_cache: 0 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache: 0x55a431079090 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_name: BinnedLRUCache 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_options: 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: capacity : 536870912 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: num_shard_bits : 4 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: strict_capacity_limit : 0 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: high_pri_pool_ratio: 0.000 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_compressed: (nil) 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: persistent_cache: (nil) 2024-03-31T23:09:23.698 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_size: 4096 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_size_deviation: 10 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_restart_interval: 16 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_block_restart_interval: 1 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: metadata_block_size: 4096 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: partition_filters: 0 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: use_delta_encoding: 1 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: filter_policy: bloomfilter 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: whole_key_filtering: 1 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: verify_compression: 0 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: read_amp_bytes_per_bit: 0 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: format_version: 5 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: enable_index_compression: 1 2024-03-31T23:09:23.699 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_align: 0 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout: max_auto_readahead_size: 262144 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout: prepopulate_block_cache: 0 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout: initial_auto_readahead_size: 8192 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout: num_file_reads_for_auto_readahead: 2 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.write_buffer_size: 33554432 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_write_buffer_number: 2 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression: NoCompression 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression: Disabled 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.prefix_extractor: nullptr 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.num_levels: 7 2024-03-31T23:09:23.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-31T23:09:23.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.level: 32767 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.strategy: 0 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.enabled: false 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-31T23:09:23.702 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.target_file_size_base: 67108864 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-31T23:09:23.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.arena_block_size: 1048576 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.disable_auto_compactions: 0 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-31T23:09:23.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.table_properties_collectors: 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.inplace_update_support: 0 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-31T23:09:23.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.bloom_locality: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.max_successive_merges: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.paranoid_file_checks: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.force_consistency_checks: 1 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.report_bg_io_stats: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.ttl: 2592000 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.enable_blob_files: false 2024-03-31T23:09:23.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.min_blob_size: 0 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.blob_file_size: 268435456 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.blob_file_starting_level: 0 2024-03-31T23:09:23.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9918bea0-cd43-4600-8b8d-914a3508ea59 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711926563349009, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711926563349471, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711926563, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9918bea0-cd43-4600-8b8d-914a3508ea59", "db_session_id": "SHSFCO5P9HLWH13WXKQ0", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711926563349558, "job": 1, "event": "recovery_finished"} 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a43116a000 2024-03-31T23:09:23.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: DB pointer 0x55a431154000 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** DB Stats ** 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-03-31T23:09:23.709 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** Compaction Stats [default] ** 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** Compaction Stats [default] ** 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-03-31T23:09:23.710 INFO:journalctl@ceph.mon.c.smithi188.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Block cache BinnedLRUCache@0x55a431079090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-03-31T23:09:23.711 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: using public_addr v2:172.21.15.188:0/0 -> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: starting mon.c rank -1 at public addrs [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] at bind addrs [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(???) e0 preinit fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).mds e1 new map 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout: e1 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout: legacy client fscid: -1 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout: No filesystems configured 2024-03-31T23:09:23.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Added host smithi188 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1107398819' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-31T23:09:23.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1107398819' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:23.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c;count:3 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: Deploying daemon mon.c on smithi188 2024-03-31T23:09:23.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.717 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:23.717 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 ceph-mon[36068]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-31T23:09:23.717 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 bash[36036]: 50bcb0a98509865fbd70587142d472855478d9e3caaf795cca0848506c6a5729 2024-03-31T23:09:23.717 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:23 smithi188 systemd[1]: Started Ceph mon.c for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:09:24.931 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-31T23:09:24.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-31T23:09:25.178 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:09:28.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:09:28.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: mon.a calling monitor election 2024-03-31T23:09:28.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: mon.c calling monitor election 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: monmap epoch 2 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: last_changed 2024-03-31T23:09:23.371681+0000 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: min_mon_release 19 (squid) 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: election_strategy: 1 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:28.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: fsmap 2024-03-31T23:09:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: mgrmap e13: x(active, since 47s) 2024-03-31T23:09:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: overall HEALTH_OK 2024-03-31T23:09:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:28.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: mon.a calling monitor election 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: mon.c calling monitor election 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: monmap epoch 2 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: last_changed 2024-03-31T23:09:23.371681+0000 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: min_mon_release 19 (squid) 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: election_strategy: 1 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: fsmap 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: mgrmap e13: x(active, since 47s) 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: overall HEALTH_OK 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:28.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.567+0000 7f0f1fa74700 1 -- 172.21.15.188:0/1840026391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f040035c0 msgr2=0x7f0f04005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.567+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/1840026391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f040035c0 0x7f0f04005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f18100b70 tx=0x7f0f0800feb0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.567+0000 7f0f1fa74700 1 -- 172.21.15.188:0/1840026391 shutdown_connections 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.567+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/1840026391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f040035c0 0x7f0f04005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.567+0000 7f0f1fa74700 1 -- 172.21.15.188:0/1840026391 >> 172.21.15.188:0/1840026391 conn(0x7f0f180fc750 msgr2=0x7f0f180feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.568+0000 7f0f1fa74700 1 -- 172.21.15.188:0/1840026391 shutdown_connections 2024-03-31T23:09:29.569 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.568+0000 7f0f1fa74700 1 -- 172.21.15.188:0/1840026391 wait complete. 2024-03-31T23:09:29.571 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.568+0000 7f0f1fa74700 1 Processor -- start 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1fa74700 1 -- start start 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1fa74700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1fa74700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f18198d20 0x7f0f181991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1fa74700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18108e10 con 0x7f0f18198d20 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1fa74700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18108c90 con 0x7f0f040035c0 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:52944/0 (socket says 172.21.15.188:52944) 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 -- 172.21.15.188:0/3618164977 learned_addr learned my addr 172.21.15.188:0/3618164977 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d00f700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f18198d20 0x7f0f181991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 -- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 msgr2=0x7f0f181987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 -- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 msgr2=0x7f0f181987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-31T23:09:29.572 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d810700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d00f700 1 -- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 msgr2=0x7f0f181987e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d00f700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.569+0000 7f0f1d00f700 1 -- 172.21.15.188:0/3618164977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f181a1850 con 0x7f0f18198d20 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.570+0000 7f0f1d00f700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f18198d20 0x7f0f181991a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400b4d0 tx=0x7f0f1400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.570+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0f14011630 con 0x7f0f18198d20 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.570+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f14011cd0 con 0x7f0f18198d20 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.570+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f181a1a20 con 0x7f0f18198d20 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.570+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0f1400f2e0 con 0x7f0f18198d20 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.570+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f181a1fb0 con 0x7f0f18198d20 2024-03-31T23:09:29.573 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.571+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f0f14018020 con 0x7f0f18198d20 2024-03-31T23:09:29.574 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.571+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f18102380 con 0x7f0f18198d20 2024-03-31T23:09:29.574 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.571+0000 7f0f0effd700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0efc038c40 0x7f0efc03b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:29.574 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.571+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0f1404b8c0 con 0x7f0f18198d20 2024-03-31T23:09:29.574 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.572+0000 7f0f1d810700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0efc038c40 0x7f0efc03b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:29.574 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.572+0000 7f0f1d810700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0efc038c40 0x7f0efc03b100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800fa60 tx=0x7f0f08005be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:29.578 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.577+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0f1401f020 con 0x7f0f18198d20 2024-03-31T23:09:29.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:29.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:29.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:29.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:29 smithi188 ceph-mon[36068]: Deploying daemon mon.b on smithi094 2024-03-31T23:09:29.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:29 smithi188 ceph-mon[36068]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:29.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:29 smithi042 ceph-mon[32380]: Deploying daemon mon.b on smithi094 2024-03-31T23:09:29.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:29 smithi042 ceph-mon[32380]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:29.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:29.854 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.853+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0f181a22d0 con 0x7f0f18198d20 2024-03-31T23:09:29.854 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.854+0000 7f0f0effd700 1 -- 172.21.15.188:0/3618164977 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0f14018310 con 0x7f0f18198d20 2024-03-31T23:09:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:09:29.855 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":2,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","modified":"2024-03-31T23:09:23.371681Z","created":"2024-03-31T23:07:33.997579Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3300","nonce":0},{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-31T23:09:29.856 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0efc038c40 msgr2=0x7f0efc03b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:29.856 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0efc038c40 0x7f0efc03b100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800fa60 tx=0x7f0f08005be0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f18198d20 msgr2=0x7f0f181991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f18198d20 0x7f0f181991a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400b4d0 tx=0x7f0f1400b890 comp rx=0 tx=0).stop 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 shutdown_connections 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0efc038c40 0x7f0efc03b100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f040035c0 0x7f0f181987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 --2- 172.21.15.188:0/3618164977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f18198d20 0x7f0f181991a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.855+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 >> 172.21.15.188:0/3618164977 conn(0x7f0f180fc750 msgr2=0x7f0f180fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.856+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 shutdown_connections 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:29.856+0000 7f0f1fa74700 1 -- 172.21.15.188:0/3618164977 wait complete. 2024-03-31T23:09:29.857 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 2 2024-03-31T23:09:30.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:30 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/3618164977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-31T23:09:30.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:30 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/3618164977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-31T23:09:31.474 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-31T23:09:31.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-31T23:09:31.718 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:09:31.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:31 smithi188 ceph-mon[36068]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:31.726 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:31 smithi042 ceph-mon[32380]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).mds e1 new map 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).mds e1 print_map 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout: e1 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout: legacy client fscid: -1 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout: 2024-03-31T23:09:32.109 INFO:journalctl@ceph.mon.b.smithi094.stdout: No filesystems configured 2024-03-31T23:09:32.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Added host smithi188 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1107398819' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1107398819' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c;count:3 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Deploying daemon mon.c on smithi188 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:09:32.426 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.a calling monitor election 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.c calling monitor election 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: monmap epoch 2 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: last_changed 2024-03-31T23:09:23.371681+0000 2024-03-31T23:09:32.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: min_mon_release 19 (squid) 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: election_strategy: 1 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: fsmap 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mgrmap e13: x(active, since 47s) 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: overall HEALTH_OK 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: Deploying daemon mon.b on smithi094 2024-03-31T23:09:32.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.429 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:32.429 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/3618164977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-31T23:09:32.429 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:32.429 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 ceph-mon[36167]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-31T23:09:32.429 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 bash[36147]: 41f61d177940fd171d3f9aed035b745e49aeddb5a763dc7432ec993c685cc85c 2024-03-31T23:09:32.429 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:32 smithi094 systemd[1]: Started Ceph mon.b for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: mon.a calling monitor election 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: mon.c calling monitor election 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: monmap epoch 3 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: last_changed 2024-03-31T23:09:32.114037+0000 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: min_mon_release 19 (squid) 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: election_strategy: 1 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:37.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: 2: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: fsmap 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: mgrmap e13: x(active, since 56s) 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: overall HEALTH_OK 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 -- 172.21.15.188:0/3180258657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 msgr2=0x7f7a34005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 --2- 172.21.15.188:0/3180258657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a34005610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c005fa0 tx=0x7f7a3c00ff70 comp rx=0 tx=0).stop 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 -- 172.21.15.188:0/3180258657 shutdown_connections 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 --2- 172.21.15.188:0/3180258657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a34005610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 -- 172.21.15.188:0/3180258657 >> 172.21.15.188:0/3180258657 conn(0x7f7a4c0fc6e0 msgr2=0x7f7a4c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 -- 172.21.15.188:0/3180258657 shutdown_connections 2024-03-31T23:09:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 -- 172.21.15.188:0/3180258657 wait complete. 2024-03-31T23:09:37.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.507+0000 7f7a529f9700 1 Processor -- start 2024-03-31T23:09:37.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 -- start start 2024-03-31T23:09:37.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a4c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:37.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 0x7f7a4c1a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c108d90 con 0x7f7a4c100e70 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c108c10 con 0x7f7a4c1a1890 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a529f9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c108f10 con 0x7f7a4c198d60 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:52954/0 (socket says 172.21.15.188:52954) 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 -- 172.21.15.188:0/1877695534 learned_addr learned my addr 172.21.15.188:0/1877695534 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a50f96700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 0x7f7a4c1a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 msgr2=0x7f7a4c1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 msgr2=0x7f7a4c1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-31T23:09:37.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4bfff700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a4c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a4b7fe700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a50f96700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 msgr2=0x7f7a4c1a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a50f96700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 msgr2=0x7f7a4c1a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a50f96700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 0x7f7a4c1a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.508+0000 7f7a50f96700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 0x7f7a4c1a3c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a4bfff700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 msgr2=0x7f7a4c1991e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a4bfff700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a4bfff700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 msgr2=0x7f7a4c1a3c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a4bfff700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 0x7f7a4c1a3c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a4bfff700 1 -- 172.21.15.188:0/1877695534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c1a44c0 con 0x7f7a4c100e70 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a4bfff700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a4c198820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c000c00 tx=0x7f7a3c014e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c02b020 con 0x7f7a4c100e70 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a3c004200 con 0x7f7a4c100e70 2024-03-31T23:09:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c1a4750 con 0x7f7a4c100e70 2024-03-31T23:09:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c022040 con 0x7f7a4c100e70 2024-03-31T23:09:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.509+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1a4c90 con 0x7f7a4c100e70 2024-03-31T23:09:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.510+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f7a3c02e020 con 0x7f7a4c100e70 2024-03-31T23:09:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.510+0000 7f7a497fa700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7a38039330 0x7f7a3803b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:37.514 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.510+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7a3c04fb60 con 0x7f7a4c100e70 2024-03-31T23:09:37.514 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.510+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c063870 con 0x7f7a4c100e70 2024-03-31T23:09:37.514 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.511+0000 7f7a4b7fe700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7a38039330 0x7f7a3803b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:37.514 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.511+0000 7f7a4b7fe700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7a38039330 0x7f7a3803b7f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009180 tx=0x7f7a40008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:37.516 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.516+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7a3c035020 con 0x7f7a4c100e70 2024-03-31T23:09:37.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: mon.a calling monitor election 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: mon.c calling monitor election 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-31T23:09:37.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: monmap epoch 3 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: last_changed 2024-03-31T23:09:32.114037+0000 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: min_mon_release 19 (squid) 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: election_strategy: 1 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: 2: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: fsmap 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: mgrmap e13: x(active, since 56s) 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: overall HEALTH_OK 2024-03-31T23:09:37.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.578 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.578 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.578 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:37.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.806+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7a4c1a4f50 con 0x7f7a4c100e70 2024-03-31T23:09:37.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.806+0000 7f7a497fa700 1 -- 172.21.15.188:0/1877695534 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f7a3c01ddd0 con 0x7f7a4c100e70 2024-03-31T23:09:37.808 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-03-31T23:09:37.808 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":3,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","modified":"2024-03-31T23:09:32.114037Z","created":"2024-03-31T23:07:33.997579Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3300","nonce":0},{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7a38039330 msgr2=0x7f7a3803b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7a38039330 0x7f7a3803b7f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009180 tx=0x7f7a40008040 comp rx=0 tx=0).stop 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 msgr2=0x7f7a4c198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a4c198820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c000c00 tx=0x7f7a3c014e20 comp rx=0 tx=0).stop 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 shutdown_connections 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7a38039330 0x7f7a3803b7f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a4c1a1890 0x7f7a4c1a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c100e70 0x7f7a4c198820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 --2- 172.21.15.188:0/1877695534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a4c198d60 0x7f7a4c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 >> 172.21.15.188:0/1877695534 conn(0x7f7a4c0fc6e0 msgr2=0x7f7a4c102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.810+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 shutdown_connections 2024-03-31T23:09:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:37.811+0000 7f7a529f9700 1 -- 172.21.15.188:0/1877695534 wait complete. 2024-03-31T23:09:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 3 2024-03-31T23:09:38.357 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-31T23:09:38.357 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-03-31T23:09:38.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:38.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:38 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/1877695534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-31T23:09:38.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:38 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/1877695534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-31T23:09:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:38.608 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:09:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: mon.a calling monitor election 2024-03-31T23:09:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: mon.c calling monitor election 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: monmap epoch 3 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: last_changed 2024-03-31T23:09:32.114037+0000 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: min_mon_release 19 (squid) 2024-03-31T23:09:39.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: election_strategy: 1 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: 2: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: fsmap 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: mgrmap e13: x(active, since 56s) 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: overall HEALTH_OK 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/1877695534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-31T23:09:39.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.165+0000 7ff162b16700 1 -- 172.21.15.42:0/797934450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 msgr2=0x7ff15c102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.165+0000 7ff162b16700 1 --2- 172.21.15.42:0/797934450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c102270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff150009910 tx=0x7ff150009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 -- 172.21.15.42:0/797934450 shutdown_connections 2024-03-31T23:09:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 --2- 172.21.15.42:0/797934450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c102270 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 -- 172.21.15.42:0/797934450 >> 172.21.15.42:0/797934450 conn(0x7ff15c0fd740 msgr2=0x7ff15c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 -- 172.21.15.42:0/797934450 shutdown_connections 2024-03-31T23:09:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 -- 172.21.15.42:0/797934450 wait complete. 2024-03-31T23:09:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 Processor -- start 2024-03-31T23:09:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 -- start start 2024-03-31T23:09:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff15c074a80 0x7ff15c074f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:40.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.166+0000 7ff162b16700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff15c1a3c90 0x7ff15c1a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:40.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff162b16700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c10c360 con 0x7ff15c101e90 2024-03-31T23:09:40.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff162b16700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c10c1e0 con 0x7ff15c1a3c90 2024-03-31T23:09:40.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff162b16700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c10c4e0 con 0x7ff15c074a80 2024-03-31T23:09:40.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:40.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c074540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44106/0 (socket says 172.21.15.42:44106) 2024-03-31T23:09:40.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 -- 172.21.15.42:0/3589639161 learned_addr learned my addr 172.21.15.42:0/3589639161 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:09:40.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff15bfff700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff15c074a80 0x7ff15c074f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:40.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1610b3700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff15c1a3c90 0x7ff15c1a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:40.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 -- 172.21.15.42:0/3589639161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff15c074a80 msgr2=0x7ff15c074f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:40.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff15c074a80 0x7ff15c074f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 -- 172.21.15.42:0/3589639161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff15c1a3c90 msgr2=0x7ff15c1a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:40.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff15c1a3c90 0x7ff15c1a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 -- 172.21.15.42:0/3589639161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15c1a67b0 con 0x7ff15c101e90 2024-03-31T23:09:40.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1610b3700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff15c1a3c90 0x7ff15c1a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:09:40.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff1608b2700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c074540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff150006010 tx=0x7ff1500056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150026070 con 0x7ff15c101e90 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15c1a6aa0 con 0x7ff15c101e90 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff15000bd50 con 0x7ff15c101e90 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.167+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15000fba0 con 0x7ff15c101e90 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.168+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15c1a6fe0 con 0x7ff15c101e90 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.168+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7ff150029070 con 0x7ff15c101e90 2024-03-31T23:09:40.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.169+0000 7ff159ffb700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff14c039330 0x7ff14c03b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:40.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.169+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15c063870 con 0x7ff15c101e90 2024-03-31T23:09:40.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.169+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff150003680 con 0x7ff15c101e90 2024-03-31T23:09:40.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.169+0000 7ff15bfff700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff14c039330 0x7ff14c03b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:40.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.169+0000 7ff15bfff700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff14c039330 0x7ff14c03b7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff148009ad0 tx=0x7ff148009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:40.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.175+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff150013070 con 0x7ff15c101e90 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: mon.b calling monitor election 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: mon.b calling monitor election 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: mon.c calling monitor election 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: mon.a calling monitor election 2024-03-31T23:09:40.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: monmap epoch 3 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: last_changed 2024-03-31T23:09:32.114037+0000 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: min_mon_release 19 (squid) 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: election_strategy: 1 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: 2: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: fsmap 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: mgrmap e13: x(active, since 58s) 2024-03-31T23:09:40.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: overall HEALTH_OK 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:40.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:40.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:40.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.383+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff15c075a70 con 0x7ff15c101e90 2024-03-31T23:09:40.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.383+0000 7ff159ffb700 1 -- 172.21.15.42:0/3589639161 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7ff150013bc0 con 0x7ff15c101e90 2024-03-31T23:09:40.384 INFO:teuthology.orchestra.run.smithi042.stdout:# minimal ceph.conf for 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:40.385 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-03-31T23:09:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: mon_host = [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] 2024-03-31T23:09:40.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff14c039330 msgr2=0x7ff14c03b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:40.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff14c039330 0x7ff14c03b7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff148009ad0 tx=0x7ff148009210 comp rx=0 tx=0).stop 2024-03-31T23:09:40.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 msgr2=0x7ff15c074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:40.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c074540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff150006010 tx=0x7ff1500056f0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 shutdown_connections 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff14c039330 0x7ff14c03b7f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff15c1a3c90 0x7ff15c1a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff15c101e90 0x7ff15c074540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 --2- 172.21.15.42:0/3589639161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff15c074a80 0x7ff15c074f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 >> 172.21.15.42:0/3589639161 conn(0x7ff15c0fd740 msgr2=0x7ff15c103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 shutdown_connections 2024-03-31T23:09:40.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:40.385+0000 7ff162b16700 1 -- 172.21.15.42:0/3589639161 wait complete. 2024-03-31T23:09:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: mon.b calling monitor election 2024-03-31T23:09:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:09:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:09:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:09:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: mon.b calling monitor election 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: mon.c calling monitor election 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: mon.a calling monitor election 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: monmap epoch 3 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: last_changed 2024-03-31T23:09:32.114037+0000 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: min_mon_release 19 (squid) 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: election_strategy: 1 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: 2: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: fsmap 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: mgrmap e13: x(active, since 58s) 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: overall HEALTH_OK 2024-03-31T23:09:40.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:40.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:40.425 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:40.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: mon.b calling monitor election 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: mon.b calling monitor election 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: mon.c calling monitor election 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: mon.a calling monitor election 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: monmap epoch 3 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: last_changed 2024-03-31T23:09:32.114037+0000 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: created 2024-03-31T23:07:33.997579+0000 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: min_mon_release 19 (squid) 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: election_strategy: 1 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-03-31T23:09:40.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: 2: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: fsmap 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: osdmap e4: 0 total, 0 up, 0 in 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: mgrmap e13: x(active, since 58s) 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: overall HEALTH_OK 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:40.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:40.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:40.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:40.908 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-31T23:09:40.908 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:09:40.908 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.conf 2024-03-31T23:09:40.937 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:09:40.938 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:41.004 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:09:41.005 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.conf 2024-03-31T23:09:41.039 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:09:41.039 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:41.110 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:09:41.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.conf 2024-03-31T23:09:41.144 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:09:41.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:09:41.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:41 smithi042 ceph-mon[32380]: Reconfiguring mon.a (unknown last config time)... 2024-03-31T23:09:41.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:41 smithi042 ceph-mon[32380]: Reconfiguring daemon mon.a on smithi042 2024-03-31T23:09:41.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:41.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:41 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3589639161' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:41.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:41 smithi042 ceph-mon[32380]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:41.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:41.214 INFO:tasks.cephadm:Adding mgr.x on smithi042 2024-03-31T23:09:41.217 INFO:tasks.cephadm:Adding mgr.y on smithi094 2024-03-31T23:09:41.217 INFO:tasks.cephadm:Adding mgr.z on smithi188 2024-03-31T23:09:41.217 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch apply mgr '3;smithi042=x;smithi094=y;smithi188=z' 2024-03-31T23:09:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:41 smithi094 ceph-mon[36167]: Reconfiguring mon.a (unknown last config time)... 2024-03-31T23:09:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:41 smithi094 ceph-mon[36167]: Reconfiguring daemon mon.a on smithi042 2024-03-31T23:09:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:41 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3589639161' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:41 smithi094 ceph-mon[36167]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:41.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:41 smithi188 ceph-mon[36068]: Reconfiguring mon.a (unknown last config time)... 2024-03-31T23:09:41.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:41 smithi188 ceph-mon[36068]: Reconfiguring daemon mon.a on smithi042 2024-03-31T23:09:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:09:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:41 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3589639161' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:41 smithi188 ceph-mon[36068]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:41.489 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:09:42.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 -- 172.21.15.188:0/2128100949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c100ca0 msgr2=0x7fe92c1010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 --2- 172.21.15.188:0/2128100949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c100ca0 0x7fe92c1010c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009910 tx=0x7fe91c009c20 comp rx=0 tx=0).stop 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 -- 172.21.15.188:0/2128100949 shutdown_connections 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 --2- 172.21.15.188:0/2128100949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c100ca0 0x7fe92c1010c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 -- 172.21.15.188:0/2128100949 >> 172.21.15.188:0/2128100949 conn(0x7fe92c0fc240 msgr2=0x7fe92c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 -- 172.21.15.188:0/2128100949 shutdown_connections 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 -- 172.21.15.188:0/2128100949 wait complete. 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 Processor -- start 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.960+0000 7fe932893700 1 -- start start 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe932893700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe92c100ca0 0x7fe92c06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe932893700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 0x7fe92c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe932893700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c19cd60 0x7fe92c19f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:42.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe932893700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c106e20 con 0x7fe92c19cd60 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe932893700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c106ca0 con 0x7fe92c100ca0 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe932893700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c106fa0 con 0x7fe92c19a390 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 0x7fe92c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 0x7fe92c19c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:42262/0 (socket says 172.21.15.188:42262) 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 -- 172.21.15.188:0/1404940645 learned_addr learned my addr 172.21.15.188:0/1404940645 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92bfff700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe92c100ca0 0x7fe92c06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe930e30700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c19cd60 0x7fe92c19f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 -- 172.21.15.188:0/1404940645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe92c100ca0 msgr2=0x7fe92c06afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe92c100ca0 0x7fe92c06afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 -- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c19cd60 msgr2=0x7fe92c19f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c19cd60 0x7fe92c19f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 -- 172.21.15.188:0/1404940645 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c19fac0 con 0x7fe92c19a390 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe930e30700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c19cd60 0x7fe92c19f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:09:42.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.961+0000 7fe92b7fe700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 0x7fe92c19c780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe92000b780 tx=0x7fe92000ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.962+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920004230 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.962+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c19fdb0 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.962+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe9200043d0 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.962+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920011c50 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.962+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c1a02f0 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.963+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fe92001a400 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.963+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92c063870 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.963+0000 7fe9297fa700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe914039330 0x7fe91403b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.963+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe92004b9c0 con 0x7fe92c19a390 2024-03-31T23:09:42.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.963+0000 7fe92bfff700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe914039330 0x7fe91403b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:42.967 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.963+0000 7fe92bfff700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe914039330 0x7fe91403b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00b5c0 tx=0x7fe91c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:42.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:42.968+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe92004de20 con 0x7fe92c19a390 2024-03-31T23:09:43.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:43.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:43.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: Reconfiguring mon.b (monmap changed)... 2024-03-31T23:09:43.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:43.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:43.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:43.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: Reconfiguring daemon mon.b on smithi094 2024-03-31T23:09:43.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:42 smithi042 ceph-mon[32380]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: Reconfiguring mon.b (monmap changed)... 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: Reconfiguring daemon mon.b on smithi094 2024-03-31T23:09:43.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:42 smithi094 ceph-mon[36167]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:43.175 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.174+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi094=y;smithi188=z", "target": ["mon-mgr", ""]}) -- 0x7fe92c062680 con 0x7fe914039330 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: Reconfiguring mon.b (monmap changed)... 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: Reconfiguring daemon mon.b on smithi094 2024-03-31T23:09:43.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:42 smithi188 ceph-mon[36068]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:43.181 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.180+0000 7fe9297fa700 1 -- 172.21.15.188:0/1404940645 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe92c062680 con 0x7fe914039330 2024-03-31T23:09:43.181 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mgr update... 2024-03-31T23:09:43.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe914039330 msgr2=0x7fe91403b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:43.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe914039330 0x7fe91403b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00b5c0 tx=0x7fe91c01a040 comp rx=0 tx=0).stop 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 msgr2=0x7fe92c19c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 0x7fe92c19c780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe92000b780 tx=0x7fe92000ba90 comp rx=0 tx=0).stop 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 shutdown_connections 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe914039330 0x7fe91403b7f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe92c19cd60 0x7fe92c19f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe92c100ca0 0x7fe92c06afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 --2- 172.21.15.188:0/1404940645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe92c19a390 0x7fe92c19c780 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.182+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 >> 172.21.15.188:0/1404940645 conn(0x7fe92c0fc240 msgr2=0x7fe92c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.183+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 shutdown_connections 2024-03-31T23:09:43.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:09:43.183+0000 7fe932893700 1 -- 172.21.15.188:0/1404940645 wait complete. 2024-03-31T23:09:43.761 DEBUG:teuthology.orchestra.run.smithi094:mgr.y> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.y.service 2024-03-31T23:09:43.764 DEBUG:teuthology.orchestra.run.smithi188:mgr.z> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.z.service 2024-03-31T23:09:43.766 INFO:tasks.cephadm:Deploying OSDs... 2024-03-31T23:09:43.766 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:09:43.766 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-03-31T23:09:43.786 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-31T23:09:43.786 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-03-31T23:09:43.844 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-31T23:09:43.844 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:43.844 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-31T23:09:43.845 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:43.845 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:43.845 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-31 23:08:50.136576664 +0000 2024-03-31T23:09:43.845 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-31 23:04:04.297660131 +0000 2024-03-31T23:09:43.845 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-31 23:04:04.297660131 +0000 2024-03-31T23:09:43.845 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-31 23:04:04.297660131 +0000 2024-03-31T23:09:43.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-31T23:09:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-31T23:09:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-31T23:09:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00012715 s, 4.0 MB/s 2024-03-31T23:09:43.917 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-31T23:09:43.975 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-31 23:08:50.173576367 +0000 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-31 23:04:04.626657667 +0000 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-31 23:04:04.626657667 +0000 2024-03-31T23:09:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-31 23:04:04.626657667 +0000 2024-03-31T23:09:44.033 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-31T23:09:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-31T23:09:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-31T23:09:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000100179 s, 5.1 MB/s 2024-03-31T23:09:44.102 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-31T23:09:44.158 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-03-31T23:09:44.214 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-31T23:09:44.214 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-31 23:08:50.223575965 +0000 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-31 23:04:04.984654985 +0000 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-31 23:04:04.984654985 +0000 2024-03-31T23:09:44.215 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-31 23:04:04.984654985 +0000 2024-03-31T23:09:44.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-31T23:09:44.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi094=y;smithi188=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:44.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: Saving service mgr spec with placement smithi042=x;smithi094=y;smithi188=z;count:3 2024-03-31T23:09:44.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: Reconfiguring mon.c (monmap changed)... 2024-03-31T23:09:44.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:44.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:44.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:44.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:44 smithi188 ceph-mon[36068]: Reconfiguring daemon mon.c on smithi188 2024-03-31T23:09:44.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-31T23:09:44.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-31T23:09:44.281 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000109041 s, 4.7 MB/s 2024-03-31T23:09:44.282 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-31T23:09:44.338 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-03-31T23:09:44.393 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-31T23:09:44.393 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:44.393 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-31T23:09:44.393 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:44.394 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:44.394 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-31 23:08:50.270575588 +0000 2024-03-31T23:09:44.394 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-31 23:04:05.339652326 +0000 2024-03-31T23:09:44.394 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-31 23:04:05.339652326 +0000 2024-03-31T23:09:44.394 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-31 23:04:05.339652326 +0000 2024-03-31T23:09:44.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi094=y;smithi188=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: Saving service mgr spec with placement smithi042=x;smithi094=y;smithi188=z;count:3 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: Reconfiguring mon.c (monmap changed)... 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:44.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:44 smithi042 ceph-mon[32380]: Reconfiguring daemon mon.c on smithi188 2024-03-31T23:09:44.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-31T23:09:44.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-31T23:09:44.460 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000106129 s, 4.8 MB/s 2024-03-31T23:09:44.461 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-31T23:09:44.517 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-31T23:09:44.517 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-03-31T23:09:44.536 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-31T23:09:44.536 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-03-31T23:09:44.594 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-31T23:09:44.594 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-31 23:09:31.590833600 +0000 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-31 23:04:15.681081586 +0000 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-31 23:04:15.681081586 +0000 2024-03-31T23:09:44.595 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-31 23:04:15.681081586 +0000 2024-03-31T23:09:44.595 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-31T23:09:44.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi094=y;smithi188=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: Saving service mgr spec with placement smithi042=x;smithi094=y;smithi188=z;count:3 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: Reconfiguring mon.c (monmap changed)... 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:44 smithi094 ceph-mon[36167]: Reconfiguring daemon mon.c on smithi188 2024-03-31T23:09:44.663 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-31T23:09:44.664 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-31T23:09:44.664 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000118232 s, 4.3 MB/s 2024-03-31T23:09:44.665 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-31T23:09:44.723 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-31 23:09:31.591833583 +0000 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-31 23:04:16.032075570 +0000 2024-03-31T23:09:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-31 23:04:16.032075570 +0000 2024-03-31T23:09:44.781 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-31 23:04:16.032075570 +0000 2024-03-31T23:09:44.781 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-31T23:09:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-31T23:09:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-31T23:09:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.00012161 s, 4.2 MB/s 2024-03-31T23:09:44.850 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-31T23:09:44.906 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-31 23:09:31.591833583 +0000 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-31 23:04:16.359069964 +0000 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-31 23:04:16.359069964 +0000 2024-03-31T23:09:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-31 23:04:16.359069964 +0000 2024-03-31T23:09:44.962 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-31T23:09:45.027 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-31T23:09:45.028 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-31T23:09:45.028 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000116472 s, 4.4 MB/s 2024-03-31T23:09:45.029 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-31T23:09:45.085 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-03-31T23:09:45.140 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-31T23:09:45.140 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:45.140 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-03-31T23:09:45.141 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:45.141 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:45.141 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-31 23:09:31.591833583 +0000 2024-03-31T23:09:45.141 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-31 23:04:16.684064392 +0000 2024-03-31T23:09:45.141 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-31 23:04:16.684064392 +0000 2024-03-31T23:09:45.141 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-31 23:04:16.684064392 +0000 2024-03-31T23:09:45.141 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-31T23:09:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-31T23:09:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-31T23:09:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.00011168 s, 4.6 MB/s 2024-03-31T23:09:45.207 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-31T23:09:45.263 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-03-31T23:09:45.263 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-03-31T23:09:45.280 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-31T23:09:45.280 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-03-31 23:09:22.785484445 +0000 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-03-31 23:04:20.555566537 +0000 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-03-31 23:04:20.555566537 +0000 2024-03-31T23:09:45.335 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-03-31 23:04:20.555566537 +0000 2024-03-31T23:09:45.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-31T23:09:45.403 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-03-31T23:09:45.403 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-03-31T23:09:45.404 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000250709 s, 2.0 MB/s 2024-03-31T23:09:45.405 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-31T23:09:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:45 smithi094 ceph-mon[36167]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:45 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:45 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:45 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:45.460 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-03-31T23:09:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:45 smithi188 ceph-mon[36068]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:45 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:45 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:45 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-03-31 23:09:22.785484445 +0000 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-03-31 23:04:20.912559777 +0000 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-03-31 23:04:20.912559777 +0000 2024-03-31T23:09:45.482 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-03-31 23:04:20.912559777 +0000 2024-03-31T23:09:45.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-31T23:09:45.548 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-03-31T23:09:45.549 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-03-31T23:09:45.549 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000189567 s, 2.7 MB/s 2024-03-31T23:09:45.550 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-31T23:09:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:45 smithi042 ceph-mon[32380]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:45 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:45 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:45 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:45.605 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-03-31T23:09:45.660 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-31T23:09:45.660 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 699 Links: 1 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-03-31 23:09:22.786484426 +0000 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-03-31 23:04:21.269553017 +0000 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-03-31 23:04:21.269553017 +0000 2024-03-31T23:09:45.661 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-03-31 23:04:21.269553017 +0000 2024-03-31T23:09:45.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-31T23:09:45.726 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-03-31T23:09:45.726 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-03-31T23:09:45.726 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000211952 s, 2.4 MB/s 2024-03-31T23:09:45.727 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-31T23:09:45.783 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-03-31 23:09:22.786484426 +0000 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-03-31 23:04:21.617546428 +0000 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-03-31 23:04:21.617546428 +0000 2024-03-31T23:09:45.838 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-03-31 23:04:21.617546428 +0000 2024-03-31T23:09:45.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-31T23:09:45.908 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-03-31T23:09:45.908 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-03-31T23:09:45.908 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000218256 s, 2.3 MB/s 2024-03-31T23:09:45.909 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-31T23:09:45.965 INFO:tasks.cephadm:Deploying osd.0 on smithi042 with /dev/vg_nvme/lv_4... 2024-03-31T23:09:45.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-31T23:09:46.205 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:46.323 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:46 smithi042 ceph-mon[32380]: Deploying daemon mgr.z on smithi188 2024-03-31T23:09:46.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:46.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:46.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:46.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:46.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-31T23:09:46.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:46.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:46.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:46 smithi188 ceph-mon[36068]: Deploying daemon mgr.z on smithi188 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:46 smithi094 ceph-mon[36167]: Deploying daemon mgr.z on smithi188 2024-03-31T23:09:47.441 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:47 smithi188 ceph-mon[36068]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:47.442 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 systemd[1]: Starting Ceph mgr.z for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:09:47.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:47 smithi042 ceph-mon[32380]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:47.671 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:47 smithi094 ceph-mon[36167]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:47.719 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 podman[37903]: 2024-03-31 23:09:47.343925645 +0000 UTC m=+0.017784310 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:09:47.719 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 podman[37903]: 2024-03-31 23:09:47.443092413 +0000 UTC m=+0.116951060 container create 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-31T23:09:47.719 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 podman[37903]: 2024-03-31 23:09:47.645538235 +0000 UTC m=+0.319396898 container init 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-31T23:09:47.719 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 podman[37903]: 2024-03-31 23:09:47.647952946 +0000 UTC m=+0.321811593 container start 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-31T23:09:47.719 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 ceph-mgr[37922]: -- 172.21.15.188:0/3856409206 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8ae43c5a0 con 0x55a8ae410c00 2024-03-31T23:09:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-31T23:09:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-31T23:09:48.042 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 10+0 records in 2024-03-31T23:09:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:10+0 records out 2024-03-31T23:09:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00842881 s, 1.2 GB/s 2024-03-31T23:09:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping successful for: 2024-03-31T23:09:48.202 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 bash[37903]: 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c 2024-03-31T23:09:48.202 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:47 smithi188 systemd[1]: Started Ceph mgr.z for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:09:48.468 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:48.201+0000 7fa7a6882200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:09:48.468 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:48.293+0000 7fa7a6882200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:09:48.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi042:vg_nvme/lv_4 2024-03-31T23:09:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: Deploying daemon mgr.y on smithi094 2024-03-31T23:09:49.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:48 smithi042 ceph-mon[32380]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: Deploying daemon mgr.y on smithi094 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-mon[36068]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:49.169 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:48.934+0000 7fa7a6882200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:09:49.170 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.026+0000 7fa7a6882200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:09:49.170 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.166+0000 7fa7a6882200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: Deploying daemon mgr.y on smithi094 2024-03-31T23:09:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:48 smithi094 ceph-mon[36167]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:49.468 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.261+0000 7fa7a6882200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:09:49.469 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.343+0000 7fa7a6882200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:09:49.892 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.605+0000 7fa7a6882200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:09:49.893 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.713+0000 7fa7a6882200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:09:49.893 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.798+0000 7fa7a6882200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:09:49.893 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:49.890+0000 7fa7a6882200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:09:49.922 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:49 smithi094 systemd[1]: Starting Ceph mgr.y for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:09:50.182 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:50.067+0000 7fa7a6882200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 -- 172.21.15.42:0/2798147181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc1023a0 msgr2=0x7fe1fc102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 --2- 172.21.15.42:0/2798147181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc1023a0 0x7fe1fc102800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00099c0 tx=0x7fe1f0009cd0 comp rx=0 tx=0).stop 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 -- 172.21.15.42:0/2798147181 shutdown_connections 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 --2- 172.21.15.42:0/2798147181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 --2- 172.21.15.42:0/2798147181 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc102d40 0x7fe1fc1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 --2- 172.21.15.42:0/2798147181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc1023a0 0x7fe1fc102800 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 -- 172.21.15.42:0/2798147181 >> 172.21.15.42:0/2798147181 conn(0x7fe1fc0fc760 msgr2=0x7fe1fc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 -- 172.21.15.42:0/2798147181 shutdown_connections 2024-03-31T23:09:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.207+0000 7fe200fb0700 1 -- 172.21.15.42:0/2798147181 wait complete. 2024-03-31T23:09:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 Processor -- start 2024-03-31T23:09:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 -- start start 2024-03-31T23:09:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1fc1023a0 0x7fe1fc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc102d40 0x7fe1fc19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc10ced0 con 0x7fe1fc102d40 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc10cd50 con 0x7fe1fc1011a0 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe200fb0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc10d050 con 0x7fe1fc1023a0 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:53178/0 (socket says 172.21.15.42:53178) 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc102d40 0x7fe1fc19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 -- 172.21.15.42:0/1439145716 learned_addr learned my addr 172.21.15.42:0/1439145716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1f9d9b700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1fc1023a0 0x7fe1fc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 -- 172.21.15.42:0/1439145716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1fc1023a0 msgr2=0x7fe1fc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1fc1023a0 0x7fe1fc198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 -- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc102d40 msgr2=0x7fe1fc19fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc102d40 0x7fe1fc19fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:09:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 -- 172.21.15.42:0/1439145716 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc1a01c0 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.208+0000 7fe1fa59c700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1985b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400e950 tx=0x7fe1f400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4004230 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe1f40043d0 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc1a04b0 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4010430 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1fc1a09a0 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fe1f40105d0 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.209+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1fc068f00 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.210+0000 7fe1eb7fe700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe1e40390e0 0x7fe1e403b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.210+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe1f404c370 con 0x7fe1fc1011a0 2024-03-31T23:09:50.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.210+0000 7fe1f9d9b700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe1e40390e0 0x7fe1e403b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:09:50.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.210+0000 7fe1f9d9b700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe1e40390e0 0x7fe1e403b5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0000c00 tx=0x7fe1f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:09:50.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.215+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe1f401fbb0 con 0x7fe1fc1011a0 2024-03-31T23:09:50.237 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:49 smithi094 podman[37536]: 2024-03-31 23:09:49.850411615 +0000 UTC m=+0.017559189 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:09:50.237 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:49 smithi094 podman[37536]: 2024-03-31 23:09:49.965080544 +0000 UTC m=+0.132228109 container create 595da78b082b0274fbb7fad47c231138cef1a8cf96c548e8339b332279e68154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:09:50.237 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 podman[37536]: 2024-03-31 23:09:50.169815334 +0000 UTC m=+0.336962908 container init 595da78b082b0274fbb7fad47c231138cef1a8cf96c548e8339b332279e68154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-31T23:09:50.237 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 podman[37536]: 2024-03-31 23:09:50.172630977 +0000 UTC m=+0.339778556 container start 595da78b082b0274fbb7fad47c231138cef1a8cf96c548e8339b332279e68154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-31T23:09:50.237 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 ceph-mgr[37556]: -- 172.21.15.94:0/1940176931 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5592ebc545a0 con 0x5592ebc28c00 2024-03-31T23:09:50.237 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 bash[37536]: 595da78b082b0274fbb7fad47c231138cef1a8cf96c548e8339b332279e68154 2024-03-31T23:09:50.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:50.443+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe1fc0fe970 con 0x7fe1e40390e0 2024-03-31T23:09:50.507 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 systemd[1]: Started Ceph mgr.y for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:09:50.844 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:50.745+0000 7fb6ea599200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:09:50.845 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:50.843+0000 7fb6ea599200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:09:51.370 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:51.094+0000 7fa7a6882200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:09:51.370 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:51.234+0000 7fa7a6882200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:09:51.370 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.370 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:51.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:51.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:51.547+0000 7fb6ea599200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:51.581 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:51.582 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:51.672 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:51.580+0000 7fa7a6882200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:09:51.672 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:51.670+0000 7fa7a6882200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:09:51.886 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:51.641+0000 7fb6ea599200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:09:51.886 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:51.787+0000 7fb6ea599200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:09:51.886 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:51.885+0000 7fb6ea599200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:09:51.968 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:51.882+0000 7fa7a6882200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:09:52.172 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:51.969+0000 7fb6ea599200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:09:52.361 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:52.077+0000 7fa7a6882200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:09:52.521 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:52.233+0000 7fb6ea599200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:09:52.521 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:52.341+0000 7fb6ea599200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:09:52.521 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:52.426+0000 7fb6ea599200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:09:52.521 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:52.520+0000 7fb6ea599200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:09:52.622 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:52.360+0000 7fa7a6882200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:09:52.622 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:52.621+0000 7fa7a6882200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:09:52.822 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:52.694+0000 7fb6ea599200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:09:52.968 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:52.858+0000 7fa7a6882200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: Reconfiguring mgr.x (unknown last config time)... 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: Reconfiguring daemon mgr.x on smithi042 2024-03-31T23:09:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:52 smithi188 ceph-mon[36068]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: Reconfiguring mgr.x (unknown last config time)... 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: Reconfiguring daemon mgr.x on smithi042 2024-03-31T23:09:53.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:52 smithi042 ceph-mon[32380]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: Reconfiguring mgr.x (unknown last config time)... 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-31T23:09:53.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-31T23:09:53.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:53.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: Reconfiguring daemon mgr.x on smithi042 2024-03-31T23:09:53.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:52 smithi094 ceph-mon[36167]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:53.922 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:53.650+0000 7fb6ea599200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:09:53.922 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:53.780+0000 7fb6ea599200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:09:53.935 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:53.657+0000 7fa7a6882200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:09:54.199 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:54.112+0000 7fb6ea599200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:09:54.200 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:54.198+0000 7fb6ea599200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:09:54.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/4045285598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f"}]: dispatch 2024-03-31T23:09:54.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/4045285598' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f"}]': finished 2024-03-31T23:09:54.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-mon[36167]: osdmap e5: 1 total, 0 up, 1 in 2024-03-31T23:09:54.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:09:54.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/81017438' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:09:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/4045285598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f"}]: dispatch 2024-03-31T23:09:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/4045285598' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f"}]': finished 2024-03-31T23:09:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:53 smithi188 ceph-mon[36068]: osdmap e5: 1 total, 0 up, 1 in 2024-03-31T23:09:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:53 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:09:54.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/81017438' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:09:54.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4045285598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f"}]: dispatch 2024-03-31T23:09:54.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4045285598' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f"}]': finished 2024-03-31T23:09:54.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:53 smithi042 ceph-mon[32380]: osdmap e5: 1 total, 0 up, 1 in 2024-03-31T23:09:54.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:09:54.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/81017438' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:09:54.539 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:54.228+0000 7fa7a6882200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:09:54.539 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:54.324+0000 7fa7a6882200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:09:54.539 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:09:54.538+0000 7fa7a6882200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:09:54.570 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:54.388+0000 7fb6ea599200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:09:54.570 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:54.569+0000 7fb6ea599200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:09:54.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:54.942+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mgrmap(e 14) ==== 91718+0+0 (secure 0 0 0) 0x7fe1f4007d10 con 0x7fe1fc1011a0 2024-03-31T23:09:55.102 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:54.845+0000 7fb6ea599200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:09:55.102 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:55.101+0000 7fb6ea599200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:09:55.102 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-mon[36167]: Standby manager daemon z started 2024-03-31T23:09:55.102 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-31T23:09:55.102 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:09:55.102 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-31T23:09:55.103 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:09:55.103 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:54 smithi094 ceph-mon[36167]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:55.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-mon[36068]: Standby manager daemon z started 2024-03-31T23:09:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-31T23:09:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:09:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-31T23:09:55.301 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:09:55.301 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:54 smithi188 ceph-mon[36068]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:55.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:54 smithi042 ceph-mon[32380]: Standby manager daemon z started 2024-03-31T23:09:55.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:54 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-31T23:09:55.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:54 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:09:55.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:54 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-31T23:09:55.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:54 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/2848175379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:09:55.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:54 smithi042 ceph-mon[32380]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:55.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:55.333+0000 7fb6ea599200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:09:56.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:55 smithi188 ceph-mon[36068]: mgrmap e14: x(active, since 74s), standbys: z 2024-03-31T23:09:56.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-31T23:09:56.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:55 smithi042 ceph-mon[32380]: mgrmap e14: x(active, since 74s), standbys: z 2024-03-31T23:09:56.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-31T23:09:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:55 smithi094 ceph-mon[36167]: mgrmap e14: x(active, since 74s), standbys: z 2024-03-31T23:09:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-31T23:09:56.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:56.119+0000 7fb6ea599200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:09:56.946 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:56.679+0000 7fb6ea599200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:09:56.946 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:56.775+0000 7fb6ea599200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:09:57.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:56 smithi188 ceph-mon[36068]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:57.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:56 smithi042 ceph-mon[32380]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:57.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:56 smithi094 ceph-mon[36167]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:57.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:09:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:09:56.986+0000 7fb6ea599200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:09:57.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:09:57.955+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mon.2 v2:172.21.15.94:3300/0 8 ==== mgrmap(e 15) ==== 137264+0+0 (secure 0 0 0) 0x7fe1f400ace0 con 0x7fe1fc1011a0 2024-03-31T23:09:58.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:57 smithi188 ceph-mon[36068]: Standby manager daemon y started 2024-03-31T23:09:58.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:57 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-31T23:09:58.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:57 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:09:58.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:57 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-31T23:09:58.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:57 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:09:58.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:57 smithi042 ceph-mon[32380]: Standby manager daemon y started 2024-03-31T23:09:58.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:57 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-31T23:09:58.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:57 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:09:58.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:57 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-31T23:09:58.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:57 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:09:58.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:57 smithi094 ceph-mon[36167]: Standby manager daemon y started 2024-03-31T23:09:58.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:57 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-31T23:09:58.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:57 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:09:58.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:57 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-31T23:09:58.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:57 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3810470279' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: mgrmap e15: x(active, since 77s), standbys: z, y 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:09:58 smithi042 ceph-mon[32380]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:59.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: mgrmap e15: x(active, since 77s), standbys: z, y 2024-03-31T23:09:59.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:09:58 smithi188 ceph-mon[36068]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:09:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: mgrmap e15: x(active, since 77s), standbys: z, y 2024-03-31T23:09:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-31T23:09:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:09:59.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:09:59.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:09:59.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:09:59.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:09:58 smithi094 ceph-mon[36167]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:00.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:00 smithi042 ceph-mon[32380]: overall HEALTH_OK 2024-03-31T23:10:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:00 smithi094 ceph-mon[36167]: overall HEALTH_OK 2024-03-31T23:10:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:00 smithi188 ceph-mon[36068]: overall HEALTH_OK 2024-03-31T23:10:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-31T23:10:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:01 smithi094 ceph-mon[36167]: Deploying daemon osd.0 on smithi042 2024-03-31T23:10:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:01 smithi094 ceph-mon[36167]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:01.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-31T23:10:01.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:01.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:01 smithi188 ceph-mon[36068]: Deploying daemon osd.0 on smithi042 2024-03-31T23:10:01.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:01 smithi188 ceph-mon[36068]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:01.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-31T23:10:01.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:01.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:01 smithi042 ceph-mon[32380]: Deploying daemon osd.0 on smithi042 2024-03-31T23:10:01.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:01 smithi042 ceph-mon[32380]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:03.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:02 smithi042 ceph-mon[32380]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:03.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:02 smithi094 ceph-mon[36167]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:03.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:02 smithi188 ceph-mon[36068]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:04.985 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:04 smithi042 ceph-mon[32380]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:05.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:04 smithi094 ceph-mon[36167]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:05.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:04 smithi188 ceph-mon[36068]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:07.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:07.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:07.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:06 smithi042 ceph-mon[32380]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:07.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:07.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:07.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:07.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:06 smithi094 ceph-mon[36167]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:07.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:07.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:07.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:07.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:06 smithi188 ceph-mon[36068]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:09.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:09.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:09.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:09 smithi042 ceph-mon[32380]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:09.225 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 0 on host 'smithi042' 2024-03-31T23:10:09.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.223+0000 7fe1eb7fe700 1 -- 172.21.15.42:0/1439145716 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe1fc0fe970 con 0x7fe1e40390e0 2024-03-31T23:10:09.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.225+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe1e40390e0 msgr2=0x7fe1e403b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.225+0000 7fe200fb0700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe1e40390e0 0x7fe1e403b5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0000c00 tx=0x7fe1f0005fb0 comp rx=0 tx=0).stop 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 msgr2=0x7fe1fc1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1985b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400e950 tx=0x7fe1f400ec60 comp rx=0 tx=0).stop 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 shutdown_connections 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe1e40390e0 0x7fe1e403b5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1fc102d40 0x7fe1fc19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1fc1011a0 0x7fe1fc1985b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 --2- 172.21.15.42:0/1439145716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1fc1023a0 0x7fe1fc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 >> 172.21.15.42:0/1439145716 conn(0x7fe1fc0fc760 msgr2=0x7fe1fc0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 shutdown_connections 2024-03-31T23:10:09.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:10:09.226+0000 7fe200fb0700 1 -- 172.21.15.42:0/1439145716 wait complete. 2024-03-31T23:10:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:09 smithi094 ceph-mon[36167]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:09.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:09.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:09.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:09.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:09 smithi188 ceph-mon[36068]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:09.825 DEBUG:teuthology.orchestra.run.smithi042:osd.0> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.0.service 2024-03-31T23:10:09.827 INFO:tasks.cephadm:Deploying osd.1 on smithi094 with /dev/vg_nvme/lv_4... 2024-03-31T23:10:09.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-31T23:10:10.070 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:10:10.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:10 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:10.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:10 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:10.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:10 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:10.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:10 smithi188 ceph-mon[36068]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-31T23:10:10.517 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:10 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:10.517 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:10 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:10.517 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:10 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:10.517 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:10 smithi094 ceph-mon[36167]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-31T23:10:10.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:10 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:10.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:10 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:10.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:10 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:10.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:10 smithi042 ceph-mon[32380]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-31T23:10:11.239 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-mon[32380]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-31T23:10:11.239 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-mon[32380]: osdmap e6: 1 total, 0 up, 1 in 2024-03-31T23:10:11.239 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-mon[32380]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:10:11.239 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:11.239 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-mon[32380]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:11.297 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:11 smithi094 ceph-mon[36167]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-31T23:10:11.298 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:11 smithi094 ceph-mon[36167]: osdmap e6: 1 total, 0 up, 1 in 2024-03-31T23:10:11.298 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:11 smithi094 ceph-mon[36167]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:10:11.298 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:11 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:11.298 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:11 smithi094 ceph-mon[36167]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:11.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:11 smithi188 ceph-mon[36068]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-31T23:10:11.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:11 smithi188 ceph-mon[36068]: osdmap e6: 1 total, 0 up, 1 in 2024-03-31T23:10:11.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:11 smithi188 ceph-mon[36068]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:10:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:11 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:11 smithi188 ceph-mon[36068]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:11.831 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-31T23:10:11.831 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-31T23:10:11.831 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-03-31T23:10:11.831 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-03-31T23:10:11.831 INFO:teuthology.orchestra.run.smithi094.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00810895 s, 1.3 GB/s 2024-03-31T23:10:11.831 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-03-31T23:10:12.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0[44792]: 2024-03-31T23:10:11.652+0000 7f1a12bc5700 -1 osd.0 0 waiting for initial osdmap 2024-03-31T23:10:12.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:10:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0[44792]: 2024-03-31T23:10:11.656+0000 7f1a0a1af700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:10:12.445 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:12 smithi094 ceph-mon[36167]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:10:12.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:12 smithi094 ceph-mon[36167]: osdmap e7: 1 total, 0 up, 1 in 2024-03-31T23:10:12.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:12.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:12.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:12 smithi094 ceph-mon[36167]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' 2024-03-31T23:10:12.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi094:vg_nvme/lv_4 2024-03-31T23:10:12.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:12 smithi188 ceph-mon[36068]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:10:12.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:12 smithi188 ceph-mon[36068]: osdmap e7: 1 total, 0 up, 1 in 2024-03-31T23:10:12.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:12.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:12.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:12 smithi188 ceph-mon[36068]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' 2024-03-31T23:10:12.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:12 smithi042 ceph-mon[32380]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:10:12.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:12 smithi042 ceph-mon[32380]: osdmap e7: 1 total, 0 up, 1 in 2024-03-31T23:10:12.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:12.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:12.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:12 smithi042 ceph-mon[32380]: from='osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305]' entity='osd.0' 2024-03-31T23:10:12.687 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:10:13.415 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:10:13.415 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] boot 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: osdmap e8: 1 total, 1 up, 1 in 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:13.416 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] boot 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: osdmap e8: 1 total, 1 up, 1 in 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: osd.0 [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] boot 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: osdmap e8: 1 total, 1 up, 1 in 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:14.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.195+0000 7fd9e33f0700 1 -- 172.21.15.94:0/3807509206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc102d70 msgr2=0x7fd9dc105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:14.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.195+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/3807509206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc102d70 0x7fd9dc105160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009990 tx=0x7fd9d8009ca0 comp rx=0 tx=0).stop 2024-03-31T23:10:14.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.195+0000 7fd9e33f0700 1 -- 172.21.15.94:0/3807509206 shutdown_connections 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/3807509206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/3807509206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc102d70 0x7fd9dc105160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/3807509206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9dc1056a0 0x7fd9dc107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- 172.21.15.94:0/3807509206 >> 172.21.15.94:0/3807509206 conn(0x7fd9dc0fc7a0 msgr2=0x7fd9dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- 172.21.15.94:0/3807509206 shutdown_connections 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- 172.21.15.94:0/3807509206 wait complete. 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 Processor -- start 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- start start 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9dc102d70 0x7fd9dc1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc1056a0 0x7fd9dc198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:14.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc10e080 con 0x7fd9dc1056a0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc10df00 con 0x7fd9dc107fd0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e33f0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc10e200 con 0x7fd9dc102d70 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e198d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.196+0000 7fd9e198d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52486/0 (socket says 172.21.15.94:52486) 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 -- 172.21.15.94:0/629043655 learned_addr learned my addr 172.21.15.94:0/629043655 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e098b700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc1056a0 0x7fd9dc198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e118c700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9dc102d70 0x7fd9dc1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 -- 172.21.15.94:0/629043655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9dc102d70 msgr2=0x7fd9dc1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9dc102d70 0x7fd9dc1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 -- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc1056a0 msgr2=0x7fd9dc198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc1056a0 0x7fd9dc198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 -- 172.21.15.94:0/629043655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc1a02c0 con 0x7fd9dc107fd0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e198d700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc19fc20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b9e0 tx=0x7fd9d400bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:10:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4019070 con 0x7fd9dc107fd0 2024-03-31T23:10:14.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9d400ce30 con 0x7fd9dc107fd0 2024-03-31T23:10:14.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4014e60 con 0x7fd9dc107fd0 2024-03-31T23:10:14.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc1a05b0 con 0x7fd9dc107fd0 2024-03-31T23:10:14.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.197+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc1a0b20 con 0x7fd9dc107fd0 2024-03-31T23:10:14.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.198+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9dc068f00 con 0x7fd9dc107fd0 2024-03-31T23:10:14.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.199+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 15) ==== 137264+0+0 (secure 0 0 0) 0x7fd9d401c070 con 0x7fd9dc107fd0 2024-03-31T23:10:14.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.200+0000 7fd9d27fc700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c80a24a0 0x7fd9c80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:14.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.200+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fd9d40cc3e0 con 0x7fd9dc107fd0 2024-03-31T23:10:14.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.200+0000 7fd9e118c700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c80a24a0 0x7fd9c80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:14.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.201+0000 7fd9e118c700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c80a24a0 0x7fd9c80a4960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8003ad0 tx=0x7fd9d8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:10:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.204+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd9d409b010 con 0x7fd9dc107fd0 2024-03-31T23:10:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:14.407+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd9dc062680 con 0x7fd9c80a24a0 2024-03-31T23:10:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:14 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi042 2024-03-31T23:10:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:14 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi042 to 17093M 2024-03-31T23:10:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:14 smithi094 ceph-mon[36167]: osdmap e9: 1 total, 1 up, 1 in 2024-03-31T23:10:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:10:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:10:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:14.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:14 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi042 2024-03-31T23:10:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:14 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi042 to 17093M 2024-03-31T23:10:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:14 smithi188 ceph-mon[36068]: osdmap e9: 1 total, 1 up, 1 in 2024-03-31T23:10:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:10:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:10:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:15.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:14 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi042 2024-03-31T23:10:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:14 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi042 to 17093M 2024-03-31T23:10:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:14 smithi042 ceph-mon[32380]: osdmap e9: 1 total, 1 up, 1 in 2024-03-31T23:10:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:10:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:10:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:15.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:15 smithi094 ceph-mon[36167]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:10:15.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:15 smithi094 ceph-mon[36167]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:15.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:15 smithi188 ceph-mon[36068]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:10:15.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:15 smithi188 ceph-mon[36068]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:16.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:15 smithi042 ceph-mon[32380]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:10:16.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:15 smithi042 ceph-mon[32380]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:17.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:16 smithi042 ceph-mon[32380]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:17.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:16 smithi094 ceph-mon[36167]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:17.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:16 smithi188 ceph-mon[36068]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:17 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/3844880983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]: dispatch 2024-03-31T23:10:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:17 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]: dispatch 2024-03-31T23:10:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:17 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]': finished 2024-03-31T23:10:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:17 smithi042 ceph-mon[32380]: osdmap e10: 2 total, 1 up, 2 in 2024-03-31T23:10:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:17 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/3658384239' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:10:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:17 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/3844880983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]: dispatch 2024-03-31T23:10:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:17 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]: dispatch 2024-03-31T23:10:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:17 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]': finished 2024-03-31T23:10:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:17 smithi094 ceph-mon[36167]: osdmap e10: 2 total, 1 up, 2 in 2024-03-31T23:10:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:17 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:17 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/3658384239' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:10:18.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:17 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/3844880983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]: dispatch 2024-03-31T23:10:18.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:17 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]: dispatch 2024-03-31T23:10:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:17 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c72d11f-d1e4-429e-b066-1fc0cc75bc37"}]': finished 2024-03-31T23:10:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:17 smithi188 ceph-mon[36068]: osdmap e10: 2 total, 1 up, 2 in 2024-03-31T23:10:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:17 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:17 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/3658384239' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:10:19.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:18 smithi094 ceph-mon[36167]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:18 smithi042 ceph-mon[32380]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:19.120 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:18 smithi188 ceph-mon[36068]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:20.865 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:20 smithi094 ceph-mon[36167]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:21.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:20 smithi042 ceph-mon[32380]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:21.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:20 smithi188 ceph-mon[36068]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:23.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:22 smithi042 ceph-mon[32380]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:23.166 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:22 smithi094 ceph-mon[36167]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:22 smithi188 ceph-mon[36068]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-31T23:10:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-31T23:10:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:24.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-31T23:10:24.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:24 smithi094 ceph-mon[36167]: Deploying daemon osd.1 on smithi094 2024-03-31T23:10:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:24 smithi094 ceph-mon[36167]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:25.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:24 smithi042 ceph-mon[32380]: Deploying daemon osd.1 on smithi094 2024-03-31T23:10:25.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:24 smithi042 ceph-mon[32380]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:25.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:24 smithi188 ceph-mon[36068]: Deploying daemon osd.1 on smithi094 2024-03-31T23:10:25.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:24 smithi188 ceph-mon[36068]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:26 smithi094 ceph-mon[36167]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:27.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:26 smithi042 ceph-mon[32380]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:27.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:26 smithi188 ceph-mon[36068]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:28.908 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:28 smithi094 ceph-mon[36167]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:29.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:28 smithi042 ceph-mon[32380]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:29.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:28 smithi188 ceph-mon[36068]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:30.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:30.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:30.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:30.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:30.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:30.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:30.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:30.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:30.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:30 smithi094 ceph-mon[36167]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:31.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:30 smithi188 ceph-mon[36068]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:31.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:30 smithi042 ceph-mon[32380]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:32.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.324+0000 7fd9d27fc700 1 -- 172.21.15.94:0/629043655 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd9dc062680 con 0x7fd9c80a24a0 2024-03-31T23:10:32.326 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 1 on host 'smithi094' 2024-03-31T23:10:32.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c80a24a0 msgr2=0x7fd9c80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:32.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c80a24a0 0x7fd9c80a4960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8003ad0 tx=0x7fd9d8005fd0 comp rx=0 tx=0).stop 2024-03-31T23:10:32.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 msgr2=0x7fd9dc19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:32.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc19fc20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b9e0 tx=0x7fd9d400bcf0 comp rx=0 tx=0).stop 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 shutdown_connections 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c80a24a0 0x7fd9c80a4960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9dc102d70 0x7fd9dc1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9dc107fd0 0x7fd9dc19fc20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 --2- 172.21.15.94:0/629043655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc1056a0 0x7fd9dc198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 >> 172.21.15.94:0/629043655 conn(0x7fd9dc0fc7a0 msgr2=0x7fd9dc1036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 shutdown_connections 2024-03-31T23:10:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:10:32.326+0000 7fd9e33f0700 1 -- 172.21.15.94:0/629043655 wait complete. 2024-03-31T23:10:32.920 DEBUG:teuthology.orchestra.run.smithi094:osd.1> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.1.service 2024-03-31T23:10:32.922 INFO:tasks.cephadm:Deploying osd.2 on smithi188 with /dev/vg_nvme/lv_4... 2024-03-31T23:10:32.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-31T23:10:33.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:32 smithi094 ceph-mon[36167]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-31T23:10:33.185 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:10:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:33.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:33.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-31T23:10:33.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:32 smithi188 ceph-mon[36068]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-31T23:10:33.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-31T23:10:33.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:32 smithi042 ceph-mon[32380]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-31T23:10:34.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:34 smithi188 ceph-mon[36068]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-31T23:10:34.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:34 smithi188 ceph-mon[36068]: from='osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:10:34.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:34 smithi188 ceph-mon[36068]: osdmap e11: 2 total, 1 up, 2 in 2024-03-31T23:10:34.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:34 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:34.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:34 smithi188 ceph-mon[36068]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:10:34.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:34 smithi042 ceph-mon[32380]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-31T23:10:34.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:34 smithi042 ceph-mon[32380]: from='osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:10:34.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:34 smithi042 ceph-mon[32380]: osdmap e11: 2 total, 1 up, 2 in 2024-03-31T23:10:34.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:34 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:34.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:34 smithi042 ceph-mon[32380]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:10:34.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-mon[36167]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-31T23:10:34.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-mon[36167]: from='osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:10:34.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-mon[36167]: osdmap e11: 2 total, 1 up, 2 in 2024-03-31T23:10:34.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:34.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-mon[36167]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:10:34.673 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1[40749]: 2024-03-31T23:10:34.301+0000 7f9c503cb700 -1 osd.1 0 waiting for initial osdmap 2024-03-31T23:10:34.673 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:10:34 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1[40749]: 2024-03-31T23:10:34.305+0000 7f9c4c1be700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:10:35.155 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-31T23:10:35.155 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-31T23:10:35.155 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-03-31T23:10:35.155 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-03-31T23:10:35.155 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132216 s, 793 MB/s 2024-03-31T23:10:35.155 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-03-31T23:10:35.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:35 smithi188 ceph-mon[36068]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:10:35.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:35 smithi188 ceph-mon[36068]: osdmap e12: 2 total, 1 up, 2 in 2024-03-31T23:10:35.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:35 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:35.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:35 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:35.461 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:35 smithi188 ceph-mon[36068]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:35.574 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:35 smithi094 ceph-mon[36167]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:10:35.574 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:35 smithi094 ceph-mon[36167]: osdmap e12: 2 total, 1 up, 2 in 2024-03-31T23:10:35.574 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:35 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:35.574 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:35 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:35.574 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:35 smithi094 ceph-mon[36167]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:35.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:35 smithi042 ceph-mon[32380]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:10:35.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:35 smithi042 ceph-mon[32380]: osdmap e12: 2 total, 1 up, 2 in 2024-03-31T23:10:35.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:35 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:35.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:35 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:35.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:35 smithi042 ceph-mon[32380]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-31T23:10:35.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_4 2024-03-31T23:10:36.011 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] boot 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: osdmap e13: 2 total, 2 up, 2 in 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi094 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:36.425 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi094 to 17080M 2024-03-31T23:10:36.425 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.425 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:36.425 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:36.425 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] boot 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: osdmap e13: 2 total, 2 up, 2 in 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi094 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi094 to 17080M 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:36.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:36.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: osd.1 [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] boot 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: osdmap e13: 2 total, 2 up, 2 in 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:10:36.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi094 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi094 to 17080M 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:36.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 -- 172.21.15.188:0/1726957608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 msgr2=0x7f6910102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 --2- 172.21.15.188:0/1726957608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910102ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6900009990 tx=0x7f6900009ca0 comp rx=0 tx=0).stop 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 -- 172.21.15.188:0/1726957608 shutdown_connections 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 --2- 172.21.15.188:0/1726957608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910102ba0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 --2- 172.21.15.188:0/1726957608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6910101da0 0x7f6910109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 --2- 172.21.15.188:0/1726957608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69101013e0 0x7f6910101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 -- 172.21.15.188:0/1726957608 >> 172.21.15.188:0/1726957608 conn(0x7f69100fbeb0 msgr2=0x7f69100fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:10:37.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 -- 172.21.15.188:0/1726957608 shutdown_connections 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.440+0000 7f6916338700 1 -- 172.21.15.188:0/1726957608 wait complete. 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 Processor -- start 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 -- start start 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69101013e0 0x7f6910105180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6910101da0 0x7f69101037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910103d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f691010ce90 con 0x7f69101013e0 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f691010cd10 con 0x7f6910101da0 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f6916338700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f691010d010 con 0x7f6910102780 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910103d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910103d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:49648/0 (socket says 172.21.15.188:49648) 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 -- 172.21.15.188:0/2604290377 learned_addr learned my addr 172.21.15.188:0/2604290377 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:10:37.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f690ffff700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69101013e0 0x7f6910105180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f690f7fe700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6910101da0 0x7f69101037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 -- 172.21.15.188:0/2604290377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6910101da0 msgr2=0x7f69101037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6910101da0 0x7f69101037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 -- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69101013e0 msgr2=0x7f6910105180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.441+0000 7f69148d5700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69101013e0 0x7f6910105180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f69148d5700 1 -- 172.21.15.188:0/2604290377 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69101045c0 con 0x7f6910102780 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f69148d5700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910103d10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6908007ee0 tx=0x7f690800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690800dbd0 con 0x7f6910102780 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69101a2700 con 0x7f6910102780 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f690800dd70 con 0x7f6910102780 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080133f0 con 0x7f6910102780 2024-03-31T23:10:37.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.442+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101a2c10 con 0x7f6910102780 2024-03-31T23:10:37.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.443+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6910068f00 con 0x7f6910102780 2024-03-31T23:10:37.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.444+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 15) ==== 137264+0+0 (secure 0 0 0) 0x7f690801a020 con 0x7f6910102780 2024-03-31T23:10:37.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.445+0000 7f690d7fa700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f68f80a24a0 0x7f68f80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:10:37.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.445+0000 7f690ffff700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f68f80a24a0 0x7f68f80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:10:37.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.445+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f69080cc670 con 0x7f6910102780 2024-03-31T23:10:37.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.445+0000 7f690ffff700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f68f80a24a0 0x7f68f80a4960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69000039a0 tx=0x7f6900005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:10:37.450 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.450+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6908010070 con 0x7f6910102780 2024-03-31T23:10:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:37.649+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f69100fe000 con 0x7f68f80a24a0 2024-03-31T23:10:37.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:37 smithi188 ceph-mon[36068]: osdmap e14: 2 total, 2 up, 2 in 2024-03-31T23:10:37.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:37 smithi188 ceph-mon[36068]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:37.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:10:37.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:10:37.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:37 smithi094 ceph-mon[36167]: osdmap e14: 2 total, 2 up, 2 in 2024-03-31T23:10:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:37 smithi094 ceph-mon[36167]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:37 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:10:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:37 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:10:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:37 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:37 smithi042 ceph-mon[32380]: osdmap e14: 2 total, 2 up, 2 in 2024-03-31T23:10:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:37 smithi042 ceph-mon[32380]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:10:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:10:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:38.910 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:38 smithi188 ceph-mon[36068]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:10:38.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:38 smithi094 ceph-mon[36167]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:10:39.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:38 smithi042 ceph-mon[32380]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:10:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:39 smithi094 ceph-mon[36167]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:39.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:39 smithi188 ceph-mon[36068]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:39 smithi042 ceph-mon[32380]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:40.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:40 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/3249959173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]: dispatch 2024-03-31T23:10:40.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:40 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]: dispatch 2024-03-31T23:10:40.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:40 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]': finished 2024-03-31T23:10:40.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:40 smithi188 ceph-mon[36068]: osdmap e15: 3 total, 2 up, 3 in 2024-03-31T23:10:40.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:41.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:40 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/3249959173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]: dispatch 2024-03-31T23:10:41.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:40 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]: dispatch 2024-03-31T23:10:41.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:40 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]': finished 2024-03-31T23:10:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:40 smithi042 ceph-mon[32380]: osdmap e15: 3 total, 2 up, 3 in 2024-03-31T23:10:41.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:41.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:40 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/3249959173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]: dispatch 2024-03-31T23:10:41.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:40 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]: dispatch 2024-03-31T23:10:41.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:40 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35000c1d-43e1-4918-aa28-dac85f3b7802"}]': finished 2024-03-31T23:10:41.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:40 smithi094 ceph-mon[36167]: osdmap e15: 3 total, 2 up, 3 in 2024-03-31T23:10:41.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:41.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:41 smithi042 ceph-mon[32380]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:41.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:41 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/1250538194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:10:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:41 smithi188 ceph-mon[36068]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:41 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/1250538194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:10:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:41 smithi094 ceph-mon[36167]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:41 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/1250538194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:10:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:42 smithi042 ceph-mon[32380]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:42 smithi094 ceph-mon[36167]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:43.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:42 smithi188 ceph-mon[36068]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:45.010 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:44 smithi188 ceph-mon[36068]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:45.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:44 smithi042 ceph-mon[32380]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:44 smithi094 ceph-mon[36167]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:47.056 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:46 smithi188 ceph-mon[36068]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:47.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:46 smithi042 ceph-mon[32380]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:46 smithi094 ceph-mon[36167]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-31T23:10:47.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:47.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:47 smithi188 ceph-mon[36068]: Deploying daemon osd.2 on smithi188 2024-03-31T23:10:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-31T23:10:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:47 smithi042 ceph-mon[32380]: Deploying daemon osd.2 on smithi188 2024-03-31T23:10:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-31T23:10:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:47 smithi094 ceph-mon[36167]: Deploying daemon osd.2 on smithi188 2024-03-31T23:10:48.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:48 smithi188 ceph-mon[36068]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:49.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:48 smithi094 ceph-mon[36167]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:49.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:48 smithi042 ceph-mon[32380]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:50 smithi188 ceph-mon[36068]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:51.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:50 smithi042 ceph-mon[32380]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:51.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:50 smithi094 ceph-mon[36167]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:53.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:53 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:53 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:53 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:53 smithi188 ceph-mon[36068]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:53.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:53.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:53.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:53.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:53 smithi042 ceph-mon[32380]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:53.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:53 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:53.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:53 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:53.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:53 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:53.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:53 smithi094 ceph-mon[36167]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:55.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:54 smithi188 ceph-mon[36068]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:55.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:54 smithi042 ceph-mon[32380]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:55.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:54 smithi094 ceph-mon[36167]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:55.368 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 2 on host 'smithi188' 2024-03-31T23:10:55.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.367+0000 7f690d7fa700 1 -- 172.21.15.188:0/2604290377 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f69100fe000 con 0x7f68f80a24a0 2024-03-31T23:10:55.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f68f80a24a0 msgr2=0x7f68f80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:55.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f68f80a24a0 0x7f68f80a4960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69000039a0 tx=0x7f6900005fd0 comp rx=0 tx=0).stop 2024-03-31T23:10:55.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 msgr2=0x7f6910103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:10:55.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910103d10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6908007ee0 tx=0x7f690800d3b0 comp rx=0 tx=0).stop 2024-03-31T23:10:55.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 shutdown_connections 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f68f80a24a0 0x7f68f80a4960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6910102780 0x7f6910103d10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69101013e0 0x7f6910105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 --2- 172.21.15.188:0/2604290377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6910101da0 0x7f69101037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.370+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 >> 172.21.15.188:0/2604290377 conn(0x7f69100fbeb0 msgr2=0x7f69100fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.371+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 shutdown_connections 2024-03-31T23:10:55.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:10:55.371+0000 7f6916338700 1 -- 172.21.15.188:0/2604290377 wait complete. 2024-03-31T23:10:56.005 DEBUG:teuthology.orchestra.run.smithi188:osd.2> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.2.service 2024-03-31T23:10:56.008 INFO:tasks.cephadm:Deploying osd.3 on smithi042 with /dev/vg_nvme/lv_3... 2024-03-31T23:10:56.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-31T23:10:56.190 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2[41193]: 2024-03-31T23:10:56.102+0000 7f34f296d7c0 -1 osd.2 0 log_to_monitors true 2024-03-31T23:10:56.259 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:10:56.466 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.466 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.466 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.466 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.467 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-mon[36068]: from='osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-31T23:10:56.467 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:56 smithi188 ceph-mon[36068]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-31T23:10:56.614 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.614 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.614 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.614 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.614 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:56 smithi042 ceph-mon[32380]: from='osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-31T23:10:56.614 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:56 smithi042 ceph-mon[32380]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-31T23:10:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:56 smithi094 ceph-mon[36167]: from='osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-31T23:10:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:56 smithi094 ceph-mon[36167]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-31T23:10:57.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:57 smithi042 ceph-mon[32380]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-31T23:10:57.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:57 smithi042 ceph-mon[32380]: osdmap e16: 3 total, 2 up, 3 in 2024-03-31T23:10:57.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:57 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:57.649 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:57 smithi042 ceph-mon[32380]: from='osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:10:57.649 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:57 smithi042 ceph-mon[32380]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:10:57.649 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:57 smithi042 ceph-mon[32380]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:57 smithi094 ceph-mon[36167]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-31T23:10:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:57 smithi094 ceph-mon[36167]: osdmap e16: 3 total, 2 up, 3 in 2024-03-31T23:10:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:57 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:57 smithi094 ceph-mon[36167]: from='osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:10:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:57 smithi094 ceph-mon[36167]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:10:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:57 smithi094 ceph-mon[36167]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-mon[36068]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-31T23:10:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-mon[36068]: osdmap e16: 3 total, 2 up, 3 in 2024-03-31T23:10:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-mon[36068]: from='osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:10:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-mon[36068]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:10:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-mon[36068]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:57.719 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2[41193]: 2024-03-31T23:10:57.406+0000 7f34e7fd2700 -1 osd.2 0 waiting for initial osdmap 2024-03-31T23:10:57.720 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:10:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2[41193]: 2024-03-31T23:10:57.411+0000 7f34e3dc5700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:10:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-31T23:10:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-31T23:10:58.187 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 10+0 records in 2024-03-31T23:10:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:10+0 records out 2024-03-31T23:10:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00837241 s, 1.3 GB/s 2024-03-31T23:10:58.187 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 2024-03-31T23:10:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping successful for: 2024-03-31T23:10:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:58 smithi094 ceph-mon[36167]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:10:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:58 smithi094 ceph-mon[36167]: osdmap e17: 3 total, 2 up, 3 in 2024-03-31T23:10:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:58.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:58 smithi042 ceph-mon[32380]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:10:58.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:58 smithi042 ceph-mon[32380]: osdmap e17: 3 total, 2 up, 3 in 2024-03-31T23:10:58.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:58.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:58.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:58 smithi188 ceph-mon[36068]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:10:58.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:58 smithi188 ceph-mon[36068]: osdmap e17: 3 total, 2 up, 3 in 2024-03-31T23:10:58.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:58.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:58.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi042:vg_nvme/lv_3 2024-03-31T23:10:59.223 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:10:59.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:10:59.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:10:59.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] boot 2024-03-31T23:10:59.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: osdmap e18: 3 total, 3 up, 3 in 2024-03-31T23:10:59.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:59.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:59.631 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:10:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:10:59.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] boot 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: osdmap e18: 3 total, 3 up, 3 in 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:59.676 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:59.676 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:59.676 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:10:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: osd.2 [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] boot 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: osdmap e18: 3 total, 3 up, 3 in 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:10:59.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:10:59.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:10:59.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:10:59.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:10:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:00 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi188 2024-03-31T23:11:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:00 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi188 to 17080M 2024-03-31T23:11:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-31T23:11:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:00 smithi094 ceph-mon[36167]: osdmap e19: 3 total, 3 up, 3 in 2024-03-31T23:11:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:11:00.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:00 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi188 2024-03-31T23:11:00.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:00 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi188 to 17080M 2024-03-31T23:11:00.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-31T23:11:00.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:00 smithi042 ceph-mon[32380]: osdmap e19: 3 total, 3 up, 3 in 2024-03-31T23:11:00.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:11:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:00 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi188 2024-03-31T23:11:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:00 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi188 to 17080M 2024-03-31T23:11:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-31T23:11:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:00 smithi188 ceph-mon[36068]: osdmap e19: 3 total, 3 up, 3 in 2024-03-31T23:11:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:11:00.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 -- 172.21.15.42:0/157732543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 msgr2=0x7f0f441095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:00.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 --2- 172.21.15.42:0/157732543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f441095c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b0d0 tx=0x7f0f3c00b3e0 comp rx=0 tx=0).stop 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 -- 172.21.15.42:0/157732543 shutdown_connections 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 --2- 172.21.15.42:0/157732543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f441095c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 --2- 172.21.15.42:0/157732543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f44101170 0x7f0f44101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 --2- 172.21.15.42:0/157732543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f44102370 0x7f0f441027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 -- 172.21.15.42:0/157732543 >> 172.21.15.42:0/157732543 conn(0x7f0f440fc710 msgr2=0x7f0f440feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 -- 172.21.15.42:0/157732543 shutdown_connections 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.899+0000 7f0f48d97700 1 -- 172.21.15.42:0/157732543 wait complete. 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 Processor -- start 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 -- start start 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f44101170 0x7f0f44105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f44102370 0x7f0f44103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f44103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4410ceb0 con 0x7f0f44102d10 2024-03-31T23:11:00.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4410cd30 con 0x7f0f44101170 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f48d97700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4410d030 con 0x7f0f44102370 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.900+0000 7f0f42d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f44103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f44103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47436/0 (socket says 172.21.15.42:47436) 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 -- 172.21.15.42:0/421186673 learned_addr learned my addr 172.21.15.42:0/421186673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f41d9b700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f44102370 0x7f0f44103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f4259c700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f44101170 0x7f0f44105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 -- 172.21.15.42:0/421186673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f44102370 msgr2=0x7f0f44103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f44102370 0x7f0f44103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 -- 172.21.15.42:0/421186673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f44101170 msgr2=0x7f0f44105100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f44101170 0x7f0f44105100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 -- 172.21.15.42:0/421186673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f44104540 con 0x7f0f44102d10 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f42d9d700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f44103c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c007d40 tx=0x7f0f3c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c01f070 con 0x7f0f44102d10 2024-03-31T23:11:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f3c0092e0 con 0x7f0f44102d10 2024-03-31T23:11:00.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c01b680 con 0x7f0f44102d10 2024-03-31T23:11:00.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f441a26f0 con 0x7f0f44102d10 2024-03-31T23:11:00.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.901+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f441a2af0 con 0x7f0f44102d10 2024-03-31T23:11:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.902+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f44068f00 con 0x7f0f44102d10 2024-03-31T23:11:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.904+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 15) ==== 137264+0+0 (secure 0 0 0) 0x7f0f3c022070 con 0x7f0f44102d10 2024-03-31T23:11:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.905+0000 7f0f3b7fe700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0f300a2520 0x7f0f300a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.905+0000 7f0f4259c700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0f300a2520 0x7f0f300a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.905+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3237+0+0 (secure 0 0 0) 0x7f0f3c00f020 con 0x7f0f44102d10 2024-03-31T23:11:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.905+0000 7f0f4259c700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0f300a2520 0x7f0f300a49e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f441021d0 tx=0x7f0f2c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:11:00.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:00.908+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0f3c029020 con 0x7f0f44102d10 2024-03-31T23:11:01.047 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:00 smithi042 sudo[49461]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-31T23:11:01.047 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:00 smithi042 sudo[49461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:01.047 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:00 smithi042 sudo[49461]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:01.047 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:00 smithi042 sudo[49461]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:01.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:01.130+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0f440fe810 con 0x7f0f300a2520 2024-03-31T23:11:01.325 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:01 smithi042 sudo[49486]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-31T23:11:01.325 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:01 smithi042 sudo[49486]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:01.325 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:01 smithi042 sudo[49486]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:01.325 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:11:01 smithi042 sudo[49486]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:01.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:01.429+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f0f3c098f70 con 0x7f0f44102d10 2024-03-31T23:11:01.571 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44452]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-31T23:11:01.571 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44452]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:01.571 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44452]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:01.571 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44452]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:01.571 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: osdmap e20: 3 total, 3 up, 3 in 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:01.572 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:01 smithi094 ceph-mon[36167]: osdmap e21: 3 total, 3 up, 3 in 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: osdmap e20: 3 total, 3 up, 3 in 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:01.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:01.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:01 smithi188 ceph-mon[36068]: osdmap e21: 3 total, 3 up, 3 in 2024-03-31T23:11:01.738 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: osdmap e20: 3 total, 3 up, 3 in 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:01.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:01 smithi042 ceph-mon[32380]: osdmap e21: 3 total, 3 up, 3 in 2024-03-31T23:11:01.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44455]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-31T23:11:01.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44455]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:01.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44455]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:01.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:11:01 smithi094 sudo[44455]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:01.968 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:01 smithi188 sudo[45278]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-31T23:11:01.969 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:01 smithi188 sudo[45278]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:01.969 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:01 smithi188 sudo[45278]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:01.969 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:01 smithi188 sudo[45278]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:02.468 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45281]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-31T23:11:02.468 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45281]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:02.469 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45281]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:02.469 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45281]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:02.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49633]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-31T23:11:02.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49633]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:02.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49633]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:02.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49633]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:02.897 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49637]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49637]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49637]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 sudo[49637]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 ceph-mon[32380]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 ceph-mon[32380]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:02.898 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:02 smithi042 ceph-mon[32380]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:02.901 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 ceph-mon[36068]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 ceph-mon[36068]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 ceph-mon[36068]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45284]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45284]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45284]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:02.902 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:02 smithi188 sudo[45284]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:02 smithi094 ceph-mon[36167]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:02 smithi094 ceph-mon[36167]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-31T23:11:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:02 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:02 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:02 smithi094 ceph-mon[36167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:03.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 sudo[45287]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-31T23:11:03.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 sudo[45287]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:03.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 sudo[45287]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:03.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 sudo[45287]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:03.629 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44458]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-31T23:11:03.629 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:03.629 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44458]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:03.630 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44458]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:03.630 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44461]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-31T23:11:03.630 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-31T23:11:03.630 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44461]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-31T23:11:03.630 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 sudo[44461]: pam_unix(sudo:session): session closed for user root 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:03.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:03 smithi094 ceph-mon[36167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:03.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:03.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:03.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:03.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:03 smithi188 ceph-mon[36068]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-31T23:11:04.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:11:04.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:11:04.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:11:04.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:03 smithi042 ceph-mon[32380]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-31T23:11:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:04 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2333385975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]: dispatch 2024-03-31T23:11:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:04 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]: dispatch 2024-03-31T23:11:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:04 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]': finished 2024-03-31T23:11:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:04 smithi094 ceph-mon[36167]: osdmap e22: 4 total, 3 up, 4 in 2024-03-31T23:11:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:04 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2934914746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:04 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2333385975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]: dispatch 2024-03-31T23:11:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:04 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]: dispatch 2024-03-31T23:11:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:04 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]': finished 2024-03-31T23:11:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:04 smithi188 ceph-mon[36068]: osdmap e22: 4 total, 3 up, 4 in 2024-03-31T23:11:04.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:04.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:04 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2934914746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:05.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:04 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2333385975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]: dispatch 2024-03-31T23:11:05.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:04 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]: dispatch 2024-03-31T23:11:05.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:04 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f930edaa-f275-44f4-ae10-1699013ce78b"}]': finished 2024-03-31T23:11:05.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:04 smithi042 ceph-mon[32380]: osdmap e22: 4 total, 3 up, 4 in 2024-03-31T23:11:05.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:05.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:04 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2934914746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:05 smithi094 ceph-mon[36167]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:05.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:05 smithi188 ceph-mon[36068]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:06.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:05 smithi042 ceph-mon[32380]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:06 smithi042 ceph-mon[32380]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 247 KiB/s wr, 17 op/s 2024-03-31T23:11:07.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:06 smithi094 ceph-mon[36167]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 247 KiB/s wr, 17 op/s 2024-03-31T23:11:07.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:06 smithi188 ceph-mon[36068]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 247 KiB/s wr, 17 op/s 2024-03-31T23:11:09.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:08 smithi042 ceph-mon[32380]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 179 KiB/s wr, 12 op/s 2024-03-31T23:11:09.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:08 smithi094 ceph-mon[36167]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 179 KiB/s wr, 12 op/s 2024-03-31T23:11:09.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:08 smithi188 ceph-mon[36068]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 179 KiB/s wr, 12 op/s 2024-03-31T23:11:11.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:10 smithi042 ceph-mon[32380]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 141 KiB/s wr, 9 op/s 2024-03-31T23:11:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:10 smithi094 ceph-mon[36167]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 141 KiB/s wr, 9 op/s 2024-03-31T23:11:11.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:10 smithi188 ceph-mon[36068]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 141 KiB/s wr, 9 op/s 2024-03-31T23:11:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-31T23:11:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:11.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:11 smithi042 ceph-mon[32380]: Deploying daemon osd.3 on smithi042 2024-03-31T23:11:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:11 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-31T23:11:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:11 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:11 smithi094 ceph-mon[36167]: Deploying daemon osd.3 on smithi042 2024-03-31T23:11:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:11 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-31T23:11:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:11 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:11 smithi188 ceph-mon[36068]: Deploying daemon osd.3 on smithi042 2024-03-31T23:11:12.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:12 smithi042 ceph-mon[32380]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-31T23:11:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:12 smithi094 ceph-mon[36167]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-31T23:11:13.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:12 smithi188 ceph-mon[36068]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-31T23:11:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:14 smithi042 ceph-mon[32380]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 120 KiB/s wr, 8 op/s 2024-03-31T23:11:15.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:14 smithi094 ceph-mon[36167]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 120 KiB/s wr, 8 op/s 2024-03-31T23:11:15.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:14 smithi188 ceph-mon[36068]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 120 KiB/s wr, 8 op/s 2024-03-31T23:11:16.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:16 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:16.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:16 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:16.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:16 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:16.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:16 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:16.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:16 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:16.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:16 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:16.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:16 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:16.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:16 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:16.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:16 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:17.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:17 smithi042 ceph-mon[32380]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-03-31T23:11:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:17 smithi094 ceph-mon[36167]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-03-31T23:11:17.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:17 smithi188 ceph-mon[36068]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-03-31T23:11:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:18 smithi042 ceph-mon[32380]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:19.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:18 smithi094 ceph-mon[36167]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:19.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:18 smithi188 ceph-mon[36068]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:19.937 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 3 on host 'smithi042' 2024-03-31T23:11:19.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.936+0000 7f0f3b7fe700 1 -- 172.21.15.42:0/421186673 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0f440fe810 con 0x7f0f300a2520 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0f300a2520 msgr2=0x7f0f300a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0f300a2520 0x7f0f300a49e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f441021d0 tx=0x7f0f2c00a380 comp rx=0 tx=0).stop 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 msgr2=0x7f0f44103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f44103c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c007d40 tx=0x7f0f3c007d70 comp rx=0 tx=0).stop 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 shutdown_connections 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0f300a2520 0x7f0f300a49e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f44102d10 0x7f0f44103c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f44101170 0x7f0f44105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 --2- 172.21.15.42:0/421186673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f44102370 0x7f0f44103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 >> 172.21.15.42:0/421186673 conn(0x7f0f440fc710 msgr2=0x7f0f440fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:11:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 shutdown_connections 2024-03-31T23:11:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:11:19.940+0000 7f0f48d97700 1 -- 172.21.15.42:0/421186673 wait complete. 2024-03-31T23:11:20.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:20.415 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.415 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.415 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:20.416 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:20.416 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.416 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.416 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.416 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:20.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:20.509 DEBUG:teuthology.orchestra.run.smithi042:osd.3> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.3.service 2024-03-31T23:11:20.511 INFO:tasks.cephadm:Deploying osd.4 on smithi094 with /dev/vg_nvme/lv_3... 2024-03-31T23:11:20.511 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-31T23:11:20.755 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:11:21.167 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:21 smithi094 ceph-mon[36167]: from='osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-31T23:11:21.167 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:21 smithi094 ceph-mon[36167]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-31T23:11:21.167 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:21 smithi094 ceph-mon[36167]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:21.377 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:21 smithi042 ceph-mon[32380]: from='osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-31T23:11:21.377 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:21 smithi042 ceph-mon[32380]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-31T23:11:21.377 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:21 smithi042 ceph-mon[32380]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:21.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:21 smithi188 ceph-mon[36068]: from='osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-31T23:11:21.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:21 smithi188 ceph-mon[36068]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-31T23:11:21.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:21 smithi188 ceph-mon[36068]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:22.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-mon[32380]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-31T23:11:22.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-mon[32380]: osdmap e23: 4 total, 3 up, 4 in 2024-03-31T23:11:22.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-mon[32380]: from='osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:11:22.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:22.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-mon[32380]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:11:22.326 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:11:22.109+0000 7f9c03404700 -1 osd.3 0 waiting for initial osdmap 2024-03-31T23:11:22.326 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:11:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:11:22.114+0000 7f9bff1f7700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:11:22.373 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:22 smithi094 ceph-mon[36167]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-31T23:11:22.374 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:22 smithi094 ceph-mon[36167]: osdmap e23: 4 total, 3 up, 4 in 2024-03-31T23:11:22.374 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:22 smithi094 ceph-mon[36167]: from='osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:11:22.374 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:22 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:22.374 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:22 smithi094 ceph-mon[36167]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:11:22.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:22 smithi188 ceph-mon[36068]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-31T23:11:22.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:22 smithi188 ceph-mon[36068]: osdmap e23: 4 total, 3 up, 4 in 2024-03-31T23:11:22.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:22 smithi188 ceph-mon[36068]: from='osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:11:22.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:22 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:22.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:22 smithi188 ceph-mon[36068]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:11:22.672 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-31T23:11:22.672 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-31T23:11:22.672 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-03-31T23:11:22.672 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-03-31T23:11:22.672 INFO:teuthology.orchestra.run.smithi094.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00855046 s, 1.2 GB/s 2024-03-31T23:11:22.673 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-03-31T23:11:23.269 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:11:23.270 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: osdmap e24: 4 total, 3 up, 4 in 2024-03-31T23:11:23.270 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:23.270 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:23.270 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:23.270 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] boot 2024-03-31T23:11:23.270 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:23 smithi094 ceph-mon[36167]: osdmap e25: 4 total, 4 up, 4 in 2024-03-31T23:11:23.297 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi094:vg_nvme/lv_3 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: osdmap e24: 4 total, 3 up, 4 in 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] boot 2024-03-31T23:11:23.370 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:23 smithi042 ceph-mon[32380]: osdmap e25: 4 total, 4 up, 4 in 2024-03-31T23:11:23.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:11:23.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: osdmap e24: 4 total, 3 up, 4 in 2024-03-31T23:11:23.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:23.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:23.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-31T23:11:23.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: osd.3 [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] boot 2024-03-31T23:11:23.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:23 smithi188 ceph-mon[36068]: osdmap e25: 4 total, 4 up, 4 in 2024-03-31T23:11:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:11:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:11:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:11:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: osdmap e26: 4 total, 4 up, 4 in 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi042 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi042 to 8546M 2024-03-31T23:11:24.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:24.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:24.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: osdmap e26: 4 total, 4 up, 4 in 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi042 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi042 to 8546M 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:24.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:11:24.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: osdmap e26: 4 total, 4 up, 4 in 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi042 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi042 to 8546M 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 -- 172.21.15.94:0/120565787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541023c0 msgr2=0x7f4954102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 --2- 172.21.15.94:0/120565787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541023c0 0x7f4954102820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49480099c0 tx=0x7f4948009cd0 comp rx=0 tx=0).stop 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 -- 172.21.15.94:0/120565787 shutdown_connections 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 --2- 172.21.15.94:0/120565787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49541011c0 0x7f49541015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 --2- 172.21.15.94:0/120565787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4954102d60 0x7f4954109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 --2- 172.21.15.94:0/120565787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541023c0 0x7f4954102820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 -- 172.21.15.94:0/120565787 >> 172.21.15.94:0/120565787 conn(0x7f49540fc760 msgr2=0x7f49540feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:11:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 -- 172.21.15.94:0/120565787 shutdown_connections 2024-03-31T23:11:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 -- 172.21.15.94:0/120565787 wait complete. 2024-03-31T23:11:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 Processor -- start 2024-03-31T23:11:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.982+0000 7f4958ac8700 1 -- start start 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 0x7f495406b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49541023c0 0x7f495419d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4954102d60 0x7f495419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f495410ce90 con 0x7f49541023c0 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f495410cd10 con 0x7f49541011c0 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f495410d010 con 0x7f4954102d60 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 0x7f495406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 0x7f495406b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52112/0 (socket says 172.21.15.94:52112) 2024-03-31T23:11:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 -- 172.21.15.94:0/3909756198 learned_addr learned my addr 172.21.15.94:0/3909756198 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4951d9b700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49541023c0 0x7f495419d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4952d9d700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4954102d60 0x7f495419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 -- 172.21.15.94:0/3909756198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4954102d60 msgr2=0x7f495419f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4954102d60 0x7f495419f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 -- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49541023c0 msgr2=0x7f495419d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49541023c0 0x7f495419d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 -- 172.21.15.94:0/3909756198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4954197080 con 0x7f49541011c0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f495259c700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 0x7f495406b480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f494400d980 tx=0x7f494400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944016070 con 0x7f49541011c0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f494400be50 con 0x7f49541011c0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4954197370 con 0x7f49541011c0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494400f3c0 con 0x7f49541011c0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.983+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4954197880 con 0x7f49541011c0 2024-03-31T23:11:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.985+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4954068f00 con 0x7f49541011c0 2024-03-31T23:11:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.985+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f4944019070 con 0x7f49541011c0 2024-03-31T23:11:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.986+0000 7f49437fe700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f493c0a2530 0x7f493c0a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.986+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f49440cd110 con 0x7f49541011c0 2024-03-31T23:11:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.986+0000 7f4951d9b700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f493c0a2530 0x7f493c0a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:24.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.987+0000 7f4951d9b700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f493c0a2530 0x7f493c0a49f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f4948005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:11:24.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:24.991+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4944020030 con 0x7f49541011c0 2024-03-31T23:11:25.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:25.190+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4954108010 con 0x7f493c0a2530 2024-03-31T23:11:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:25 smithi094 ceph-mon[36167]: osdmap e27: 4 total, 4 up, 4 in 2024-03-31T23:11:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:25 smithi094 ceph-mon[36167]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:25 smithi188 ceph-mon[36068]: osdmap e27: 4 total, 4 up, 4 in 2024-03-31T23:11:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:25 smithi188 ceph-mon[36068]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:25.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:25 smithi042 ceph-mon[32380]: osdmap e27: 4 total, 4 up, 4 in 2024-03-31T23:11:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:25 smithi042 ceph-mon[32380]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:26 smithi094 ceph-mon[36167]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:26 smithi094 ceph-mon[36167]: osdmap e28: 4 total, 4 up, 4 in 2024-03-31T23:11:26.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:26 smithi188 ceph-mon[36068]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:26 smithi188 ceph-mon[36068]: osdmap e28: 4 total, 4 up, 4 in 2024-03-31T23:11:26.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:26 smithi042 ceph-mon[32380]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:26.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:26 smithi042 ceph-mon[32380]: osdmap e28: 4 total, 4 up, 4 in 2024-03-31T23:11:27.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:27 smithi094 ceph-mon[36167]: osdmap e29: 4 total, 4 up, 4 in 2024-03-31T23:11:27.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:27 smithi094 ceph-mon[36167]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail; 160 KiB/s, 0 objects/s recovering 2024-03-31T23:11:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:27 smithi188 ceph-mon[36068]: osdmap e29: 4 total, 4 up, 4 in 2024-03-31T23:11:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:27 smithi188 ceph-mon[36068]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail; 160 KiB/s, 0 objects/s recovering 2024-03-31T23:11:27.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:27 smithi042 ceph-mon[32380]: osdmap e29: 4 total, 4 up, 4 in 2024-03-31T23:11:27.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:27 smithi042 ceph-mon[32380]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail; 160 KiB/s, 0 objects/s recovering 2024-03-31T23:11:28.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:28 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/2557749354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]: dispatch 2024-03-31T23:11:28.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:28 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]: dispatch 2024-03-31T23:11:28.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:28 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]': finished 2024-03-31T23:11:28.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:28 smithi094 ceph-mon[36167]: osdmap e30: 5 total, 4 up, 5 in 2024-03-31T23:11:28.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:28 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:28 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/2557749354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]: dispatch 2024-03-31T23:11:28.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:28 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]: dispatch 2024-03-31T23:11:28.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:28 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]': finished 2024-03-31T23:11:28.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:28 smithi188 ceph-mon[36068]: osdmap e30: 5 total, 4 up, 5 in 2024-03-31T23:11:28.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:28.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:28 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/2557749354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]: dispatch 2024-03-31T23:11:28.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:28 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]: dispatch 2024-03-31T23:11:28.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:28 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf0bfa0c-ff89-4cfa-ae26-a97164273ee9"}]': finished 2024-03-31T23:11:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:28 smithi042 ceph-mon[32380]: osdmap e30: 5 total, 4 up, 5 in 2024-03-31T23:11:28.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:29.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:29 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/682864495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:29.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:29 smithi188 ceph-mon[36068]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-31T23:11:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:29 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/682864495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:29 smithi042 ceph-mon[32380]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-31T23:11:29.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:29 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/682864495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:29.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:29 smithi094 ceph-mon[36167]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-31T23:11:31.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:30 smithi042 ceph-mon[32380]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:11:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:30 smithi094 ceph-mon[36167]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:11:31.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:30 smithi188 ceph-mon[36068]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:11:33.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:32 smithi042 ceph-mon[32380]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-31T23:11:33.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:32 smithi094 ceph-mon[36167]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-31T23:11:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:32 smithi188 ceph-mon[36068]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-31T23:11:35.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:34 smithi042 ceph-mon[32380]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:35.125 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:34 smithi094 ceph-mon[36167]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:35.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:34 smithi188 ceph-mon[36068]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:36.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:35 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-31T23:11:36.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:35 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:36.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:35 smithi094 ceph-mon[36167]: Deploying daemon osd.4 on smithi094 2024-03-31T23:11:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:35 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-31T23:11:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:35 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:35 smithi042 ceph-mon[32380]: Deploying daemon osd.4 on smithi094 2024-03-31T23:11:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:35 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-31T23:11:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:35 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:35 smithi188 ceph-mon[36068]: Deploying daemon osd.4 on smithi094 2024-03-31T23:11:36.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:36 smithi094 ceph-mon[36167]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:37.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:36 smithi042 ceph-mon[32380]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:37.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:36 smithi188 ceph-mon[36068]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:38.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:38 smithi094 ceph-mon[36167]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:39.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:38 smithi042 ceph-mon[32380]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:38 smithi188 ceph-mon[36068]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:41.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:41.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:41.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:41.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:41 smithi094 ceph-mon[36167]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:41.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:41 smithi042 ceph-mon[32380]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:41 smithi188 ceph-mon[36068]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:43.022 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:42 smithi094 ceph-mon[36167]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:43.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:42 smithi042 ceph-mon[32380]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:43.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:42 smithi188 ceph-mon[36068]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:43.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.956+0000 7f49437fe700 1 -- 172.21.15.94:0/3909756198 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4954108010 con 0x7f493c0a2530 2024-03-31T23:11:43.957 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 4 on host 'smithi094' 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f493c0a2530 msgr2=0x7f493c0a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f493c0a2530 0x7f493c0a49f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f4948005fb0 comp rx=0 tx=0).stop 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 msgr2=0x7f495406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 0x7f495406b480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f494400d980 tx=0x7f494400dc90 comp rx=0 tx=0).stop 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 shutdown_connections 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f493c0a2530 0x7f493c0a49f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4954102d60 0x7f495419f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:43.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49541011c0 0x7f495406b480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:43.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 --2- 172.21.15.94:0/3909756198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49541023c0 0x7f495419d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:43.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 >> 172.21.15.94:0/3909756198 conn(0x7f49540fc760 msgr2=0x7f4954105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:11:43.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 shutdown_connections 2024-03-31T23:11:43.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:11:43.959+0000 7f4958ac8700 1 -- 172.21.15.94:0/3909756198 wait complete. 2024-03-31T23:11:44.566 DEBUG:teuthology.orchestra.run.smithi094:osd.4> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.4.service 2024-03-31T23:11:44.568 INFO:tasks.cephadm:Deploying osd.5 on smithi188 with /dev/vg_nvme/lv_3... 2024-03-31T23:11:44.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-31T23:11:44.817 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:11:45.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: from='osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-31T23:11:45.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-31T23:11:45.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:45.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.308 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: from='osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-31T23:11:45.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-31T23:11:45.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:45.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: from='osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-31T23:11:45.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-31T23:11:45.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:45.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:45.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:46.192 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:45 smithi188 ceph-mon[36068]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-31T23:11:46.193 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:45 smithi188 ceph-mon[36068]: from='osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:11:46.193 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:45 smithi188 ceph-mon[36068]: osdmap e31: 5 total, 4 up, 5 in 2024-03-31T23:11:46.193 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:45 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:46.193 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:45 smithi188 ceph-mon[36068]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:11:46.291 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:45 smithi094 ceph-mon[36167]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-31T23:11:46.291 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:45 smithi094 ceph-mon[36167]: from='osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:11:46.291 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:45 smithi094 ceph-mon[36167]: osdmap e31: 5 total, 4 up, 5 in 2024-03-31T23:11:46.291 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:45 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:46.291 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:45 smithi094 ceph-mon[36167]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:11:46.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:45 smithi042 ceph-mon[32380]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-31T23:11:46.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:45 smithi042 ceph-mon[32380]: from='osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:11:46.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:45 smithi042 ceph-mon[32380]: osdmap e31: 5 total, 4 up, 5 in 2024-03-31T23:11:46.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:45 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:46.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:45 smithi042 ceph-mon[32380]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:11:46.615 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:11:46.463+0000 7fd5c37cd700 -1 osd.4 0 waiting for initial osdmap 2024-03-31T23:11:46.615 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:11:46.470+0000 7fd5bb5b8700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:11:46.772 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-31T23:11:46.773 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-31T23:11:46.773 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-03-31T23:11:46.773 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-03-31T23:11:46.773 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111256 s, 942 MB/s 2024-03-31T23:11:46.773 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-03-31T23:11:47.110 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:46 smithi188 ceph-mon[36068]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:11:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:46 smithi188 ceph-mon[36068]: osdmap e32: 5 total, 4 up, 5 in 2024-03-31T23:11:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:46 smithi188 ceph-mon[36068]: from='osd.4 ' entity='osd.4' 2024-03-31T23:11:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:46 smithi188 ceph-mon[36068]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:47.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:46 smithi042 ceph-mon[32380]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:11:47.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:46 smithi042 ceph-mon[32380]: osdmap e32: 5 total, 4 up, 5 in 2024-03-31T23:11:47.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:47.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:47.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:46 smithi042 ceph-mon[32380]: from='osd.4 ' entity='osd.4' 2024-03-31T23:11:47.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:46 smithi042 ceph-mon[32380]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:47.402 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-mon[36167]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:11:47.402 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-mon[36167]: osdmap e32: 5 total, 4 up, 5 in 2024-03-31T23:11:47.402 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:47.402 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:47.402 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-mon[36167]: from='osd.4 ' entity='osd.4' 2024-03-31T23:11:47.402 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:46 smithi094 ceph-mon[36167]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-31T23:11:47.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_3 2024-03-31T23:11:47.698 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:11:48.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:47 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:11:48.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:47 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:11:48.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:48.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:47 smithi094 ceph-mon[36167]: osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] boot 2024-03-31T23:11:48.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:47 smithi094 ceph-mon[36167]: osdmap e33: 5 total, 5 up, 5 in 2024-03-31T23:11:48.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:48.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:47 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:11:48.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:47 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:11:48.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:48.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:47 smithi188 ceph-mon[36068]: osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] boot 2024-03-31T23:11:48.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:47 smithi188 ceph-mon[36068]: osdmap e33: 5 total, 5 up, 5 in 2024-03-31T23:11:48.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:47 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:11:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:47 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:11:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:47 smithi042 ceph-mon[32380]: osd.4 [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] boot 2024-03-31T23:11:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:47 smithi042 ceph-mon[32380]: osdmap e33: 5 total, 5 up, 5 in 2024-03-31T23:11:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:11:49.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi094 2024-03-31T23:11:49.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi094 to 8540M 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:49 smithi188 ceph-mon[36068]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:49.323 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi094 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi094 to 8540M 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:49.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:49 smithi094 ceph-mon[36167]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi094 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi094 to 8540M 2024-03-31T23:11:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:11:49.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:49 smithi042 ceph-mon[32380]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:49.328 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 -- 172.21.15.188:0/2347728432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968108080 msgr2=0x7f196810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:49.328 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 --2- 172.21.15.188:0/2347728432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968108080 0x7f196810a470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1960009990 tx=0x7f1960009ca0 comp rx=0 tx=0).stop 2024-03-31T23:11:49.328 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 -- 172.21.15.188:0/2347728432 shutdown_connections 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 --2- 172.21.15.188:0/2347728432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968108080 0x7f196810a470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 --2- 172.21.15.188:0/2347728432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1968102e20 0x7f1968105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 --2- 172.21.15.188:0/2347728432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968105750 0x7f1968107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 -- 172.21.15.188:0/2347728432 >> 172.21.15.188:0/2347728432 conn(0x7f19680fc7d0 msgr2=0x7f19680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 -- 172.21.15.188:0/2347728432 shutdown_connections 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.325+0000 7f196eee0700 1 -- 172.21.15.188:0/2347728432 wait complete. 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 Processor -- start 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 -- start start 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 0x7f1968198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1968105750 0x7f1968198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968108080 0x7f196819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f196810dfb0 con 0x7f1968105750 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f196810de30 con 0x7f1968108080 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196eee0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f196810e130 con 0x7f1968102e20 2024-03-31T23:11:49.329 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 0x7f1968198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 0x7f1968198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:34244/0 (socket says 172.21.15.188:34244) 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 -- 172.21.15.188:0/670749493 learned_addr learned my addr 172.21.15.188:0/670749493 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f195ffff700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1968105750 0x7f1968198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196d47d700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968108080 0x7f196819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 -- 172.21.15.188:0/670749493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968108080 msgr2=0x7f196819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968108080 0x7f196819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 -- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1968105750 msgr2=0x7f1968198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1968105750 0x7f1968198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 -- 172.21.15.188:0/670749493 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19681a0160 con 0x7f1968102e20 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196d47d700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968108080 0x7f196819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.326+0000 7f196cc7c700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 0x7f1968198500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f196400add0 tx=0x7f196400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.327+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964017020 con 0x7f1968102e20 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.327+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1968100c70 con 0x7f1968102e20 2024-03-31T23:11:49.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.327+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f196400ce40 con 0x7f1968102e20 2024-03-31T23:11:49.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.327+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964005520 con 0x7f1968102e20 2024-03-31T23:11:49.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.327+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19681011b0 con 0x7f1968102e20 2024-03-31T23:11:49.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.328+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1968068f00 con 0x7f1968102e20 2024-03-31T23:11:49.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.329+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f1964004ad0 con 0x7f1968102e20 2024-03-31T23:11:49.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.329+0000 7f195dffb700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f19500a2530 0x7f19500a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:11:49.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.329+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f19640ccec0 con 0x7f1968102e20 2024-03-31T23:11:49.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.329+0000 7f195ffff700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f19500a2530 0x7f19500a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:11:49.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.330+0000 7f195ffff700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f19500a2530 0x7f19500a49f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1958009c60 tx=0x7f1958009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:11:49.334 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.334+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1964021020 con 0x7f1968102e20 2024-03-31T23:11:49.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:11:49.535+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1968062680 con 0x7f19500a2530 2024-03-31T23:11:50.433 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:50 smithi188 ceph-mon[36068]: osdmap e34: 5 total, 5 up, 5 in 2024-03-31T23:11:50.434 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:50 smithi188 ceph-mon[36068]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:50.434 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:50.434 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:50.434 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:50.514 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:50 smithi094 ceph-mon[36167]: osdmap e34: 5 total, 5 up, 5 in 2024-03-31T23:11:50.514 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:50 smithi094 ceph-mon[36167]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:50.514 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:50.514 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:50.514 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:50 smithi042 ceph-mon[32380]: osdmap e34: 5 total, 5 up, 5 in 2024-03-31T23:11:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:50 smithi042 ceph-mon[32380]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:11:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:11:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:11:50.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:51.328 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:51 smithi188 ceph-mon[36068]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:51 smithi042 ceph-mon[32380]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:51.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:51 smithi094 ceph-mon[36167]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:52.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:52 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/2112043266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]: dispatch 2024-03-31T23:11:52.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:52 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]: dispatch 2024-03-31T23:11:52.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:52 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]': finished 2024-03-31T23:11:52.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:52 smithi042 ceph-mon[32380]: osdmap e35: 6 total, 5 up, 6 in 2024-03-31T23:11:52.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:11:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:52 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/2112043266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]: dispatch 2024-03-31T23:11:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:52 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]: dispatch 2024-03-31T23:11:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:52 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]': finished 2024-03-31T23:11:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:52 smithi094 ceph-mon[36167]: osdmap e35: 6 total, 5 up, 6 in 2024-03-31T23:11:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:11:52.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:52 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/2112043266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]: dispatch 2024-03-31T23:11:52.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:52 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]: dispatch 2024-03-31T23:11:52.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:52 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0176a668-abe0-43f2-98de-235389566eb6"}]': finished 2024-03-31T23:11:52.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:52 smithi188 ceph-mon[36068]: osdmap e35: 6 total, 5 up, 6 in 2024-03-31T23:11:52.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:11:53.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:53 smithi042 ceph-mon[32380]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:53.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/3706729305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:53.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:53 smithi094 ceph-mon[36167]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:53.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/3706729305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:53.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:53 smithi188 ceph-mon[36068]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:53.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/3706729305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:11:55.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:54 smithi042 ceph-mon[32380]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:55.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:54 smithi094 ceph-mon[36167]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:55.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:54 smithi188 ceph-mon[36068]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:56.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:56 smithi188 ceph-mon[36068]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:57.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:56 smithi042 ceph-mon[32380]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:57.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:56 smithi094 ceph-mon[36167]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:58 smithi188 ceph-mon[36068]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:59.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:58 smithi042 ceph-mon[32380]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:58 smithi094 ceph-mon[36167]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:11:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-31T23:11:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:11:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:11:59 smithi188 ceph-mon[36068]: Deploying daemon osd.5 on smithi188 2024-03-31T23:12:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-31T23:12:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:00.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:11:59 smithi042 ceph-mon[32380]: Deploying daemon osd.5 on smithi188 2024-03-31T23:12:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-31T23:12:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:11:59 smithi094 ceph-mon[36167]: Deploying daemon osd.5 on smithi188 2024-03-31T23:12:00.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:00 smithi094 ceph-mon[36167]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:00 smithi188 ceph-mon[36068]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:01.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:00 smithi042 ceph-mon[32380]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:03.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:02 smithi042 ceph-mon[32380]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:03.118 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:02 smithi188 ceph-mon[36068]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:03.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:02 smithi094 ceph-mon[36167]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:05.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:04 smithi188 ceph-mon[36068]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:05.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:04 smithi042 ceph-mon[32380]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:05.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:04 smithi094 ceph-mon[36167]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:06.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:06.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:06.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:06.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:06.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:06.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:07.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:07 smithi188 ceph-mon[36068]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:07.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:07 smithi042 ceph-mon[32380]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:07 smithi094 ceph-mon[36167]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:08.702 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 5 on host 'smithi188' 2024-03-31T23:12:08.703 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.701+0000 7f195dffb700 1 -- 172.21.15.188:0/670749493 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1968062680 con 0x7f19500a2530 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f19500a2530 msgr2=0x7f19500a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f19500a2530 0x7f19500a49f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1958009c60 tx=0x7f1958009260 comp rx=0 tx=0).stop 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 msgr2=0x7f1968198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 0x7f1968198500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f196400add0 tx=0x7f196400c330 comp rx=0 tx=0).stop 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 shutdown_connections 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f19500a2530 0x7f19500a49f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:08.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1968102e20 0x7f1968198500 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:08.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1968108080 0x7f196819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:08.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 --2- 172.21.15.188:0/670749493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1968105750 0x7f1968198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:08.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 >> 172.21.15.188:0/670749493 conn(0x7f19680fc7d0 msgr2=0x7f1968103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:12:08.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 shutdown_connections 2024-03-31T23:12:08.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:12:08.703+0000 7f196eee0700 1 -- 172.21.15.188:0/670749493 wait complete. 2024-03-31T23:12:09.403 DEBUG:teuthology.orchestra.run.smithi188:osd.5> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.5.service 2024-03-31T23:12:09.406 INFO:tasks.cephadm:Deploying osd.6 on smithi042 with /dev/vg_nvme/lv_2... 2024-03-31T23:12:09.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-31T23:12:09.657 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:12:09.779 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.780 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.780 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:09.780 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.780 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.780 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: from='osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-31T23:12:09.780 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:09 smithi042 ceph-mon[32380]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: from='osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-31T23:12:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:09 smithi094 ceph-mon[36167]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-31T23:12:09.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: from='osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-31T23:12:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:09 smithi188 ceph-mon[36068]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-31T23:12:11.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-mon[36068]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-31T23:12:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-mon[36068]: osdmap e36: 6 total, 5 up, 6 in 2024-03-31T23:12:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-mon[36068]: from='osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:12:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-mon[36068]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:12:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-mon[36068]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:11.469 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:12:11.175+0000 7fa03583a700 -1 osd.5 0 waiting for initial osdmap 2024-03-31T23:12:11.469 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:12:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:12:11.181+0000 7fa03162d700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:12:11.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:11 smithi042 ceph-mon[32380]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-31T23:12:11.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:11 smithi042 ceph-mon[32380]: osdmap e36: 6 total, 5 up, 6 in 2024-03-31T23:12:11.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:11 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:11.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:11 smithi042 ceph-mon[32380]: from='osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:12:11.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:11 smithi042 ceph-mon[32380]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:12:11.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:11 smithi042 ceph-mon[32380]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-31T23:12:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-31T23:12:11.663 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 10+0 records in 2024-03-31T23:12:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:10+0 records out 2024-03-31T23:12:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00833473 s, 1.3 GB/s 2024-03-31T23:12:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping successful for: 2024-03-31T23:12:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:11 smithi094 ceph-mon[36167]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-31T23:12:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:11 smithi094 ceph-mon[36167]: osdmap e36: 6 total, 5 up, 6 in 2024-03-31T23:12:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:11 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:11 smithi094 ceph-mon[36167]: from='osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:12:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:11 smithi094 ceph-mon[36167]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:12:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:11 smithi094 ceph-mon[36167]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:12.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:12 smithi042 ceph-mon[32380]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:12:12.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:12 smithi042 ceph-mon[32380]: osdmap e37: 6 total, 5 up, 6 in 2024-03-31T23:12:12.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.456 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:12 smithi188 ceph-mon[36068]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:12:12.456 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:12 smithi188 ceph-mon[36068]: osdmap e37: 6 total, 5 up, 6 in 2024-03-31T23:12:12.456 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.456 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.456 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi042:vg_nvme/lv_2 2024-03-31T23:12:12.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:12 smithi094 ceph-mon[36167]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:12:12.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:12 smithi094 ceph-mon[36167]: osdmap e37: 6 total, 5 up, 6 in 2024-03-31T23:12:12.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:12.730 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] boot 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: osdmap e38: 6 total, 6 up, 6 in 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi188 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi188 to 8540M 2024-03-31T23:12:13.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:13.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:13 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] boot 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: osdmap e38: 6 total, 6 up, 6 in 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi188 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi188 to 8540M 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:13.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:13 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: osd.5 [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] boot 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: osdmap e38: 6 total, 6 up, 6 in 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi188 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi188 to 8540M 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:13.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:13 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:14.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 -- 172.21.15.42:0/968158633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 msgr2=0x7fe6d01038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/968158633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d01038f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0099c0 tx=0x7fe6cc009cd0 comp rx=0 tx=0).stop 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 -- 172.21.15.42:0/968158633 shutdown_connections 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/968158633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6d0102290 0x7fe6d01026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/968158633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d0103e30 0x7fe6d010a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/968158633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d01038f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 -- 172.21.15.42:0/968158633 >> 172.21.15.42:0/968158633 conn(0x7fe6d00fd850 msgr2=0x7fe6d00ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 -- 172.21.15.42:0/968158633 shutdown_connections 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 -- 172.21.15.42:0/968158633 wait complete. 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 Processor -- start 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 -- start start 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6d0102290 0x7fe6d0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:14.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.211+0000 7fe6d7d65700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d0103e30 0x7fe6d019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d7d65700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d010e010 con 0x7fe6d0103490 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d7d65700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d010de90 con 0x7fe6d0103e30 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d7d65700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d010e190 con 0x7fe6d0102290 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d0198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47370/0 (socket says 172.21.15.42:47370) 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 -- 172.21.15.42:0/2722611364 learned_addr learned my addr 172.21.15.42:0/2722611364 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5b01700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6d0102290 0x7fe6d0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d6302700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d0103e30 0x7fe6d019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 -- 172.21.15.42:0/2722611364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6d0102290 msgr2=0x7fe6d0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6d0102290 0x7fe6d0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 -- 172.21.15.42:0/2722611364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d0103e30 msgr2=0x7fe6d019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d0103e30 0x7fe6d019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:14.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 -- 172.21.15.42:0/2722611364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d01a01c0 con 0x7fe6d0103490 2024-03-31T23:12:14.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d5300700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d0198aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00b580 tx=0x7fe6cc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:12:14.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc027070 con 0x7fe6d0103490 2024-03-31T23:12:14.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6cc004140 con 0x7fe6d0103490 2024-03-31T23:12:14.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d01a0450 con 0x7fe6d0103490 2024-03-31T23:12:14.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00f460 con 0x7fe6d0103490 2024-03-31T23:12:14.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.212+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d01a0930 con 0x7fe6d0103490 2024-03-31T23:12:14.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.213+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d0068f00 con 0x7fe6d0103490 2024-03-31T23:12:14.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.214+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fe6cc02a070 con 0x7fe6d0103490 2024-03-31T23:12:14.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.215+0000 7fe6c2ffd700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6bc0a2530 0x7fe6bc0a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:14.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.215+0000 7fe6d5b01700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6bc0a2530 0x7fe6bc0a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:14.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.215+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7fe6cc0cef00 con 0x7fe6d0103490 2024-03-31T23:12:14.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.215+0000 7fe6d5b01700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6bc0a2530 0x7fe6bc0a49f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6d01032f0 tx=0x7fe6c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:12:14.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.219+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe6cc031070 con 0x7fe6d0103490 2024-03-31T23:12:14.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:14 smithi042 ceph-mon[32380]: osdmap e39: 6 total, 6 up, 6 in 2024-03-31T23:12:14.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:14.434+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe6d0062680 con 0x7fe6bc0a2530 2024-03-31T23:12:14.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:14 smithi188 ceph-mon[36068]: osdmap e39: 6 total, 6 up, 6 in 2024-03-31T23:12:14.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:14 smithi094 ceph-mon[36167]: osdmap e39: 6 total, 6 up, 6 in 2024-03-31T23:12:15.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:15 smithi042 ceph-mon[32380]: osdmap e40: 6 total, 6 up, 6 in 2024-03-31T23:12:15.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:15 smithi042 ceph-mon[32380]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:12:15.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:15 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:12:15.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:15 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:12:15.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:15 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:15.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:15 smithi042 ceph-mon[32380]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:15.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:15 smithi188 ceph-mon[36068]: osdmap e40: 6 total, 6 up, 6 in 2024-03-31T23:12:15.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:15 smithi188 ceph-mon[36068]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:12:15.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:15 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:12:15.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:15 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:12:15.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:15 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:15.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:15 smithi188 ceph-mon[36068]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:15 smithi094 ceph-mon[36167]: osdmap e40: 6 total, 6 up, 6 in 2024-03-31T23:12:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:15 smithi094 ceph-mon[36167]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:12:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:15 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:12:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:15 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:12:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:15 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:15 smithi094 ceph-mon[36167]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:16.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:16 smithi042 ceph-mon[32380]: osdmap e41: 6 total, 6 up, 6 in 2024-03-31T23:12:16.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:16 smithi188 ceph-mon[36068]: osdmap e41: 6 total, 6 up, 6 in 2024-03-31T23:12:16.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:16 smithi094 ceph-mon[36167]: osdmap e41: 6 total, 6 up, 6 in 2024-03-31T23:12:17.468 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:17 smithi042 ceph-mon[32380]: osdmap e42: 6 total, 6 up, 6 in 2024-03-31T23:12:17.468 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:17 smithi042 ceph-mon[32380]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-31T23:12:17.468 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:17 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2735646748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7878060c-9e7e-4383-98be-826d47820b5e"}]: dispatch 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:17 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2735646748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7878060c-9e7e-4383-98be-826d47820b5e"}]': finished 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:17 smithi042 ceph-mon[32380]: osdmap e43: 7 total, 6 up, 7 in 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:17 smithi188 ceph-mon[36068]: osdmap e42: 6 total, 6 up, 6 in 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:17 smithi188 ceph-mon[36068]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:17 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2735646748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7878060c-9e7e-4383-98be-826d47820b5e"}]: dispatch 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:17 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2735646748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7878060c-9e7e-4383-98be-826d47820b5e"}]': finished 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:17 smithi188 ceph-mon[36068]: osdmap e43: 7 total, 6 up, 7 in 2024-03-31T23:12:17.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:17 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:17 smithi094 ceph-mon[36167]: osdmap e42: 6 total, 6 up, 6 in 2024-03-31T23:12:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:17 smithi094 ceph-mon[36167]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-31T23:12:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:17 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2735646748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7878060c-9e7e-4383-98be-826d47820b5e"}]: dispatch 2024-03-31T23:12:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:17 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2735646748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7878060c-9e7e-4383-98be-826d47820b5e"}]': finished 2024-03-31T23:12:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:17 smithi094 ceph-mon[36167]: osdmap e43: 7 total, 6 up, 7 in 2024-03-31T23:12:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:17 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:18.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:18 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3489111814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:12:18.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:18 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3489111814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:12:18.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:18 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3489111814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:12:19.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:19 smithi188 ceph-mon[36068]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-03-31T23:12:19.573 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:19 smithi094 ceph-mon[36167]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-03-31T23:12:19.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:19 smithi042 ceph-mon[32380]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-03-31T23:12:20.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:20 smithi188 ceph-mon[36068]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:12:21.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:20 smithi042 ceph-mon[32380]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:12:21.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:20 smithi094 ceph-mon[36167]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:12:23.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:22 smithi042 ceph-mon[32380]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-03-31T23:12:23.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:22 smithi094 ceph-mon[36167]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-03-31T23:12:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:22 smithi188 ceph-mon[36068]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-03-31T23:12:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-31T23:12:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:24.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-31T23:12:24.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:25.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-31T23:12:25.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:25 smithi042 ceph-mon[32380]: Deploying daemon osd.6 on smithi042 2024-03-31T23:12:25.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:25 smithi042 ceph-mon[32380]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-03-31T23:12:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:25 smithi094 ceph-mon[36167]: Deploying daemon osd.6 on smithi042 2024-03-31T23:12:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:25 smithi094 ceph-mon[36167]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-03-31T23:12:25.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:25 smithi188 ceph-mon[36068]: Deploying daemon osd.6 on smithi042 2024-03-31T23:12:25.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:25 smithi188 ceph-mon[36068]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-03-31T23:12:27.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:26 smithi042 ceph-mon[32380]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:27.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:26 smithi094 ceph-mon[36167]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:27.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:26 smithi188 ceph-mon[36068]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:29.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:28 smithi042 ceph-mon[32380]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:28 smithi094 ceph-mon[36167]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:29.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:28 smithi188 ceph-mon[36068]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:31.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:31.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:31.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:31.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:31 smithi188 ceph-mon[36068]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:31.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:31.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:31.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:31.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:31 smithi042 ceph-mon[32380]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:31.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:31.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:31.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:31.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:31 smithi094 ceph-mon[36167]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:33.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:32 smithi042 ceph-mon[32380]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:32 smithi094 ceph-mon[36167]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:32 smithi188 ceph-mon[36068]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:33.926 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 6 on host 'smithi042' 2024-03-31T23:12:33.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.924+0000 7fe6c2ffd700 1 -- 172.21.15.42:0/2722611364 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6d0062680 con 0x7fe6bc0a2530 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6bc0a2530 msgr2=0x7fe6bc0a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6bc0a2530 0x7fe6bc0a49f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6d01032f0 tx=0x7fe6c400b410 comp rx=0 tx=0).stop 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 msgr2=0x7fe6d0198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d0198aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00b580 tx=0x7fe6cc005e80 comp rx=0 tx=0).stop 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 shutdown_connections 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6bc0a2530 0x7fe6bc0a49f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6d0102290 0x7fe6d0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d0103e30 0x7fe6d019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 --2- 172.21.15.42:0/2722611364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d0103490 0x7fe6d0198aa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 >> 172.21.15.42:0/2722611364 conn(0x7fe6d00fd850 msgr2=0x7fe6d0106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:12:33.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 shutdown_connections 2024-03-31T23:12:33.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:12:33.928+0000 7fe6d7d65700 1 -- 172.21.15.42:0/2722611364 wait complete. 2024-03-31T23:12:34.650 DEBUG:teuthology.orchestra.run.smithi042:osd.6> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.6.service 2024-03-31T23:12:34.652 INFO:tasks.cephadm:Deploying osd.7 on smithi094 with /dev/vg_nvme/lv_2... 2024-03-31T23:12:34.653 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-31T23:12:34.898 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:12:35.020 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:34 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.020 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:34 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.020 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:34 smithi094 ceph-mon[36167]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-31T23:12:35.020 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:34 smithi094 ceph-mon[36167]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:35.020 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:34 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.020 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:34 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:34 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:34 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:34 smithi188 ceph-mon[36068]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-31T23:12:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:34 smithi188 ceph-mon[36068]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:34 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:34 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:34 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:34 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:34 smithi042 ceph-mon[32380]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-31T23:12:35.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:34 smithi042 ceph-mon[32380]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:35.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:34 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:35.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:34 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:35 smithi042 ceph-mon[32380]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-31T23:12:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:35 smithi042 ceph-mon[32380]: osdmap e44: 7 total, 6 up, 7 in 2024-03-31T23:12:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:35 smithi042 ceph-mon[32380]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:12:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:35 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:36.076 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:12:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:12:35.926+0000 7fd59ae15700 -1 osd.6 0 waiting for initial osdmap 2024-03-31T23:12:36.076 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:12:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:12:35.937+0000 7fd596c08700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:12:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:35 smithi188 ceph-mon[36068]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-31T23:12:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:35 smithi188 ceph-mon[36068]: osdmap e44: 7 total, 6 up, 7 in 2024-03-31T23:12:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:35 smithi188 ceph-mon[36068]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:12:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:35 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:36.253 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:35 smithi094 ceph-mon[36167]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-31T23:12:36.253 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:35 smithi094 ceph-mon[36167]: osdmap e44: 7 total, 6 up, 7 in 2024-03-31T23:12:36.253 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:35 smithi094 ceph-mon[36167]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:12:36.253 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:35 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:36.946 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-31T23:12:36.946 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-31T23:12:36.946 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-03-31T23:12:36.946 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-03-31T23:12:36.946 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00858074 s, 1.2 GB/s 2024-03-31T23:12:36.946 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-03-31T23:12:37.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:36 smithi188 ceph-mon[36068]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:12:37.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:36 smithi188 ceph-mon[36068]: osdmap e45: 7 total, 6 up, 7 in 2024-03-31T23:12:37.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:37.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:37.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:36 smithi188 ceph-mon[36068]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:37.235 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:36 smithi094 ceph-mon[36167]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:12:37.235 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:36 smithi094 ceph-mon[36167]: osdmap e45: 7 total, 6 up, 7 in 2024-03-31T23:12:37.235 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:37.235 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:37.235 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:36 smithi094 ceph-mon[36167]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:37.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:36 smithi042 ceph-mon[32380]: from='osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:12:37.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:36 smithi042 ceph-mon[32380]: osdmap e45: 7 total, 6 up, 7 in 2024-03-31T23:12:37.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:37.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:37.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:36 smithi042 ceph-mon[32380]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-03-31T23:12:37.564 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi094:vg_nvme/lv_2 2024-03-31T23:12:37.813 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:12:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:37 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:12:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:37 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:12:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:37 smithi042 ceph-mon[32380]: osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] boot 2024-03-31T23:12:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:37 smithi042 ceph-mon[32380]: osdmap e46: 7 total, 7 up, 7 in 2024-03-31T23:12:38.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:37 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:38.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:37 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:12:38.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:37 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:12:38.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:37 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:38.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:37 smithi094 ceph-mon[36167]: osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] boot 2024-03-31T23:12:38.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:37 smithi094 ceph-mon[36167]: osdmap e46: 7 total, 7 up, 7 in 2024-03-31T23:12:38.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:37 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:38.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:37 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:12:38.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:37 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:12:38.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:38.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:37 smithi188 ceph-mon[36068]: osd.6 [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] boot 2024-03-31T23:12:38.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:37 smithi188 ceph-mon[36068]: osdmap e46: 7 total, 7 up, 7 in 2024-03-31T23:12:38.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:37 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:12:39.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: osdmap e47: 7 total, 7 up, 7 in 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi042 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi042 to 5697M 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:39.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:39.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:39.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:39.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:38 smithi188 ceph-mon[36068]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: osdmap e47: 7 total, 7 up, 7 in 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi042 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi042 to 5697M 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.230 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.231 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:38 smithi094 ceph-mon[36167]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:39.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: osdmap e47: 7 total, 7 up, 7 in 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi042 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi042 to 5697M 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:39.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:39.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:39.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:39.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:38 smithi042 ceph-mon[32380]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 -- 172.21.15.94:0/495367886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8102d10 msgr2=0x7f94a81095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 --2- 172.21.15.94:0/495367886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8102d10 0x7f94a81095c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b0d0 tx=0x7f94a000b3e0 comp rx=0 tx=0).stop 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 -- 172.21.15.94:0/495367886 shutdown_connections 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 --2- 172.21.15.94:0/495367886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8102d10 0x7f94a81095c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 --2- 172.21.15.94:0/495367886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8101170 0x7f94a8101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 --2- 172.21.15.94:0/495367886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a8102370 0x7f94a81027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 -- 172.21.15.94:0/495367886 >> 172.21.15.94:0/495367886 conn(0x7f94a80fc710 msgr2=0x7f94a80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 -- 172.21.15.94:0/495367886 shutdown_connections 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 -- 172.21.15.94:0/495367886 wait complete. 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.467+0000 7f94acc02700 1 Processor -- start 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 -- start start 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 0x7f94a81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a8102370 0x7f94a8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8102d10 0x7f94a819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f94a810cef0 con 0x7f94a8102d10 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f94a810cd70 con 0x7f94a8101170 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94acc02700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f94a810d070 con 0x7f94a8102370 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 0x7f94a81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 0x7f94a81984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54974/0 (socket says 172.21.15.94:54974) 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 -- 172.21.15.94:0/3376854821 learned_addr learned my addr 172.21.15.94:0/3376854821 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f949dd9b700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a8102370 0x7f94a8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a6d9d700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8102d10 0x7f94a819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 -- 172.21.15.94:0/3376854821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a8102370 msgr2=0x7f94a8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a8102370 0x7f94a8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 -- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8102d10 msgr2=0x7f94a819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:39.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8102d10 0x7f94a819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 -- 172.21.15.94:0/3376854821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a81a0150 con 0x7f94a8101170 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a6d9d700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8102d10 0x7f94a819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.468+0000 7f94a659c700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 0x7f94a81984f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f949800c990 tx=0x7f949800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.469+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498007b00 con 0x7f94a8101170 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.469+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a81a0440 con 0x7f94a8101170 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.469+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9498007ca0 con 0x7f94a8101170 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.469+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94980186f0 con 0x7f94a8101170 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.469+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a81a0a50 con 0x7f94a8101170 2024-03-31T23:12:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.470+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a8068f00 con 0x7f94a8101170 2024-03-31T23:12:39.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.471+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f9498004020 con 0x7f94a8101170 2024-03-31T23:12:39.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.471+0000 7f949ffff700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f94940a2530 0x7f94940a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:12:39.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.472+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f94980cdb20 con 0x7f94a8101170 2024-03-31T23:12:39.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.472+0000 7f949dd9b700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f94940a2530 0x7f94940a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:12:39.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.472+0000 7f949dd9b700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f94940a2530 0x7f94940a49f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9490009a10 tx=0x7f9490009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:12:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.475+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9498014030 con 0x7f94a8101170 2024-03-31T23:12:39.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:39.681+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f94a80fe7d0 con 0x7f94940a2530 2024-03-31T23:12:40.586 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:40 smithi094 ceph-mon[36167]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:12:40.586 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:12:40.586 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:12:40.586 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:40 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:40 smithi188 ceph-mon[36068]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:12:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:12:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:12:40.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:40 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:40.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:40 smithi042 ceph-mon[32380]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:12:40.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:12:40.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:12:40.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:40 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:41.540 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:41 smithi094 ceph-mon[36167]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:41.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:41 smithi188 ceph-mon[36068]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:41.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:41 smithi042 ceph-mon[32380]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:42.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:42 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/3650545211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]: dispatch 2024-03-31T23:12:42.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:42 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]: dispatch 2024-03-31T23:12:42.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:42 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]': finished 2024-03-31T23:12:42.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:42 smithi094 ceph-mon[36167]: osdmap e48: 8 total, 7 up, 8 in 2024-03-31T23:12:42.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:12:42.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:42 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/3650545211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]: dispatch 2024-03-31T23:12:42.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:42 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]: dispatch 2024-03-31T23:12:42.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:42 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]': finished 2024-03-31T23:12:42.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:42 smithi188 ceph-mon[36068]: osdmap e48: 8 total, 7 up, 8 in 2024-03-31T23:12:42.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:12:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:42 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/3650545211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]: dispatch 2024-03-31T23:12:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:42 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]: dispatch 2024-03-31T23:12:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:42 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "864a3347-34e1-4a21-96be-9c620c631fd8"}]': finished 2024-03-31T23:12:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:42 smithi042 ceph-mon[32380]: osdmap e48: 8 total, 7 up, 8 in 2024-03-31T23:12:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:12:43.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:43 smithi094 ceph-mon[36167]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:43.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:43 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/3067275254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:12:43.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:43 smithi188 ceph-mon[36068]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:43.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:43 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/3067275254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:12:43.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:43 smithi042 ceph-mon[32380]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:43.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:43 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/3067275254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:12:45.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:44 smithi042 ceph-mon[32380]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:44 smithi094 ceph-mon[36167]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:45.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:44 smithi188 ceph-mon[36068]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:46 smithi094 ceph-mon[36167]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:47.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:46 smithi042 ceph-mon[32380]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:47.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:46 smithi188 ceph-mon[36068]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:49.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:48 smithi042 ceph-mon[32380]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:48 smithi094 ceph-mon[36167]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:49.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:48 smithi188 ceph-mon[36068]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-31T23:12:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:49 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:49 smithi094 ceph-mon[36167]: Deploying daemon osd.7 on smithi094 2024-03-31T23:12:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-31T23:12:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:49 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:49 smithi042 ceph-mon[32380]: Deploying daemon osd.7 on smithi094 2024-03-31T23:12:50.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-31T23:12:50.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:49 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:50.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:49 smithi188 ceph-mon[36068]: Deploying daemon osd.7 on smithi094 2024-03-31T23:12:52.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:51 smithi042 ceph-mon[32380]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:52.154 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:51 smithi094 ceph-mon[36167]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:52.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:51 smithi188 ceph-mon[36068]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:53 smithi042 ceph-mon[32380]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:54.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:53 smithi094 ceph-mon[36167]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:53 smithi188 ceph-mon[36068]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:56.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:56 smithi042 ceph-mon[32380]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:56 smithi094 ceph-mon[36167]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:56.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:56 smithi188 ceph-mon[36068]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:56.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:56.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:56.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:58.406 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:58 smithi094 ceph-mon[36167]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:58.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:58 smithi042 ceph-mon[32380]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:58.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:58 smithi188 ceph-mon[36068]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:12:59.156 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 7 on host 'smithi094' 2024-03-31T23:12:59.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.154+0000 7f949ffff700 1 -- 172.21.15.94:0/3376854821 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f94a80fe7d0 con 0x7f94940a2530 2024-03-31T23:12:59.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f94940a2530 msgr2=0x7f94940a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:59.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f94940a2530 0x7f94940a49f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9490009a10 tx=0x7f9490009190 comp rx=0 tx=0).stop 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 msgr2=0x7f94a81984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 0x7f94a81984f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f949800c990 tx=0x7f949800cca0 comp rx=0 tx=0).stop 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 shutdown_connections 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f94940a2530 0x7f94940a49f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94a8102d10 0x7f94a819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94a8101170 0x7f94a81984f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 --2- 172.21.15.94:0/3376854821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a8102370 0x7f94a8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.156+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 >> 172.21.15.94:0/3376854821 conn(0x7f94a80fc710 msgr2=0x7f94a80fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.157+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 shutdown_connections 2024-03-31T23:12:59.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:12:59.157+0000 7f94acc02700 1 -- 172.21.15.94:0/3376854821 wait complete. 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:59.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-31T23:12:59.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:12:59 smithi094 ceph-mon[36167]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-31T23:12:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-31T23:12:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:12:59 smithi042 ceph-mon[32380]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-31T23:12:59.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:12:59 smithi188 ceph-mon[36068]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-31T23:12:59.806 DEBUG:teuthology.orchestra.run.smithi094:osd.7> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.7.service 2024-03-31T23:12:59.808 INFO:tasks.cephadm:Deploying osd.8 on smithi188 with /dev/vg_nvme/lv_2... 2024-03-31T23:12:59.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-31T23:13:00.055 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:13:00.303 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:00 smithi094 ceph-mon[36167]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:00.303 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:00 smithi094 ceph-mon[36167]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-31T23:13:00.303 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:00 smithi094 ceph-mon[36167]: osdmap e49: 8 total, 7 up, 8 in 2024-03-31T23:13:00.303 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:00 smithi094 ceph-mon[36167]: from='osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:13:00.303 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:00.303 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:00 smithi094 ceph-mon[36167]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:13:00.436 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:00 smithi188 ceph-mon[36068]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:00.437 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:00 smithi188 ceph-mon[36068]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-31T23:13:00.437 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:00 smithi188 ceph-mon[36068]: osdmap e49: 8 total, 7 up, 8 in 2024-03-31T23:13:00.437 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:00 smithi188 ceph-mon[36068]: from='osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:13:00.437 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:00.437 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:00 smithi188 ceph-mon[36068]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:13:00.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:00 smithi042 ceph-mon[32380]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:00 smithi042 ceph-mon[32380]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-31T23:13:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:00 smithi042 ceph-mon[32380]: osdmap e49: 8 total, 7 up, 8 in 2024-03-31T23:13:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:00 smithi042 ceph-mon[32380]: from='osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:13:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:00 smithi042 ceph-mon[32380]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:13:01.922 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:13:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:13:01.588+0000 7f38caa24700 -1 osd.7 0 waiting for initial osdmap 2024-03-31T23:13:01.923 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:13:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:13:01.598+0000 7f38c280f700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:13:02.055 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-31T23:13:02.055 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-31T23:13:02.055 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-03-31T23:13:02.055 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-03-31T23:13:02.055 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011356 s, 923 MB/s 2024-03-31T23:13:02.055 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-03-31T23:13:02.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:02 smithi042 ceph-mon[32380]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:02.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:02 smithi042 ceph-mon[32380]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:13:02.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:02 smithi042 ceph-mon[32380]: osdmap e50: 8 total, 7 up, 8 in 2024-03-31T23:13:02.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:02 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:02.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:02 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:02.378 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:02 smithi042 ceph-mon[32380]: from='osd.7 ' entity='osd.7' 2024-03-31T23:13:02.389 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:02 smithi188 ceph-mon[36068]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:02.389 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:02 smithi188 ceph-mon[36068]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:13:02.390 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:02 smithi188 ceph-mon[36068]: osdmap e50: 8 total, 7 up, 8 in 2024-03-31T23:13:02.390 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:02 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:02.390 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:02 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:02.390 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:02 smithi188 ceph-mon[36068]: from='osd.7 ' entity='osd.7' 2024-03-31T23:13:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:02 smithi094 ceph-mon[36167]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:02 smithi094 ceph-mon[36167]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:13:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:02 smithi094 ceph-mon[36167]: osdmap e50: 8 total, 7 up, 8 in 2024-03-31T23:13:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:02 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:02 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:02 smithi094 ceph-mon[36167]: from='osd.7 ' entity='osd.7' 2024-03-31T23:13:02.701 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_2 2024-03-31T23:13:02.937 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:13:03.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:13:03.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:13:03.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:03.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] boot 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: osdmap e51: 8 total, 8 up, 8 in 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:03.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:03 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.352 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:13:03.352 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] boot 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: osdmap e51: 8 total, 8 up, 8 in 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:03.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:03 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: osd.7 [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] boot 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: osdmap e51: 8 total, 8 up, 8 in 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:03.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:03.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:03.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:03.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:03 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 -- 172.21.15.188:0/522259584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103510 msgr2=0x7f76b8103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 --2- 172.21.15.188:0/522259584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103510 0x7f76b8103970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009990 tx=0x7f76a8009ca0 comp rx=0 tx=0).stop 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 -- 172.21.15.188:0/522259584 shutdown_connections 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 --2- 172.21.15.188:0/522259584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8103eb0 0x7f76b810a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 --2- 172.21.15.188:0/522259584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76b8100530 0x7f76b8100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 --2- 172.21.15.188:0/522259584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103510 0x7f76b8103970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 -- 172.21.15.188:0/522259584 >> 172.21.15.188:0/522259584 conn(0x7f76b80fbeb0 msgr2=0x7f76b80fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 -- 172.21.15.188:0/522259584 shutdown_connections 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.499+0000 7f76c01ec700 1 -- 172.21.15.188:0/522259584 wait complete. 2024-03-31T23:13:04.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 Processor -- start 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 -- start start 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8100530 0x7f76b8102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76b8103510 0x7f76b81014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 0x7f76b8101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76b810dfe0 con 0x7f76b8103510 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f76b810de60 con 0x7f76b8100530 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76c01ec700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f76b810e160 con 0x7f76b8103eb0 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 0x7f76b8101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 0x7f76b8101a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:40994/0 (socket says 172.21.15.188:40994) 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 -- 172.21.15.188:0/890979872 learned_addr learned my addr 172.21.15.188:0/890979872 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76bd787700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76b8103510 0x7f76b81014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76bdf88700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8100530 0x7f76b8102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:04.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 -- 172.21.15.188:0/890979872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8100530 msgr2=0x7f76b8102e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8100530 0x7f76b8102e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 -- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76b8103510 msgr2=0x7f76b81014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76b8103510 0x7f76b81014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76be789700 1 -- 172.21.15.188:0/890979872 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b81022b0 con 0x7f76b8103eb0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.500+0000 7f76bdf88700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8100530 0x7f76b8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.501+0000 7f76be789700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 0x7f76b8101a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b970 tx=0x7f76b000bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.501+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0019070 con 0x7f76b8103eb0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.501+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b81a26c0 con 0x7f76b8103eb0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.501+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76b0014440 con 0x7f76b8103eb0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.501+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00075d0 con 0x7f76b8103eb0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.501+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b81a2bb0 con 0x7f76b8103eb0 2024-03-31T23:13:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.502+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b8068f00 con 0x7f76b8103eb0 2024-03-31T23:13:04.506 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.503+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f76b001c070 con 0x7f76b8103eb0 2024-03-31T23:13:04.506 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.504+0000 7f76aeffd700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76a40a2530 0x7f76a40a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:04.506 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.504+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f76b00cd500 con 0x7f76b8103eb0 2024-03-31T23:13:04.506 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.504+0000 7f76bdf88700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76a40a2530 0x7f76a40a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:04.507 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.505+0000 7f76bdf88700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76a40a2530 0x7f76a40a49f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76b4005fd0 tx=0x7f76b4005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:13:04.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.508+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f76b009b200 con 0x7f76b8103eb0 2024-03-31T23:13:04.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:04 smithi042 ceph-mon[32380]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:04.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:04 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi094 2024-03-31T23:13:04.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:04 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi094 to 5693M 2024-03-31T23:13:04.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:04 smithi042 ceph-mon[32380]: osdmap e52: 8 total, 8 up, 8 in 2024-03-31T23:13:04.710 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:04.709+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f76b8062680 con 0x7f76a40a2530 2024-03-31T23:13:04.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:04 smithi188 ceph-mon[36068]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:04.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:04 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi094 2024-03-31T23:13:04.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:04 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi094 to 5693M 2024-03-31T23:13:04.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:04 smithi188 ceph-mon[36068]: osdmap e52: 8 total, 8 up, 8 in 2024-03-31T23:13:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:04 smithi094 ceph-mon[36167]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-03-31T23:13:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:04 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi094 2024-03-31T23:13:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:04 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi094 to 5693M 2024-03-31T23:13:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:04 smithi094 ceph-mon[36167]: osdmap e52: 8 total, 8 up, 8 in 2024-03-31T23:13:05.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:05 smithi188 ceph-mon[36068]: osdmap e53: 8 total, 8 up, 8 in 2024-03-31T23:13:05.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:05 smithi188 ceph-mon[36068]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:05.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:05 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:05.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:05 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:05.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:05 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:05.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:05 smithi042 ceph-mon[32380]: osdmap e53: 8 total, 8 up, 8 in 2024-03-31T23:13:05.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:05 smithi042 ceph-mon[32380]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:05.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:05 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:05.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:05 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:05.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:05 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:05 smithi094 ceph-mon[36167]: osdmap e53: 8 total, 8 up, 8 in 2024-03-31T23:13:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:05 smithi094 ceph-mon[36167]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:05 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:05 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:05 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:06.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:06 smithi188 ceph-mon[36068]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:06.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:06 smithi188 ceph-mon[36068]: osdmap e54: 8 total, 8 up, 8 in 2024-03-31T23:13:06.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:06 smithi042 ceph-mon[32380]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:06 smithi042 ceph-mon[32380]: osdmap e54: 8 total, 8 up, 8 in 2024-03-31T23:13:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:06 smithi094 ceph-mon[36167]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:06 smithi094 ceph-mon[36167]: osdmap e54: 8 total, 8 up, 8 in 2024-03-31T23:13:07.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:07 smithi188 ceph-mon[36068]: osdmap e55: 8 total, 8 up, 8 in 2024-03-31T23:13:07.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:07 smithi042 ceph-mon[32380]: osdmap e55: 8 total, 8 up, 8 in 2024-03-31T23:13:07.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:07 smithi094 ceph-mon[36167]: osdmap e55: 8 total, 8 up, 8 in 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/2688819783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]: dispatch 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]: dispatch 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]': finished 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: osdmap e56: 9 total, 8 up, 9 in 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:08 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/3714860982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:08.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:08.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/2688819783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]: dispatch 2024-03-31T23:13:08.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]: dispatch 2024-03-31T23:13:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]': finished 2024-03-31T23:13:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: osdmap e56: 9 total, 8 up, 9 in 2024-03-31T23:13:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:08 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/3714860982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/2688819783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]: dispatch 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]: dispatch 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "290efe08-cf7f-4cfb-8dcf-c346705f3b7c"}]': finished 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: osdmap e56: 9 total, 8 up, 9 in 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:08.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:08 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/3714860982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:10.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:10 smithi188 ceph-mon[36068]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:10.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:10 smithi042 ceph-mon[32380]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:10.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:10 smithi094 ceph-mon[36167]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:12.588 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:12 smithi188 ceph-mon[36068]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:12.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:12 smithi042 ceph-mon[32380]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:12 smithi094 ceph-mon[36167]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:14.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:14 smithi188 ceph-mon[36068]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:14.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:14 smithi042 ceph-mon[32380]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:14 smithi094 ceph-mon[36167]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:15.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:15 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-31T23:13:15.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:15 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:15.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:15 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-31T23:13:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:15 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:15 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-31T23:13:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:15 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:16.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:16 smithi188 ceph-mon[36068]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:16.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:16 smithi188 ceph-mon[36068]: Deploying daemon osd.8 on smithi188 2024-03-31T23:13:16.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:16 smithi042 ceph-mon[32380]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:16.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:16 smithi042 ceph-mon[32380]: Deploying daemon osd.8 on smithi188 2024-03-31T23:13:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:16 smithi094 ceph-mon[36167]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:16 smithi094 ceph-mon[36167]: Deploying daemon osd.8 on smithi188 2024-03-31T23:13:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:18 smithi188 ceph-mon[36068]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:18.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:18 smithi042 ceph-mon[32380]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:18.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:18 smithi094 ceph-mon[36167]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:20 smithi188 ceph-mon[36068]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:20.724 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:20 smithi094 ceph-mon[36167]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:20.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:20 smithi042 ceph-mon[32380]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:21.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:21.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:21.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:21.920 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:21.920 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:21.920 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:22.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:22 smithi188 ceph-mon[36068]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:22.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:22 smithi042 ceph-mon[32380]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:22.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:22 smithi094 ceph-mon[36167]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:24.031 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 8 on host 'smithi188' 2024-03-31T23:13:24.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.031+0000 7f76aeffd700 1 -- 172.21.15.188:0/890979872 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f76b8062680 con 0x7f76a40a2530 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.032+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76a40a2530 msgr2=0x7f76a40a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.032+0000 7f76c01ec700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76a40a2530 0x7f76a40a49f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76b4005fd0 tx=0x7f76b4005e40 comp rx=0 tx=0).stop 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 msgr2=0x7f76b8101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 0x7f76b8101a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b970 tx=0x7f76b000bd30 comp rx=0 tx=0).stop 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 shutdown_connections 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76a40a2530 0x7f76a40a49f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76b8103eb0 0x7f76b8101a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76b8100530 0x7f76b8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 --2- 172.21.15.188:0/890979872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76b8103510 0x7f76b81014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 >> 172.21.15.188:0/890979872 conn(0x7f76b80fbeb0 msgr2=0x7f76b8106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:13:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 shutdown_connections 2024-03-31T23:13:24.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:13:24.033+0000 7f76c01ec700 1 -- 172.21.15.188:0/890979872 wait complete. 2024-03-31T23:13:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:24 smithi188 ceph-mon[36068]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:24 smithi188 ceph-mon[36068]: from='osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-31T23:13:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:24 smithi188 ceph-mon[36068]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-31T23:13:24.653 DEBUG:teuthology.orchestra.run.smithi188:osd.8> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.8.service 2024-03-31T23:13:24.655 INFO:tasks.cephadm:Deploying osd.9 on smithi042 with /dev/vg_nvme/lv_1... 2024-03-31T23:13:24.656 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-31T23:13:24.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:24 smithi042 ceph-mon[32380]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:24.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:24.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:24.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:24 smithi042 ceph-mon[32380]: from='osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-31T23:13:24.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:24 smithi042 ceph-mon[32380]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-31T23:13:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:13:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:24 smithi094 ceph-mon[36167]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:24 smithi094 ceph-mon[36167]: from='osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-31T23:13:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:24 smithi094 ceph-mon[36167]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: osdmap e57: 9 total, 8 up, 9 in 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: from='osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:13:26.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:25 smithi188 ceph-mon[36068]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: osdmap e57: 9 total, 8 up, 9 in 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: from='osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:13:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:25 smithi042 ceph-mon[32380]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:13:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-31T23:13:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: osdmap e57: 9 total, 8 up, 9 in 2024-03-31T23:13:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:26.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: from='osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:13:26.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:25 smithi094 ceph-mon[36167]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:13:26.401 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:13:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:13:25.998+0000 7f7ef2b03700 -1 osd.8 0 waiting for initial osdmap 2024-03-31T23:13:26.401 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:13:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:13:26.011+0000 7f7eee8f6700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:13:27.000 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:26 smithi188 ceph-mon[36068]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:13:27.000 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:27 smithi188 ceph-mon[36068]: osdmap e58: 9 total, 8 up, 9 in 2024-03-31T23:13:27.000 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:27 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:27.000 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:27 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:27.074 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-31T23:13:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-31T23:13:27.075 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 10+0 records in 2024-03-31T23:13:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:10+0 records out 2024-03-31T23:13:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00860117 s, 1.2 GB/s 2024-03-31T23:13:27.075 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 2024-03-31T23:13:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping successful for: 2024-03-31T23:13:27.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:26 smithi042 ceph-mon[32380]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:13:27.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:26 smithi042 ceph-mon[32380]: osdmap e58: 9 total, 8 up, 9 in 2024-03-31T23:13:27.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:27.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:27.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:26 smithi094 ceph-mon[36167]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:13:27.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:26 smithi094 ceph-mon[36167]: osdmap e58: 9 total, 8 up, 9 in 2024-03-31T23:13:27.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:27.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:27.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi042:vg_nvme/lv_1 2024-03-31T23:13:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:13:28.185 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:28 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:13:28.185 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:28 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:13:28.185 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:28 smithi188 ceph-mon[36068]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:28.185 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:28 smithi188 ceph-mon[36068]: osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] boot 2024-03-31T23:13:28.185 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:28 smithi188 ceph-mon[36068]: osdmap e59: 9 total, 9 up, 9 in 2024-03-31T23:13:28.185 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:28 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:28.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:28 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:13:28.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:28 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:13:28.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:28 smithi042 ceph-mon[32380]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:28.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:28 smithi042 ceph-mon[32380]: osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] boot 2024-03-31T23:13:28.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:28 smithi042 ceph-mon[32380]: osdmap e59: 9 total, 9 up, 9 in 2024-03-31T23:13:28.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:28 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:28.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:28 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:13:28.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:28 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:13:28.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:28 smithi094 ceph-mon[36167]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-03-31T23:13:28.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:28 smithi094 ceph-mon[36167]: osd.8 [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] boot 2024-03-31T23:13:28.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:28 smithi094 ceph-mon[36167]: osdmap e59: 9 total, 9 up, 9 in 2024-03-31T23:13:28.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:28 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: osdmap e60: 9 total, 9 up, 9 in 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi188 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi188 to 5693M 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:29.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:29.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:29.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:29.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:29.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: osdmap e60: 9 total, 9 up, 9 in 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi188 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi188 to 5693M 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:29.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: osdmap e60: 9 total, 9 up, 9 in 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi188 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi188 to 5693M 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:29.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:29.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:29.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:29.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:29.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 -- 172.21.15.42:0/1343367553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103620 msgr2=0x7f2300103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 --2- 172.21.15.42:0/1343367553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103620 0x7f2300103a80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0099c0 tx=0x7f22ec009cd0 comp rx=0 tx=0).stop 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 -- 172.21.15.42:0/1343367553 shutdown_connections 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 --2- 172.21.15.42:0/1343367553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2300103fc0 0x7f230010a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 --2- 172.21.15.42:0/1343367553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23001005a0 0x7f23001009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 --2- 172.21.15.42:0/1343367553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103620 0x7f2300103a80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 -- 172.21.15.42:0/1343367553 >> 172.21.15.42:0/1343367553 conn(0x7f23000fbee0 msgr2=0x7f23000fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 -- 172.21.15.42:0/1343367553 shutdown_connections 2024-03-31T23:13:29.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 -- 172.21.15.42:0/1343367553 wait complete. 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 Processor -- start 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.908+0000 7f2306a8f700 1 -- start start 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23001005a0 0x7f2300102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2300103620 0x7f23001015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 0x7f2300101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f230010df90 con 0x7f2300103fc0 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f230010de10 con 0x7f2300103620 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f230010e110 con 0x7f23001005a0 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 0x7f2300101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 0x7f2300101b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56738/0 (socket says 172.21.15.42:56738) 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 -- 172.21.15.42:0/2431904682 learned_addr learned my addr 172.21.15.42:0/2431904682 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f22fffff700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2300103620 0x7f23001015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230482b700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23001005a0 0x7f2300102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:29.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 -- 172.21.15.42:0/2431904682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23001005a0 msgr2=0x7f2300102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:29.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23001005a0 0x7f2300102f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:29.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 -- 172.21.15.42:0/2431904682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2300103620 msgr2=0x7f23001015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:29.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2300103620 0x7f23001015d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:29.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 -- 172.21.15.42:0/2431904682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23001023c0 con 0x7f2300103fc0 2024-03-31T23:13:29.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f230502c700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 0x7f2300101b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007ee0 tx=0x7f22f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:13:29.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8004bb0 con 0x7f2300103fc0 2024-03-31T23:13:29.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22f8004d50 con 0x7f2300103fc0 2024-03-31T23:13:29.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.909+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23001a2720 con 0x7f2300103fc0 2024-03-31T23:13:29.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.910+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f80059b0 con 0x7f2300103fc0 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.910+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23001a2c30 con 0x7f2300103fc0 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.911+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2300068f00 con 0x7f2300103fc0 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.912+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f22f801a020 con 0x7f2300103fc0 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.912+0000 7f22fdffb700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f22f00a2530 0x7f22f00a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.912+0000 7f230482b700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f22f00a2530 0x7f22f00a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.912+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5858+0+0 (secure 0 0 0) 0x7f22f80cd410 con 0x7f2300103fc0 2024-03-31T23:13:29.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.913+0000 7f230482b700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f22f00a2530 0x7f22f00a49f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f230006a680 tx=0x7f22f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:13:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:29.917+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f22f8010070 con 0x7f2300103fc0 2024-03-31T23:13:30.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:30.131+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2300062680 con 0x7f22f00a2530 2024-03-31T23:13:30.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:30 smithi042 ceph-mon[32380]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:30.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:30 smithi042 ceph-mon[32380]: osdmap e61: 9 total, 9 up, 9 in 2024-03-31T23:13:30.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:30 smithi094 ceph-mon[36167]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:30.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:30 smithi094 ceph-mon[36167]: osdmap e61: 9 total, 9 up, 9 in 2024-03-31T23:13:30.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:30 smithi188 ceph-mon[36068]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:30.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:30 smithi188 ceph-mon[36068]: osdmap e61: 9 total, 9 up, 9 in 2024-03-31T23:13:31.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:31 smithi042 ceph-mon[32380]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:31.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:31.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:31.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:31.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:31 smithi042 ceph-mon[32380]: osdmap e62: 9 total, 9 up, 9 in 2024-03-31T23:13:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:31 smithi094 ceph-mon[36167]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:31 smithi094 ceph-mon[36167]: osdmap e62: 9 total, 9 up, 9 in 2024-03-31T23:13:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:31 smithi188 ceph-mon[36068]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:31.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:31.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:31 smithi188 ceph-mon[36068]: osdmap e62: 9 total, 9 up, 9 in 2024-03-31T23:13:32.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:32 smithi188 ceph-mon[36068]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:32.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:32 smithi188 ceph-mon[36068]: osdmap e63: 9 total, 9 up, 9 in 2024-03-31T23:13:32.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:32 smithi042 ceph-mon[32380]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:32.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:32 smithi042 ceph-mon[32380]: osdmap e63: 9 total, 9 up, 9 in 2024-03-31T23:13:32.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:32 smithi094 ceph-mon[36167]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:32.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:32 smithi094 ceph-mon[36167]: osdmap e63: 9 total, 9 up, 9 in 2024-03-31T23:13:33.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:33 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/698441095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b15764c-d0d6-4f5b-89e1-4f1c3b673599"}]: dispatch 2024-03-31T23:13:33.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:33 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/698441095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b15764c-d0d6-4f5b-89e1-4f1c3b673599"}]': finished 2024-03-31T23:13:33.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:33 smithi188 ceph-mon[36068]: osdmap e64: 10 total, 9 up, 10 in 2024-03-31T23:13:33.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:33.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:33 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/698441095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b15764c-d0d6-4f5b-89e1-4f1c3b673599"}]: dispatch 2024-03-31T23:13:33.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:33 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/698441095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b15764c-d0d6-4f5b-89e1-4f1c3b673599"}]': finished 2024-03-31T23:13:33.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:33 smithi042 ceph-mon[32380]: osdmap e64: 10 total, 9 up, 10 in 2024-03-31T23:13:33.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:33 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/698441095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b15764c-d0d6-4f5b-89e1-4f1c3b673599"}]: dispatch 2024-03-31T23:13:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:33 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/698441095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b15764c-d0d6-4f5b-89e1-4f1c3b673599"}]': finished 2024-03-31T23:13:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:33 smithi094 ceph-mon[36167]: osdmap e64: 10 total, 9 up, 10 in 2024-03-31T23:13:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:34.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:34 smithi188 ceph-mon[36068]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:34.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:34 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2537899874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:34.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:34 smithi042 ceph-mon[32380]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:34.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:34 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2537899874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:34.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:34 smithi094 ceph-mon[36167]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:34.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:34 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2537899874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:36.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:36 smithi188 ceph-mon[36068]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-31T23:13:36.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:36 smithi042 ceph-mon[32380]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-31T23:13:36.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:36 smithi094 ceph-mon[36167]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-31T23:13:38.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:38 smithi188 ceph-mon[36068]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-31T23:13:38.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:38 smithi042 ceph-mon[32380]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-31T23:13:38.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:38 smithi094 ceph-mon[36167]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-31T23:13:40.557 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:40 smithi042 ceph-mon[32380]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-31T23:13:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:40 smithi188 ceph-mon[36068]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-31T23:13:40.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:40 smithi094 ceph-mon[36167]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-31T23:13:41.486 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-31T23:13:41.486 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:41.487 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:41 smithi042 ceph-mon[32380]: Deploying daemon osd.9 on smithi042 2024-03-31T23:13:41.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-31T23:13:41.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:41.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:41 smithi188 ceph-mon[36068]: Deploying daemon osd.9 on smithi042 2024-03-31T23:13:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-31T23:13:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:41 smithi094 ceph-mon[36167]: Deploying daemon osd.9 on smithi042 2024-03-31T23:13:42.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:42 smithi042 ceph-mon[32380]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-31T23:13:42.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:42 smithi188 ceph-mon[36068]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-31T23:13:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:42 smithi094 ceph-mon[36167]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-31T23:13:44.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:44 smithi188 ceph-mon[36068]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-31T23:13:44.731 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:44 smithi042 ceph-mon[32380]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-31T23:13:44.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:44 smithi094 ceph-mon[36167]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-31T23:13:46.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:46 smithi188 ceph-mon[36068]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-03-31T23:13:46.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:46 smithi042 ceph-mon[32380]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-03-31T23:13:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:46 smithi094 ceph-mon[36167]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-03-31T23:13:47.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:47.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:47.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:47.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:47.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:47.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:48.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:48 smithi188 ceph-mon[36068]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:48.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:48 smithi042 ceph-mon[32380]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:48.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:48 smithi094 ceph-mon[36167]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:50.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.457+0000 7f22fdffb700 1 -- 172.21.15.42:0/2431904682 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2300062680 con 0x7f22f00a2530 2024-03-31T23:13:50.459 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 9 on host 'smithi042' 2024-03-31T23:13:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.459+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f22f00a2530 msgr2=0x7f22f00a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.459+0000 7f2306a8f700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f22f00a2530 0x7f22f00a49f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f230006a680 tx=0x7f22f4009260 comp rx=0 tx=0).stop 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 msgr2=0x7f2300101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 0x7f2300101b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007ee0 tx=0x7f22f800d3b0 comp rx=0 tx=0).stop 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 shutdown_connections 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f22f00a2530 0x7f22f00a49f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23001005a0 0x7f2300102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2300103fc0 0x7f2300101b10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 --2- 172.21.15.42:0/2431904682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2300103620 0x7f23001015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 >> 172.21.15.42:0/2431904682 conn(0x7f23000fbee0 msgr2=0x7f2300106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 shutdown_connections 2024-03-31T23:13:50.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:13:50.460+0000 7f2306a8f700 1 -- 172.21.15.42:0/2431904682 wait complete. 2024-03-31T23:13:50.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:50.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:50 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:50.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:50.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:50.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:50.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-31T23:13:50.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:50 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:50 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:13:51.072 DEBUG:teuthology.orchestra.run.smithi042:osd.9> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.9.service 2024-03-31T23:13:51.075 INFO:tasks.cephadm:Deploying osd.10 on smithi094 with /dev/vg_nvme/lv_1... 2024-03-31T23:13:51.075 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-31T23:13:51.321 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:13:51.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:51 smithi094 ceph-mon[36167]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-31T23:13:51.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:51 smithi094 ceph-mon[36167]: osdmap e65: 10 total, 9 up, 10 in 2024-03-31T23:13:51.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:51 smithi094 ceph-mon[36167]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:13:51.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:51 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:51 smithi042 ceph-mon[32380]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-31T23:13:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:51 smithi042 ceph-mon[32380]: osdmap e65: 10 total, 9 up, 10 in 2024-03-31T23:13:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:51 smithi042 ceph-mon[32380]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:13:51.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:51 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:51.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:13:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:13:51.581+0000 7f1cb3567700 -1 osd.9 0 waiting for initial osdmap 2024-03-31T23:13:51.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:13:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:13:51.593+0000 7f1caf35a700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:13:51.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:51 smithi188 ceph-mon[36068]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-31T23:13:51.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:51 smithi188 ceph-mon[36068]: osdmap e65: 10 total, 9 up, 10 in 2024-03-31T23:13:51.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:51 smithi188 ceph-mon[36068]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-03-31T23:13:51.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:51 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:52 smithi094 ceph-mon[36167]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:52 smithi094 ceph-mon[36167]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:13:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:52 smithi094 ceph-mon[36167]: osdmap e66: 10 total, 9 up, 10 in 2024-03-31T23:13:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:52 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:52.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:52 smithi042 ceph-mon[32380]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:52.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:52 smithi042 ceph-mon[32380]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:13:52.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:52 smithi042 ceph-mon[32380]: osdmap e66: 10 total, 9 up, 10 in 2024-03-31T23:13:52.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:52.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:52 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:52.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:52 smithi188 ceph-mon[36068]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:52 smithi188 ceph-mon[36068]: from='osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-03-31T23:13:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:52 smithi188 ceph-mon[36068]: osdmap e66: 10 total, 9 up, 10 in 2024-03-31T23:13:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:52 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:53.252 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-31T23:13:53.252 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-31T23:13:53.252 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-03-31T23:13:53.252 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-03-31T23:13:53.252 INFO:teuthology.orchestra.run.smithi094.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00859275 s, 1.2 GB/s 2024-03-31T23:13:53.252 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-03-31T23:13:53.898 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:53 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:13:53.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:53 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:13:53.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:53 smithi094 ceph-mon[36167]: osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] boot 2024-03-31T23:13:53.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:53 smithi094 ceph-mon[36167]: osdmap e67: 10 total, 10 up, 10 in 2024-03-31T23:13:53.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:53 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:53.925 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi094:vg_nvme/lv_1 2024-03-31T23:13:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:53 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:13:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:53 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:13:53.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:53 smithi188 ceph-mon[36068]: osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] boot 2024-03-31T23:13:53.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:53 smithi188 ceph-mon[36068]: osdmap e67: 10 total, 10 up, 10 in 2024-03-31T23:13:53.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:53 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:53 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:13:54.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:53 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:13:54.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:53 smithi042 ceph-mon[32380]: osd.9 [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] boot 2024-03-31T23:13:54.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:53 smithi042 ceph-mon[32380]: osdmap e67: 10 total, 10 up, 10 in 2024-03-31T23:13:54.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:53 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:13:54.174 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:13:54.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:54.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: osdmap e68: 10 total, 10 up, 10 in 2024-03-31T23:13:54.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:54.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:54 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:54.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: osdmap e68: 10 total, 10 up, 10 in 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:54.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:54 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: osdmap e68: 10 total, 10 up, 10 in 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:13:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:54 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:13:55.845 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:55 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi042 2024-03-31T23:13:55.845 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:55 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi042 to 4273M 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- 172.21.15.94:0/1805064087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102370 msgr2=0x7f76cc1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- 172.21.15.94:0/1805064087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102370 0x7f76cc1027d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0099c0 tx=0x7f76bc009cd0 comp rx=0 tx=0).stop 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- 172.21.15.94:0/1805064087 shutdown_connections 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- 172.21.15.94:0/1805064087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102d10 0x7f76cc1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- 172.21.15.94:0/1805064087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76cc101170 0x7f76cc101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- 172.21.15.94:0/1805064087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102370 0x7f76cc1027d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:55.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- 172.21.15.94:0/1805064087 >> 172.21.15.94:0/1805064087 conn(0x7f76cc0fc710 msgr2=0x7f76cc0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- 172.21.15.94:0/1805064087 shutdown_connections 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- 172.21.15.94:0/1805064087 wait complete. 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 Processor -- start 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- start start 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76cc101170 0x7f76cc1051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102370 0x7f76cc103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 0x7f76cc103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc10cef0 con 0x7f76cc101170 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc10cd70 con 0x7f76cc102d10 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.847+0000 7f76d43a2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc10d070 con 0x7f76cc102370 2024-03-31T23:13:55.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 0x7f76cc103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 0x7f76cc103d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53128/0 (socket says 172.21.15.94:53128) 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d213e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76cc101170 0x7f76cc1051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 -- 172.21.15.94:0/3139286050 learned_addr learned my addr 172.21.15.94:0/3139286050 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d193d700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102370 0x7f76cc103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 -- 172.21.15.94:0/3139286050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102370 msgr2=0x7f76cc103820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102370 0x7f76cc103820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 -- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76cc101170 msgr2=0x7f76cc1051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76cc101170 0x7f76cc1051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 -- 172.21.15.94:0/3139286050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc104610 con 0x7f76cc102d10 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d193d700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102370 0x7f76cc103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d293f700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 0x7f76cc103d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76c400b970 tx=0x7f76c400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4019070 con 0x7f76cc102d10 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76c400ce30 con 0x7f76cc102d10 2024-03-31T23:13:55.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40075d0 con 0x7f76cc102d10 2024-03-31T23:13:55.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc1a2750 con 0x7f76cc102d10 2024-03-31T23:13:55.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.848+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc1a2c60 con 0x7f76cc102d10 2024-03-31T23:13:55.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.849+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc1a2f20 con 0x7f76cc102d10 2024-03-31T23:13:55.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.851+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f76c401c070 con 0x7f76cc102d10 2024-03-31T23:13:55.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.851+0000 7f76c37fe700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76b80a2530 0x7f76b80a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:13:55.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.852+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f76c40cdd50 con 0x7f76cc102d10 2024-03-31T23:13:55.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.852+0000 7f76d213e700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76b80a2530 0x7f76b80a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:13:55.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.852+0000 7f76d213e700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76b80a2530 0x7f76b80a49f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76cc1021d0 tx=0x7f76c800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:13:55.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:55.855+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f76c4023070 con 0x7f76cc102d10 2024-03-31T23:13:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:55 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi042 2024-03-31T23:13:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:55 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi042 to 4273M 2024-03-31T23:13:56.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:13:56.056+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f76cc06a600 con 0x7f76b80a2530 2024-03-31T23:13:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:55 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi042 2024-03-31T23:13:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:55 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi042 to 4273M 2024-03-31T23:13:56.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:56 smithi094 ceph-mon[36167]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:13:56.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:56.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:56.899 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:56 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:56.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:56 smithi188 ceph-mon[36068]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:13:56.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:56.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:56.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:56 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:57.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:56 smithi042 ceph-mon[32380]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:13:57.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:13:57.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:13:57.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:56 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:13:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:57 smithi094 ceph-mon[36167]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:57 smithi188 ceph-mon[36068]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:58.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:57 smithi042 ceph-mon[32380]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:13:58.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:58 smithi094 ceph-mon[36167]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:13:58.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:58 smithi188 ceph-mon[36068]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:13:59.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:58 smithi042 ceph-mon[32380]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:13:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/2433115135' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]: dispatch 2024-03-31T23:13:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:59 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]: dispatch 2024-03-31T23:13:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:59 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]': finished 2024-03-31T23:13:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:59 smithi094 ceph-mon[36167]: osdmap e69: 11 total, 10 up, 11 in 2024-03-31T23:13:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:59 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:13:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:13:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.94:0/3811947059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:13:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/2433115135' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]: dispatch 2024-03-31T23:13:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:59 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]: dispatch 2024-03-31T23:13:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:59 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]': finished 2024-03-31T23:13:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:59 smithi188 ceph-mon[36068]: osdmap e69: 11 total, 10 up, 11 in 2024-03-31T23:13:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:59 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:13:59.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:13:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.94:0/3811947059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:14:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/2433115135' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]: dispatch 2024-03-31T23:14:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:59 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]: dispatch 2024-03-31T23:14:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:59 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b06f08e0-c853-4d15-8a08-c35257d23814"}]': finished 2024-03-31T23:14:00.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:59 smithi042 ceph-mon[32380]: osdmap e69: 11 total, 10 up, 11 in 2024-03-31T23:14:00.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:59 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:00.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:13:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.94:0/3811947059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:14:00.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:00 smithi094 ceph-mon[36167]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:00 smithi188 ceph-mon[36068]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:01.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:00 smithi042 ceph-mon[32380]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:02.877 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:02 smithi042 ceph-mon[32380]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:02 smithi094 ceph-mon[36167]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:02.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:02 smithi188 ceph-mon[36068]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:04.896 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:04 smithi094 ceph-mon[36167]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:04 smithi188 ceph-mon[36068]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:05.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:04 smithi042 ceph-mon[32380]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:06 smithi094 ceph-mon[36167]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-31T23:14:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:06.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:06 smithi188 ceph-mon[36068]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:06.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-31T23:14:06.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:06 smithi042 ceph-mon[32380]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-31T23:14:07.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:07.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:07 smithi094 ceph-mon[36167]: Deploying daemon osd.10 on smithi094 2024-03-31T23:14:07.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:07 smithi188 ceph-mon[36068]: Deploying daemon osd.10 on smithi094 2024-03-31T23:14:08.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:07 smithi042 ceph-mon[32380]: Deploying daemon osd.10 on smithi094 2024-03-31T23:14:08.713 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:08 smithi094 ceph-mon[36167]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:08.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:08 smithi188 ceph-mon[36068]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:09.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:08 smithi042 ceph-mon[32380]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:10.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:10 smithi094 ceph-mon[36167]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:10.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:10 smithi188 ceph-mon[36068]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:11.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:10 smithi042 ceph-mon[32380]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:12 smithi094 ceph-mon[36167]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:12.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:12 smithi188 ceph-mon[36068]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:12.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:12.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:12.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:13.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:12 smithi042 ceph-mon[32380]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:13.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:13.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:13.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:14.906 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:14 smithi094 ceph-mon[36167]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:14.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:14 smithi188 ceph-mon[36068]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:15.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:14 smithi042 ceph-mon[32380]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:15.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.973+0000 7f76c37fe700 1 -- 172.21.15.94:0/3139286050 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f76cc06a600 con 0x7f76b80a2530 2024-03-31T23:14:15.974 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 10 on host 'smithi094' 2024-03-31T23:14:15.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76b80a2530 msgr2=0x7f76b80a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:15.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76b80a2530 0x7f76b80a49f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76cc1021d0 tx=0x7f76c800b410 comp rx=0 tx=0).stop 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 msgr2=0x7f76cc103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 0x7f76cc103d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76c400b970 tx=0x7f76c400bc80 comp rx=0 tx=0).stop 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 shutdown_connections 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76b80a2530 0x7f76b80a49f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.975+0000 7f76d43a2700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76cc102d10 0x7f76cc103d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.976+0000 7f76d43a2700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76cc101170 0x7f76cc1051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.976+0000 7f76d43a2700 1 --2- 172.21.15.94:0/3139286050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76cc102370 0x7f76cc103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.976+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 >> 172.21.15.94:0/3139286050 conn(0x7f76cc0fc710 msgr2=0x7f76cc069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.976+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 shutdown_connections 2024-03-31T23:14:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-31T23:14:15.976+0000 7f76d43a2700 1 -- 172.21.15.94:0/3139286050 wait complete. 2024-03-31T23:14:16.613 DEBUG:teuthology.orchestra.run.smithi094:osd.10> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.10.service 2024-03-31T23:14:16.616 INFO:tasks.cephadm:Deploying osd.11 on smithi188 with /dev/vg_nvme/lv_1... 2024-03-31T23:14:16.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-31T23:14:16.864 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:14:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:16 smithi094 ceph-mon[36167]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:16 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:16 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:16.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:16 smithi094 ceph-mon[36167]: from='osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-31T23:14:16.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:16 smithi094 ceph-mon[36167]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-31T23:14:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:16 smithi188 ceph-mon[36068]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:16 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:16 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:16 smithi188 ceph-mon[36068]: from='osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-31T23:14:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:16 smithi188 ceph-mon[36068]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-31T23:14:17.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:16 smithi042 ceph-mon[32380]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:17.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:16 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:17.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:16 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:17.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:16 smithi042 ceph-mon[32380]: from='osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-31T23:14:17.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:16 smithi042 ceph-mon[32380]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: osdmap e70: 11 total, 10 up, 11 in 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: from='osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:14:17.976 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-mon[36167]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:14:17.977 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:14:17.958+0000 7f61e61ad700 -1 osd.10 0 waiting for initial osdmap 2024-03-31T23:14:17.977 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:14:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:14:17.974+0000 7f61e1fa0700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:14:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: osdmap e70: 11 total, 10 up, 11 in 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: from='osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:14:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:17 smithi042 ceph-mon[32380]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:14:18.154 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: osdmap e70: 11 total, 10 up, 11 in 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: from='osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:14:18.155 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:17 smithi188 ceph-mon[36068]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-03-31T23:14:19.001 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-31T23:14:19.001 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-31T23:14:19.001 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-03-31T23:14:19.001 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-03-31T23:14:19.001 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113211 s, 926 MB/s 2024-03-31T23:14:19.001 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-03-31T23:14:19.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:14:19.002 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: osdmap e71: 11 total, 10 up, 11 in 2024-03-31T23:14:19.002 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.002 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.002 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] boot 2024-03-31T23:14:19.002 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: osdmap e72: 11 total, 11 up, 11 in 2024-03-31T23:14:19.002 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:14:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: osdmap e71: 11 total, 10 up, 11 in 2024-03-31T23:14:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] boot 2024-03-31T23:14:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: osdmap e72: 11 total, 11 up, 11 in 2024-03-31T23:14:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: osdmap e71: 11 total, 10 up, 11 in 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: osd.10 [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] boot 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: osdmap e72: 11 total, 11 up, 11 in 2024-03-31T23:14:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:14:19.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_1 2024-03-31T23:14:20.015 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:14:20.137 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:19 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:14:20.137 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:19 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:14:20.137 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:19 smithi188 ceph-mon[36068]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:20.137 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:19 smithi188 ceph-mon[36068]: osdmap e73: 11 total, 11 up, 11 in 2024-03-31T23:14:20.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:19 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:14:20.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:19 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:14:20.324 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:19 smithi094 ceph-mon[36167]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:20.325 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:19 smithi094 ceph-mon[36167]: osdmap e73: 11 total, 11 up, 11 in 2024-03-31T23:14:20.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:19 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:14:20.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:19 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:14:20.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:19 smithi042 ceph-mon[32380]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-03-31T23:14:20.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:19 smithi042 ceph-mon[32380]: osdmap e73: 11 total, 11 up, 11 in 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi094 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi094 to 4270M 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: osdmap e74: 11 total, 11 up, 11 in 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:21.595 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.677 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi094 2024-03-31T23:14:21.677 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.677 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi094 to 4270M 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.678 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: osdmap e74: 11 total, 11 up, 11 in 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:21.679 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi094 2024-03-31T23:14:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi094 to 4270M 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: osdmap e74: 11 total, 11 up, 11 in 2024-03-31T23:14:21.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:21.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:21.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:21.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:21.830 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1357765099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0107ff0 msgr2=0x7fc1e010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1357765099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0107ff0 0x7fc1e010a3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b0a0 tx=0x7fc1d800b3b0 comp rx=0 tx=0).stop 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1357765099 shutdown_connections 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1357765099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0107ff0 0x7fc1e010a3e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1357765099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1e0102d90 0x7fc1e0105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1357765099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e01056c0 0x7fc1e0107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.828+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1357765099 >> 172.21.15.188:0/1357765099 conn(0x7fc1e00fc700 msgr2=0x7fc1e00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.829+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1357765099 shutdown_connections 2024-03-31T23:14:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.829+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1357765099 wait complete. 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.829+0000 7fc1e5dfa700 1 Processor -- start 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.829+0000 7fc1e5dfa700 1 -- start start 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 0x7fc1e01026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1e01056c0 0x7fc1e0100d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0107ff0 0x7fc1e0101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e010df50 con 0x7fc1e01056c0 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e010ddd0 con 0x7fc1e0107ff0 2024-03-31T23:14:21.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e010e0d0 con 0x7fc1e0102d90 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 0x7fc1e01026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 0x7fc1e01026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:54338/0 (socket says 172.21.15.188:54338) 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 -- 172.21.15.188:0/1778653814 learned_addr learned my addr 172.21.15.188:0/1778653814 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1deffd700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1e01056c0 0x7fc1e0100d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1dffff700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0107ff0 0x7fc1e0101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 -- 172.21.15.188:0/1778653814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0107ff0 msgr2=0x7fc1e0101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0107ff0 0x7fc1e0101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 -- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1e01056c0 msgr2=0x7fc1e0100d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1e01056c0 0x7fc1e0100d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 -- 172.21.15.188:0/1778653814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e0101b30 con 0x7fc1e0102d90 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1df7fe700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 0x7fc1e01026f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000e9a0 tx=0x7fc1d000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000cbd0 con 0x7fc1e0102d90 2024-03-31T23:14:21.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01a2620 con 0x7fc1e0102d90 2024-03-31T23:14:21.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc1d000cd70 con 0x7fc1e0102d90 2024-03-31T23:14:21.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0018810 con 0x7fc1e0102d90 2024-03-31T23:14:21.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.830+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e01a2b30 con 0x7fc1e0102d90 2024-03-31T23:14:21.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.831+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0068f00 con 0x7fc1e0102d90 2024-03-31T23:14:21.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.832+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fc1d00189b0 con 0x7fc1e0102d90 2024-03-31T23:14:21.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.833+0000 7fc1dcff9700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1c80a2530 0x7fc1c80a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:21.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.833+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7fc1d00ce8a0 con 0x7fc1e0102d90 2024-03-31T23:14:21.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.833+0000 7fc1deffd700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1c80a2530 0x7fc1c80a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:21.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.834+0000 7fc1deffd700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1c80a2530 0x7fc1c80a49f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4005950 tx=0x7fc1d40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:21.838 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:21.837+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc1d009c090 con 0x7fc1e0102d90 2024-03-31T23:14:22.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:22.041+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc1e0062680 con 0x7fc1c80a2530 2024-03-31T23:14:22.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:22 smithi188 ceph-mon[36068]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:22.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:22 smithi188 ceph-mon[36068]: osdmap e75: 11 total, 11 up, 11 in 2024-03-31T23:14:22.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:22 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:14:22.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:22 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:14:22.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:22 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:22.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:22 smithi042 ceph-mon[32380]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:22.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:22 smithi042 ceph-mon[32380]: osdmap e75: 11 total, 11 up, 11 in 2024-03-31T23:14:22.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:22 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:14:22.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:22 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:14:22.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:22 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:22.887 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:22 smithi094 ceph-mon[36167]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:22.888 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:22 smithi094 ceph-mon[36167]: osdmap e75: 11 total, 11 up, 11 in 2024-03-31T23:14:22.888 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:22 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-31T23:14:22.888 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:22 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-31T23:14:22.888 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:22 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:23 smithi188 ceph-mon[36068]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:14:23.692 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:23 smithi188 ceph-mon[36068]: osdmap e76: 11 total, 11 up, 11 in 2024-03-31T23:14:23.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:23 smithi042 ceph-mon[32380]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:14:23.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:23 smithi042 ceph-mon[32380]: osdmap e76: 11 total, 11 up, 11 in 2024-03-31T23:14:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:23 smithi094 ceph-mon[36167]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:14:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:23 smithi094 ceph-mon[36167]: osdmap e76: 11 total, 11 up, 11 in 2024-03-31T23:14:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:24 smithi188 ceph-mon[36068]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:24.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:24 smithi042 ceph-mon[32380]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:24.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:24 smithi094 ceph-mon[36167]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:25.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:25 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/2479287260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]: dispatch 2024-03-31T23:14:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:25 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]: dispatch 2024-03-31T23:14:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:25 smithi188 ceph-mon[36068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]': finished 2024-03-31T23:14:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:25 smithi188 ceph-mon[36068]: osdmap e77: 12 total, 11 up, 12 in 2024-03-31T23:14:25.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:25 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:25 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/2479287260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]: dispatch 2024-03-31T23:14:25.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:25 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]: dispatch 2024-03-31T23:14:25.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:25 smithi042 ceph-mon[32380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]': finished 2024-03-31T23:14:25.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:25 smithi042 ceph-mon[32380]: osdmap e77: 12 total, 11 up, 12 in 2024-03-31T23:14:25.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:25 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:25 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/2479287260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]: dispatch 2024-03-31T23:14:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:25 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]: dispatch 2024-03-31T23:14:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:25 smithi094 ceph-mon[36167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "047cc9e9-aff1-433b-b4df-145e31c678c8"}]': finished 2024-03-31T23:14:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:25 smithi094 ceph-mon[36167]: osdmap e77: 12 total, 11 up, 12 in 2024-03-31T23:14:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:25 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:26.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:26 smithi188 ceph-mon[36068]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-31T23:14:26.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:26 smithi188 ceph-mon[36068]: from='client.? 172.21.15.188:0/575258142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:14:26.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:26 smithi042 ceph-mon[32380]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-31T23:14:26.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:26 smithi042 ceph-mon[32380]: from='client.? 172.21.15.188:0/575258142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:14:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:26 smithi094 ceph-mon[36167]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-31T23:14:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:26 smithi094 ceph-mon[36167]: from='client.? 172.21.15.188:0/575258142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-31T23:14:28.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:28 smithi188 ceph-mon[36068]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:14:28.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:28 smithi042 ceph-mon[32380]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:14:28.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:28 smithi094 ceph-mon[36167]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-31T23:14:30.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:30 smithi188 ceph-mon[36068]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-31T23:14:30.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:30 smithi042 ceph-mon[32380]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-31T23:14:30.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:30 smithi094 ceph-mon[36167]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-31T23:14:32.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:32 smithi094 ceph-mon[36167]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-03-31T23:14:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:32 smithi042 ceph-mon[32380]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-03-31T23:14:32.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:32 smithi188 ceph-mon[36068]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-03-31T23:14:33.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-31T23:14:33.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:33.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:33 smithi188 ceph-mon[36068]: Deploying daemon osd.11 on smithi188 2024-03-31T23:14:33.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-31T23:14:33.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:33.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:33 smithi042 ceph-mon[32380]: Deploying daemon osd.11 on smithi188 2024-03-31T23:14:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-31T23:14:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:33 smithi094 ceph-mon[36167]: Deploying daemon osd.11 on smithi188 2024-03-31T23:14:34.740 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:34 smithi188 ceph-mon[36068]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-31T23:14:34.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:34 smithi042 ceph-mon[32380]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-31T23:14:34.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:34 smithi094 ceph-mon[36167]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-31T23:14:36.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:36 smithi188 ceph-mon[36068]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:36.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:36 smithi042 ceph-mon[32380]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:36.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:36 smithi094 ceph-mon[36167]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:38.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:38 smithi188 ceph-mon[36068]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:38.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:38 smithi042 ceph-mon[32380]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:38.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:38 smithi094 ceph-mon[36167]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:39.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:39 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:39.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:39 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:39.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:39 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:39.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:39 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:39.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:39 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:39.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:39 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:39 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:40 smithi188 ceph-mon[36068]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:40.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:40 smithi042 ceph-mon[32380]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:40.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:40 smithi094 ceph-mon[36167]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:41.860 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 11 on host 'smithi188' 2024-03-31T23:14:41.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.859+0000 7fc1dcff9700 1 -- 172.21.15.188:0/1778653814 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc1e0062680 con 0x7fc1c80a2530 2024-03-31T23:14:41.862 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1c80a2530 msgr2=0x7fc1c80a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:41.862 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1c80a2530 0x7fc1c80a49f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4005950 tx=0x7fc1d40058e0 comp rx=0 tx=0).stop 2024-03-31T23:14:41.862 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 msgr2=0x7fc1e01026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 0x7fc1e01026f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000e9a0 tx=0x7fc1d000ed60 comp rx=0 tx=0).stop 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 shutdown_connections 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1c80a2530 0x7fc1c80a49f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1e0102d90 0x7fc1e01026f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0107ff0 0x7fc1e0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 --2- 172.21.15.188:0/1778653814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1e01056c0 0x7fc1e0100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.861+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 >> 172.21.15.188:0/1778653814 conn(0x7fc1e00fc700 msgr2=0x7fc1e01036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.862+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 shutdown_connections 2024-03-31T23:14:41.863 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:41.862+0000 7fc1e5dfa700 1 -- 172.21.15.188:0/1778653814 wait complete. 2024-03-31T23:14:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:42 smithi042 ceph-mon[32380]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:42.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:42 smithi042 ceph-mon[32380]: from='osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:42 smithi042 ceph-mon[32380]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:42 smithi188 ceph-mon[36068]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:42.826 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:42 smithi188 ceph-mon[36068]: from='osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-31T23:14:42.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:42 smithi188 ceph-mon[36068]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-31T23:14:42.853 DEBUG:teuthology.orchestra.run.smithi188:osd.11> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.11.service 2024-03-31T23:14:42.856 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-31T23:14:42.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-03-31T23:14:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:42 smithi094 ceph-mon[36167]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:42 smithi094 ceph-mon[36167]: from='osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-31T23:14:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:42 smithi094 ceph-mon[36167]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-31T23:14:43.112 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: from='osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: osdmap e78: 12 total, 11 up, 12 in 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:43.955 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:43.956 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:14:43.848+0000 7f47c1698700 -1 osd.11 0 waiting for initial osdmap 2024-03-31T23:14:43.956 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:14:43 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:14:43.863+0000 7f47bd48b700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: from='osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: osdmap e78: 12 total, 11 up, 12 in 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:43 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: from='osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: osdmap e78: 12 total, 11 up, 12 in 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:44.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:43 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:44.945 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:44 smithi188 ceph-mon[36068]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:14:44.945 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:44 smithi188 ceph-mon[36068]: osdmap e79: 12 total, 11 up, 12 in 2024-03-31T23:14:44.946 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:44.946 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:44 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 -- 172.21.15.42:0/284260591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 msgr2=0x7fc300101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 --2- 172.21.15.42:0/284260591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc300101590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0099c0 tx=0x7fc2fc009cd0 comp rx=0 tx=0).stop 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 -- 172.21.15.42:0/284260591 shutdown_connections 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 --2- 172.21.15.42:0/284260591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300102d10 0x7fc3001095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 --2- 172.21.15.42:0/284260591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc300101590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 --2- 172.21.15.42:0/284260591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc300102370 0x7fc3001027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 -- 172.21.15.42:0/284260591 >> 172.21.15.42:0/284260591 conn(0x7fc3000fc710 msgr2=0x7fc3000feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 -- 172.21.15.42:0/284260591 shutdown_connections 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.961+0000 7fc307983700 1 -- 172.21.15.42:0/284260591 wait complete. 2024-03-31T23:14:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 Processor -- start 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 -- start start 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc30006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300102370 0x7fc30019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc300102d10 0x7fc3001a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc30010ce70 con 0x7fc300101170 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc30010ccf0 con 0x7fc300102370 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc307983700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc30010cff0 con 0x7fc300102d10 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc30006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc30006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43148/0 (socket says 172.21.15.42:43148) 2024-03-31T23:14:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 -- 172.21.15.42:0/1236128339 learned_addr learned my addr 172.21.15.42:0/1236128339 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 -- 172.21.15.42:0/1236128339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc300102d10 msgr2=0x7fc3001a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc300102d10 0x7fc3001a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 -- 172.21.15.42:0/1236128339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300102370 msgr2=0x7fc30019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300102370 0x7fc30019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 -- 172.21.15.42:0/1236128339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3001a2400 con 0x7fc300101170 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.962+0000 7fc30571f700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc30006aa50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00f6f0 tx=0x7fc2fc00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.963+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc027070 con 0x7fc300101170 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.963+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2fc00be40 con 0x7fc300101170 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.963+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3001a2690 con 0x7fc300101170 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.963+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0173f0 con 0x7fc300101170 2024-03-31T23:14:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.963+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3001a2bc0 con 0x7fc300101170 2024-03-31T23:14:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.964+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc300068f00 con 0x7fc300101170 2024-03-31T23:14:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.965+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fc2fc02a070 con 0x7fc300101170 2024-03-31T23:14:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.965+0000 7fc2f67fc700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2ec0a25b0 0x7fc2ec0a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.966+0000 7fc304f1e700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2ec0a25b0 0x7fc2ec0a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.966+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7fc2fc0cf210 con 0x7fc300101170 2024-03-31T23:14:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.966+0000 7fc304f1e700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2ec0a25b0 0x7fc2ec0a4a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0005950 tx=0x7fc2f00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:44.969+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc2fc031080 con 0x7fc300101170 2024-03-31T23:14:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:44 smithi094 ceph-mon[36167]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:14:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:44 smithi094 ceph-mon[36167]: osdmap e79: 12 total, 11 up, 12 in 2024-03-31T23:14:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:44 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:45.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.172+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc300062e50 con 0x7fc300101170 2024-03-31T23:14:45.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:44 smithi042 ceph-mon[32380]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-03-31T23:14:45.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:44 smithi042 ceph-mon[32380]: osdmap e79: 12 total, 11 up, 12 in 2024-03-31T23:14:45.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:45.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:44 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:45.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.173+0000 7fc2f67fc700 1 -- 172.21.15.42:0/1236128339 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7fc2fc013070 con 0x7fc300101170 2024-03-31T23:14:45.174 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:14:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2ec0a25b0 msgr2=0x7fc2ec0a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2ec0a25b0 0x7fc2ec0a4a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0005950 tx=0x7fc2f00058e0 comp rx=0 tx=0).stop 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 msgr2=0x7fc30006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc30006aa50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00f6f0 tx=0x7fc2fc00f7d0 comp rx=0 tx=0).stop 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 shutdown_connections 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2ec0a25b0 0x7fc2ec0a4a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc300102d10 0x7fc3001a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc300101170 0x7fc30006aa50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 --2- 172.21.15.42:0/1236128339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300102370 0x7fc30019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 >> 172.21.15.42:0/1236128339 conn(0x7fc3000fc710 msgr2=0x7fc300105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 shutdown_connections 2024-03-31T23:14:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:45.175+0000 7fc307983700 1 -- 172.21.15.42:0/1236128339 wait complete. 2024-03-31T23:14:45.829 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1711926884,"num_in_osds":12,"osd_in_since":1711926864,"num_remapped_pgs":0} 2024-03-31T23:14:45.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-31T23:14:46.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: purged_snaps scrub starts 2024-03-31T23:14:46.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: purged_snaps scrub ok 2024-03-31T23:14:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] boot 2024-03-31T23:14:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: osdmap e80: 12 total, 12 up, 12 in 2024-03-31T23:14:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:45 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1236128339' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-31T23:14:46.076 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:14:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: purged_snaps scrub starts 2024-03-31T23:14:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: purged_snaps scrub ok 2024-03-31T23:14:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] boot 2024-03-31T23:14:46.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: osdmap e80: 12 total, 12 up, 12 in 2024-03-31T23:14:46.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:46.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:45 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1236128339' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-31T23:14:46.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: purged_snaps scrub starts 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: purged_snaps scrub ok 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: osd.11 [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] boot 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: osdmap e80: 12 total, 12 up, 12 in 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:14:46.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:45 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1236128339' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-31T23:14:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: osdmap e81: 12 total, 12 up, 12 in 2024-03-31T23:14:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:47.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:47.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:46 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: osdmap e81: 12 total, 12 up, 12 in 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:47.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:46 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.303 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: osdmap e81: 12 total, 12 up, 12 in 2024-03-31T23:14:47.303 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.303 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.303 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.303 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:14:47.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:47.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:47.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:46 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.800+0000 7fed2759e700 1 -- 172.21.15.42:0/2908356824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 msgr2=0x7fed20101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.800+0000 7fed2759e700 1 --2- 172.21.15.42:0/2908356824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20101660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed140099c0 tx=0x7fed14009cd0 comp rx=0 tx=0).stop 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 -- 172.21.15.42:0/2908356824 shutdown_connections 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 --2- 172.21.15.42:0/2908356824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed20106360 0x7fed2010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 --2- 172.21.15.42:0/2908356824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20101660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 --2- 172.21.15.42:0/2908356824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed20101c30 0x7fed20105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 -- 172.21.15.42:0/2908356824 >> 172.21.15.42:0/2908356824 conn(0x7fed200fcb10 msgr2=0x7fed200fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 -- 172.21.15.42:0/2908356824 shutdown_connections 2024-03-31T23:14:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 -- 172.21.15.42:0/2908356824 wait complete. 2024-03-31T23:14:47.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.801+0000 7fed2759e700 1 Processor -- start 2024-03-31T23:14:47.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 -- start start 2024-03-31T23:14:47.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed20101c30 0x7fed20103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed20106360 0x7fed201037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111450 con 0x7fed20101280 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fed201112d0 con 0x7fed20106360 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2759e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed201115d0 con 0x7fed20101c30 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43162/0 (socket says 172.21.15.42:43162) 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 -- 172.21.15.42:0/1551693770 learned_addr learned my addr 172.21.15.42:0/1551693770 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed26d9d700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed20106360 0x7fed201037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed25d9b700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed20101c30 0x7fed20103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 -- 172.21.15.42:0/1551693770 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed20101c30 msgr2=0x7fed20103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed20101c30 0x7fed20103260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:47.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 -- 172.21.15.42:0/1551693770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed20106360 msgr2=0x7fed201037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed20106360 0x7fed201037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 -- 172.21.15.42:0/1551693770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed201a6e80 con 0x7fed20101280 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed2659c700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20102d20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed14000c00 tx=0x7fed14003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.802+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14027070 con 0x7fed20101280 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.803+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed14004220 con 0x7fed20101280 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.803+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed201a7110 con 0x7fed20101280 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.803+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1400f460 con 0x7fed20101280 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.803+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201a75c0 con 0x7fed20101280 2024-03-31T23:14:47.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.804+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed20068f00 con 0x7fed20101280 2024-03-31T23:14:47.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.805+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fed1402a070 con 0x7fed20101280 2024-03-31T23:14:47.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.805+0000 7fed137fe700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed0c0a2630 0x7fed0c0a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:47.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.805+0000 7fed25d9b700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed0c0a2630 0x7fed0c0a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:47.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.805+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fed140cf220 con 0x7fed20101280 2024-03-31T23:14:47.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.806+0000 7fed25d9b700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed0c0a2630 0x7fed0c0a4af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed200fdf30 tx=0x7fed18005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:47.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:47.810+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fed14013070 con 0x7fed20101280 2024-03-31T23:14:48.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.016+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed2002db30 con 0x7fed20101280 2024-03-31T23:14:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.017+0000 7fed137fe700 1 -- 172.21.15.42:0/1551693770 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18394 (secure 0 0 0) 0x7fed1409c990 con 0x7fed20101280 2024-03-31T23:14:48.018 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:14:48.018 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:14:45.851873+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:14:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed0c0a2630 msgr2=0x7fed0c0a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed0c0a2630 0x7fed0c0a4af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed200fdf30 tx=0x7fed18005cf0 comp rx=0 tx=0).stop 2024-03-31T23:14:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 msgr2=0x7fed20102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20102d20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed14000c00 tx=0x7fed14003730 comp rx=0 tx=0).stop 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 shutdown_connections 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fed0c0a2630 0x7fed0c0a4af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed20106360 0x7fed201037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed20101280 0x7fed20102d20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 --2- 172.21.15.42:0/1551693770 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed20101c30 0x7fed20103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.019+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 >> 172.21.15.42:0/1551693770 conn(0x7fed200fcb10 msgr2=0x7fed20105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.020+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 shutdown_connections 2024-03-31T23:14:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:48.020+0000 7fed2759e700 1 -- 172.21.15.42:0/1551693770 wait complete. 2024-03-31T23:14:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: Detected new or changed devices on smithi188 2024-03-31T23:14:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi188 to 4270M 2024-03-31T23:14:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:48.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:47 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:48.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:48.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: Detected new or changed devices on smithi188 2024-03-31T23:14:48.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi188 to 4270M 2024-03-31T23:14:48.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:48.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:48.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:48.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:47 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: Detected new or changed devices on smithi188 2024-03-31T23:14:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi188 to 4270M 2024-03-31T23:14:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:48.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:47 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:48.905 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T23:14:48.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-03-31T23:14:49.152 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:14:49.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1551693770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:14:49.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1551693770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:14:49.273 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1551693770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:14:50.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:49 smithi094 ceph-mon[36167]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:50.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:49 smithi188 ceph-mon[36068]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:50.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:49 smithi042 ceph-mon[32380]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:51.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2145355206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102290 msgr2=0x7f2e04102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:51.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2145355206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102290 0x7f2e04102710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2df40099c0 tx=0x7f2df4009cd0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2145355206 shutdown_connections 2024-03-31T23:14:51.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2145355206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e04102c50 0x7f2e0410f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2145355206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e04108270 0x7f2e04108650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2145355206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102290 0x7f2e04102710 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2145355206 >> 172.21.15.42:0/2145355206 conn(0x7f2e04079370 msgr2=0x7f2e04079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2145355206 shutdown_connections 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2145355206 wait complete. 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 Processor -- start 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.076+0000 7f2e0b6c2700 1 -- start start 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0b6c2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e04102290 0x7f2e04074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0b6c2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 0x7f2e04074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0b6c2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e04108270 0x7f2e04074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0b6c2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2e04112630 con 0x7f2e04102c50 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0b6c2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e041124b0 con 0x7f2e04108270 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0b6c2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e041127b0 con 0x7f2e04102290 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 0x7f2e04074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:51.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 0x7f2e04074a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43174/0 (socket says 172.21.15.42:43174) 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 -- 172.21.15.42:0/2975566053 learned_addr learned my addr 172.21.15.42:0/2975566053 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e0945e700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e04102290 0x7f2e04074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e09c5f700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e04108270 0x7f2e04074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 -- 172.21.15.42:0/2975566053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e04102290 msgr2=0x7f2e04074540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e04102290 0x7f2e04074540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 -- 172.21.15.42:0/2975566053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e04108270 msgr2=0x7f2e04074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e04108270 0x7f2e04074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 -- 172.21.15.42:0/2975566053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e041a6e90 con 0x7f2e04102c50 2024-03-31T23:14:51.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.077+0000 7f2e08c5d700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 0x7f2e04074a80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2df4000c00 tx=0x7f2df40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.078+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4027070 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.078+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e041a7120 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.078+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2df4004040 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.078+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df400f460 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.078+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e041a75d0 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.078+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e04068f00 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.080+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f2df402a070 con 0x7f2e04102c50 2024-03-31T23:14:51.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.080+0000 7f2dfa7fc700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2df00a2530 0x7f2df00a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:51.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.080+0000 7f2e0945e700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2df00a2530 0x7f2df00a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:51.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.080+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2df40cf5a0 con 0x7f2e04102c50 2024-03-31T23:14:51.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.081+0000 7f2e0945e700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2df00a2530 0x7f2df00a49f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e00005950 tx=0x7f2e0000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:51.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.084+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2df4031020 con 0x7f2e04102c50 2024-03-31T23:14:51.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.285+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2e041a7830 con 0x7f2e04102c50 2024-03-31T23:14:51.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.285+0000 7f2dfa7fc700 1 -- 172.21.15.42:0/2975566053 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f2df4013070 con 0x7f2e04102c50 2024-03-31T23:14:51.286 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:14:51.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.287+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2df00a2530 msgr2=0x7f2df00a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:51.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.287+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2df00a2530 0x7f2df00a49f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e00005950 tx=0x7f2e0000a300 comp rx=0 tx=0).stop 2024-03-31T23:14:51.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.287+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 msgr2=0x7f2e04074a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.287+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 0x7f2e04074a80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2df4000c00 tx=0x7f2df40057c0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 shutdown_connections 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2df00a2530 0x7f2df00a49f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e04102290 0x7f2e04074540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e04108270 0x7f2e04074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 --2- 172.21.15.42:0/2975566053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e04102c50 0x7f2e04074a80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 >> 172.21.15.42:0/2975566053 conn(0x7f2e04079370 msgr2=0x7f2e04105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 shutdown_connections 2024-03-31T23:14:51.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:51.288+0000 7f2e0b6c2700 1 -- 172.21.15.42:0/2975566053 wait complete. 2024-03-31T23:14:52.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:51 smithi042 ceph-mon[32380]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:52.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:51 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2975566053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.a on smithi042 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.d on smithi042 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.g on smithi042 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.j on smithi042 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.b on smithi094 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.e on smithi094 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.h on smithi094 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.k on smithi094 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.c on smithi188 2024-03-31T23:14:52.073 INFO:tasks.cephadm:Adding mds.f on smithi188 2024-03-31T23:14:52.074 INFO:tasks.cephadm:Adding mds.i on smithi188 2024-03-31T23:14:52.074 INFO:tasks.cephadm:Adding mds.l on smithi188 2024-03-31T23:14:52.074 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph orch apply mds all '12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l' 2024-03-31T23:14:52.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:51 smithi094 ceph-mon[36167]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:52.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:51 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2975566053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:14:52.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:51 smithi188 ceph-mon[36068]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:52.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:51 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2975566053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:14:52.323 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.069+0000 7f258c876700 1 -- 172.21.15.188:0/1396629206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588102270 msgr2=0x7f2588102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.069+0000 7f258c876700 1 --2- 172.21.15.188:0/1396629206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588102270 0x7f2588102690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f257c009990 tx=0x7f257c009ca0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 -- 172.21.15.188:0/1396629206 shutdown_connections 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 --2- 172.21.15.188:0/1396629206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588102270 0x7f2588102690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 --2- 172.21.15.188:0/1396629206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2588103e10 0x7f258810a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 --2- 172.21.15.188:0/1396629206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588103470 0x7f25881038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 -- 172.21.15.188:0/1396629206 >> 172.21.15.188:0/1396629206 conn(0x7f25880fd850 msgr2=0x7f25880ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 -- 172.21.15.188:0/1396629206 shutdown_connections 2024-03-31T23:14:54.071 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 -- 172.21.15.188:0/1396629206 wait complete. 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.070+0000 7f258c876700 1 Processor -- start 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 -- start start 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588102270 0x7f2588075fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 0x7f2588074630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2588103e10 0x7f2588074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f258810dfa0 con 0x7f2588103e10 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f258810de20 con 0x7f2588102270 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258c876700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f258810e120 con 0x7f2588103470 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 0x7f2588074630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:54.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 0x7f2588074630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:54008/0 (socket says 172.21.15.188:54008) 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 -- 172.21.15.188:0/3453473524 learned_addr learned my addr 172.21.15.188:0/3453473524 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2586d9d700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2588103e10 0x7f2588074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258659c700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588102270 0x7f2588075fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 -- 172.21.15.188:0/3453473524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588102270 msgr2=0x7f2588075fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588102270 0x7f2588075fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 -- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2588103e10 msgr2=0x7f2588074b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2588103e10 0x7f2588074b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 -- 172.21.15.188:0/3453473524 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2588075420 con 0x7f2588103470 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f258659c700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588102270 0x7f2588075fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f2585d9b700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 0x7f2588074630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f257800c9b0 tx=0x7f257800ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.071+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578007b00 con 0x7f2588103470 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.072+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2578007ca0 con 0x7f2588103470 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.072+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578018780 con 0x7f2588103470 2024-03-31T23:14:54.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.072+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25881a2660 con 0x7f2588103470 2024-03-31T23:14:54.075 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.072+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25881a2b70 con 0x7f2588103470 2024-03-31T23:14:54.075 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.073+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2588068f00 con 0x7f2588103470 2024-03-31T23:14:54.075 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.074+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f257800f450 con 0x7f2588103470 2024-03-31T23:14:54.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:53 smithi188 ceph-mon[36068]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:54.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.074+0000 7f25777fe700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25700a2530 0x7f25700a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:54.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.075+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f25780ce270 con 0x7f2588103470 2024-03-31T23:14:54.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.075+0000 7f258659c700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25700a2530 0x7f25700a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:54.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.075+0000 7f258659c700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25700a2530 0x7f25700a49f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f257c00b5c0 tx=0x7f257c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:54.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.079+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2578014030 con 0x7f2588103470 2024-03-31T23:14:54.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:53 smithi094 ceph-mon[36167]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:54.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.296+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}) -- 0x7f2588062780 con 0x7f25700a2530 2024-03-31T23:14:54.305 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.304+0000 7f25777fe700 1 -- 172.21.15.188:0/3453473524 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2588062780 con 0x7f25700a2530 2024-03-31T23:14:54.305 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mds.all update... 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25700a2530 msgr2=0x7f25700a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25700a2530 0x7f25700a49f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f257c00b5c0 tx=0x7f257c005fd0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 msgr2=0x7f2588074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 0x7f2588074630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f257800c9b0 tx=0x7f257800ccc0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 shutdown_connections 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25700a2530 0x7f25700a49f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2588103e10 0x7f2588074b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2588102270 0x7f2588075fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 --2- 172.21.15.188:0/3453473524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2588103470 0x7f2588074630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 >> 172.21.15.188:0/3453473524 conn(0x7f25880fd850 msgr2=0x7f2588106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 shutdown_connections 2024-03-31T23:14:54.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-03-31T23:14:54.307+0000 7f258c876700 1 -- 172.21.15.188:0/3453473524 wait complete. 2024-03-31T23:14:54.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:53 smithi042 ceph-mon[32380]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:54.949 DEBUG:teuthology.orchestra.run.smithi042:mds.a> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.a.service 2024-03-31T23:14:54.952 DEBUG:teuthology.orchestra.run.smithi042:mds.d> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.d.service 2024-03-31T23:14:54.995 DEBUG:teuthology.orchestra.run.smithi042:mds.g> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.g.service 2024-03-31T23:14:55.038 DEBUG:teuthology.orchestra.run.smithi042:mds.j> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.j.service 2024-03-31T23:14:55.081 DEBUG:teuthology.orchestra.run.smithi094:mds.b> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.b.service 2024-03-31T23:14:55.084 DEBUG:teuthology.orchestra.run.smithi094:mds.e> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.e.service 2024-03-31T23:14:55.127 DEBUG:teuthology.orchestra.run.smithi094:mds.h> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.h.service 2024-03-31T23:14:55.169 DEBUG:teuthology.orchestra.run.smithi094:mds.k> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.k.service 2024-03-31T23:14:55.213 DEBUG:teuthology.orchestra.run.smithi188:mds.c> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.c.service 2024-03-31T23:14:55.216 DEBUG:teuthology.orchestra.run.smithi188:mds.f> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.f.service 2024-03-31T23:14:55.258 DEBUG:teuthology.orchestra.run.smithi188:mds.i> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.i.service 2024-03-31T23:14:55.301 DEBUG:teuthology.orchestra.run.smithi188:mds.l> sudo journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.l.service 2024-03-31T23:14:55.344 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-31T23:14:55.345 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:14:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:14:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-03-31T23:14:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:55.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:55.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:55.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:14:55.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:14:55.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:55 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 -- 172.21.15.42:0/2123822845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438100670 msgr2=0x7f5438100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 --2- 172.21.15.42:0/2123822845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438100670 0x7f5438100a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5430009ca0 tx=0x7f543002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 -- 172.21.15.42:0/2123822845 shutdown_connections 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 --2- 172.21.15.42:0/2123822845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5438102220 0x7f5438108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 --2- 172.21.15.42:0/2123822845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438101860 0x7f5438101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 --2- 172.21.15.42:0/2123822845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438100670 0x7f5438100a90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 -- 172.21.15.42:0/2123822845 >> 172.21.15.42:0/2123822845 conn(0x7f54380fbbe0 msgr2=0x7f54380fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 -- 172.21.15.42:0/2123822845 shutdown_connections 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 -- 172.21.15.42:0/2123822845 wait complete. 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 Processor -- start 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.464+0000 7f543ea78640 1 -- start start 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5438100670 0x7f5438196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 0x7f5438196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438102220 0x7f543819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f543810c420 con 0x7f5438101860 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f543810c2a0 con 0x7f5438100670 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f543810c5a0 con 0x7f5438102220 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 0x7f5438196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 0x7f5438196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42456/0 (socket says 172.21.15.42:42456) 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 -- 172.21.15.42:0/1701150356 learned_addr learned my addr 172.21.15.42:0/1701150356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543c814640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5438100670 0x7f5438196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543d015640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438102220 0x7f543819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 -- 172.21.15.42:0/1701150356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438102220 msgr2=0x7f543819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438102220 0x7f543819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 -- 172.21.15.42:0/1701150356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5438100670 msgr2=0x7f5438196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5438100670 0x7f5438196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 -- 172.21.15.42:0/1701150356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543819e6b0 con 0x7f5438101860 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543d015640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438102220 0x7f543819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5437fff640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 0x7f5438196fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f542c00eb00 tx=0x7f542c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c00bc30 con 0x7f5438101860 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f542c00bdd0 con 0x7f5438101860 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c017670 con 0x7f5438101860 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.465+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5438068910 con 0x7f5438101860 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.466+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5438068e10 con 0x7f5438101860 2024-03-31T23:14:55.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.467+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5438068540 con 0x7f5438101860 2024-03-31T23:14:55.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.468+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f542c017810 con 0x7f5438101860 2024-03-31T23:14:55.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.468+0000 7f5435ffb640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f54200a24a0 0x7f54200a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.468+0000 7f543c814640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f54200a24a0 0x7f54200a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.468+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f542c0cfc70 con 0x7f5438101860 2024-03-31T23:14:55.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.469+0000 7f543c814640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f54200a24a0 0x7f54200a4960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f543002c700 tx=0x7f5430009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.473+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f542c09d2d0 con 0x7f5438101860 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:14:55.538 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:55 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:55.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:14:55.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:14:55.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:55 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:55.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.656+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5438107610 con 0x7f5438101860 2024-03-31T23:14:55.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.657+0000 7f5435ffb640 1 -- 172.21.15.42:0/1701150356 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18394 (secure 0 0 0) 0x7f542c09cbd0 con 0x7f5438101860 2024-03-31T23:14:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:14:55.659 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:14:45.851873+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f54200a24a0 msgr2=0x7f54200a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f54200a24a0 0x7f54200a4960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f543002c700 tx=0x7f5430009360 comp rx=0 tx=0).stop 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 msgr2=0x7f5438196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 0x7f5438196fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f542c00eb00 tx=0x7f542c00ef00 comp rx=0 tx=0).stop 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 shutdown_connections 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5438102220 0x7f543819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f54200a24a0 0x7f54200a4960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5438101860 0x7f5438196fd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 --2- 172.21.15.42:0/1701150356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5438100670 0x7f5438196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 >> 172.21.15.42:0/1701150356 conn(0x7f54380fbbe0 msgr2=0x7f5438104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 shutdown_connections 2024-03-31T23:14:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.659+0000 7f543ea78640 1 -- 172.21.15.42:0/1701150356 wait complete. 2024-03-31T23:14:55.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T23:14:55.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 -- 172.21.15.42:0/376389944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4100650 msgr2=0x7f78c4100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 --2- 172.21.15.42:0/376389944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4100650 0x7f78c4100a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009900 tx=0x7f78b802bc30 comp rx=0 tx=0).stop 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 -- 172.21.15.42:0/376389944 shutdown_connections 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 --2- 172.21.15.42:0/376389944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4102200 0x7f78c4108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 --2- 172.21.15.42:0/376389944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4101840 0x7f78c4101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 --2- 172.21.15.42:0/376389944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4100650 0x7f78c4100a70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 -- 172.21.15.42:0/376389944 >> 172.21.15.42:0/376389944 conn(0x7f78c40fbbe0 msgr2=0x7f78c40fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 -- 172.21.15.42:0/376389944 shutdown_connections 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.776+0000 7f78cacd4640 1 -- 172.21.15.42:0/376389944 wait complete. 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 Processor -- start 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 -- start start 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4100650 0x7f78c4197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 0x7f78c41980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4102200 0x7f78c419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78c410c3b0 con 0x7f78c4101840 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f78c410c230 con 0x7f78c4100650 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78cacd4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f78c410c530 con 0x7f78c4102200 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 0x7f78c41980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 0x7f78c41980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42482/0 (socket says 172.21.15.42:42482) 2024-03-31T23:14:55.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 -- 172.21.15.42:0/2424646274 learned_addr learned my addr 172.21.15.42:0/2424646274 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c9271640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4102200 0x7f78c419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c8a70640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4100650 0x7f78c4197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 -- 172.21.15.42:0/2424646274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4102200 msgr2=0x7f78c419f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4102200 0x7f78c419f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 -- 172.21.15.42:0/2424646274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4100650 msgr2=0x7f78c4197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4100650 0x7f78c4197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 -- 172.21.15.42:0/2424646274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c419f790 con 0x7f78c4101840 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c8a70640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4100650 0x7f78c4197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c9271640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4102200 0x7f78c419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.777+0000 7f78c3fff640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 0x7f78c41980b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f78b000e9f0 tx=0x7f78b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.778+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b000cd80 con 0x7f78c4101840 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.778+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78b0005520 con 0x7f78c4101840 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.778+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c419fa80 con 0x7f78c4101840 2024-03-31T23:14:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.778+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0010690 con 0x7f78c4101840 2024-03-31T23:14:55.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.778+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c419ff80 con 0x7f78c4101840 2024-03-31T23:14:55.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.779+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c41a0210 con 0x7f78c4101840 2024-03-31T23:14:55.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.780+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f78b00046c0 con 0x7f78c4101840 2024-03-31T23:14:55.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.780+0000 7f78c1ffb640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78b40a24a0 0x7f78b40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:55.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.781+0000 7f78c8a70640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78b40a24a0 0x7f78b40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:55.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.781+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f78b00ce820 con 0x7f78c4101840 2024-03-31T23:14:55.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.781+0000 7f78c8a70640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78b40a24a0 0x7f78b40a4960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78b802c900 tx=0x7f78b802c690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:55.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.785+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f78b009be80 con 0x7f78c4101840 2024-03-31T23:14:55.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.968+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f78c41a03e0 con 0x7f78c4101840 2024-03-31T23:14:55.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.968+0000 7f78c1ffb640 1 -- 172.21.15.42:0/2424646274 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f78b009b780 con 0x7f78c4101840 2024-03-31T23:14:55.969 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78b40a24a0 msgr2=0x7f78b40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78b40a24a0 0x7f78b40a4960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78b802c900 tx=0x7f78b802c690 comp rx=0 tx=0).stop 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 msgr2=0x7f78c41980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 0x7f78c41980b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f78b000e9f0 tx=0x7f78b000edf0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 shutdown_connections 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78c4102200 0x7f78c419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78b40a24a0 0x7f78b40a4960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c4101840 0x7f78c41980b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 --2- 172.21.15.42:0/2424646274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78c4100650 0x7f78c4197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:55.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 >> 172.21.15.42:0/2424646274 conn(0x7f78c40fbbe0 msgr2=0x7f78c40fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:55.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 shutdown_connections 2024-03-31T23:14:55.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:55.971+0000 7f78cacd4640 1 -- 172.21.15.42:0/2424646274 wait complete. 2024-03-31T23:14:55.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.084+0000 7f7ced647640 1 -- 172.21.15.42:0/2783715346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce8107450 msgr2=0x7f7ce81098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.084+0000 7f7ced647640 1 --2- 172.21.15.42:0/2783715346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce8107450 0x7f7ce81098a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009900 tx=0x7f7ce002bc30 comp rx=0 tx=0).stop 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- 172.21.15.42:0/2783715346 shutdown_connections 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 --2- 172.21.15.42:0/2783715346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce8107450 0x7f7ce81098a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 --2- 172.21.15.42:0/2783715346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ce8104b20 0x7f7ce8106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 --2- 172.21.15.42:0/2783715346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce81021f0 0x7f7ce81045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- 172.21.15.42:0/2783715346 >> 172.21.15.42:0/2783715346 conn(0x7f7ce80fbbe0 msgr2=0x7f7ce80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- 172.21.15.42:0/2783715346 shutdown_connections 2024-03-31T23:14:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- 172.21.15.42:0/2783715346 wait complete. 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 Processor -- start 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- start start 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 0x7f7ce8197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce8104b20 0x7f7ce81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ce8107450 0x7f7ce819f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810d550 con 0x7f7ce81021f0 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810d3d0 con 0x7f7ce8104b20 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.085+0000 7f7ced647640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810d6d0 con 0x7f7ce8107450 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 0x7f7ce8197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 0x7f7ce8197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42496/0 (socket says 172.21.15.42:42496) 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 -- 172.21.15.42:0/3391968828 learned_addr learned my addr 172.21.15.42:0/3391968828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce77fe640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ce8107450 0x7f7ce819f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce67fc640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce8104b20 0x7f7ce81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 -- 172.21.15.42:0/3391968828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ce8107450 msgr2=0x7f7ce819f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ce8107450 0x7f7ce819f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 -- 172.21.15.42:0/3391968828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce8104b20 msgr2=0x7f7ce81980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce8104b20 0x7f7ce81980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 -- 172.21.15.42:0/3391968828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce819f780 con 0x7f7ce81021f0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce67fc640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce8104b20 0x7f7ce81980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ce6ffd640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 0x7f7ce8197b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800cce0 tx=0x7f7cd800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8004b20 con 0x7f7ce81021f0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cd8004cc0 con 0x7f7ce81021f0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800f870 con 0x7f7ce81021f0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce819fa70 con 0x7f7ce81021f0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.086+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce81a0010 con 0x7f7ce81021f0 2024-03-31T23:14:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.087+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce80fd6d0 con 0x7f7ce81021f0 2024-03-31T23:14:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.088+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f7cd800fa10 con 0x7f7ce81021f0 2024-03-31T23:14:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.089+0000 7f7cdffff640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7cd40a2520 0x7f7cd40a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.089+0000 7f7ce67fc640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7cd40a2520 0x7f7cd40a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.089+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7cd80ce330 con 0x7f7ce81021f0 2024-03-31T23:14:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.089+0000 7f7ce67fc640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7cd40a2520 0x7f7cd40a49e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8199070 tx=0x7f7cd0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:56.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.093+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7cd8014030 con 0x7f7ce81021f0 2024-03-31T23:14:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.314+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ce802d170 con 0x7f7ce81021f0 2024-03-31T23:14:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.315+0000 7f7cdffff640 1 -- 172.21.15.42:0/3391968828 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f7cd809b8f0 con 0x7f7ce81021f0 2024-03-31T23:14:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:14:56.316 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-31T23:14:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 1 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7cd40a2520 msgr2=0x7f7cd40a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7cd40a2520 0x7f7cd40a49e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8199070 tx=0x7f7cd0008040 comp rx=0 tx=0).stop 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 msgr2=0x7f7ce8197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 0x7f7ce8197b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800cce0 tx=0x7f7cd800a620 comp rx=0 tx=0).stop 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 shutdown_connections 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ce8107450 0x7f7ce819f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ce8104b20 0x7f7ce81980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7cd40a2520 0x7f7cd40a49e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 --2- 172.21.15.42:0/3391968828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ce81021f0 0x7f7ce8197b60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 >> 172.21.15.42:0/3391968828 conn(0x7f7ce80fbbe0 msgr2=0x7f7ce8102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 shutdown_connections 2024-03-31T23:14:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:56.317+0000 7f7ced647640 1 -- 172.21.15.42:0/3391968828 wait complete. 2024-03-31T23:14:56.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:56 smithi042 ceph-mon[32380]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:56 smithi042 ceph-mon[32380]: Deploying daemon mds.l on smithi188 2024-03-31T23:14:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1701150356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:14:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2424646274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:14:56.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:56 smithi188 ceph-mon[36068]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:56.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:56 smithi188 ceph-mon[36068]: Deploying daemon mds.l on smithi188 2024-03-31T23:14:56.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1701150356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:14:56.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2424646274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:14:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:56 smithi094 ceph-mon[36167]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:56 smithi094 ceph-mon[36167]: Deploying daemon mds.l on smithi188 2024-03-31T23:14:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1701150356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:14:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2424646274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:14:56.957 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:56 smithi188 systemd[1]: Starting Ceph mds.l for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:14:57.219 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 podman[66032]: 2024-03-31 23:14:57.078485535 +0000 UTC m=+0.018650891 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:14:57.219 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 podman[66032]: 2024-03-31 23:14:57.201732685 +0000 UTC m=+0.141898024 container create 9dcc09fd4e75173330108e40cd54bee9df3b685226d174a0888a684036379083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=) 2024-03-31T23:14:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3391968828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:14:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3391968828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:14:57.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3391968828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:14:57.720 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 podman[66032]: 2024-03-31 23:14:57.459079271 +0000 UTC m=+0.399244615 container init 9dcc09fd4e75173330108e40cd54bee9df3b685226d174a0888a684036379083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:14:57.720 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 podman[66032]: 2024-03-31 23:14:57.462162836 +0000 UTC m=+0.402328179 container start 9dcc09fd4e75173330108e40cd54bee9df3b685226d174a0888a684036379083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:14:57.720 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 ceph-mds[66051]: -- 172.21.15.188:0/2533326240 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557746ff1a40 con 0x557746fc4c00 2024-03-31T23:14:57.720 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l[66047]: starting mds.l at 2024-03-31T23:14:57.721 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 bash[66032]: 9dcc09fd4e75173330108e40cd54bee9df3b685226d174a0888a684036379083 2024-03-31T23:14:57.721 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:14:57 smithi188 systemd[1]: Started Ceph mds.l for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:14:58.329 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 -- 172.21.15.42:0/3905129278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 msgr2=0x7f58a8102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3905129278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8102de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5890009900 tx=0x7f589002bc30 comp rx=0 tx=0).stop 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 -- 172.21.15.42:0/3905129278 shutdown_connections 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3905129278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58a8103320 0x7f58a8109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3905129278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8102de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3905129278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58a8101770 0x7f58a8101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 -- 172.21.15.42:0/3905129278 >> 172.21.15.42:0/3905129278 conn(0x7f58a80fcd00 msgr2=0x7f58a80ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 -- 172.21.15.42:0/3905129278 shutdown_connections 2024-03-31T23:14:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.444+0000 7f58aefe5640 1 -- 172.21.15.42:0/3905129278 wait complete. 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 Processor -- start 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 -- start start 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58a8101770 0x7f58a8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58a8103320 0x7f58a819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58a810d4d0 con 0x7f58a8102960 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f58a810d350 con 0x7f58a8101770 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58aefe5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f58a810d650 con 0x7f58a8103320 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42512/0 (socket says 172.21.15.42:42512) 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 -- 172.21.15.42:0/3972343545 learned_addr learned my addr 172.21.15.42:0/3972343545 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58acd81640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58a8101770 0x7f58a8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58ad582640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58a8103320 0x7f58a819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 -- 172.21.15.42:0/3972343545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58a8103320 msgr2=0x7f58a819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58a8103320 0x7f58a819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 -- 172.21.15.42:0/3972343545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58a8101770 msgr2=0x7f58a8197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58a8101770 0x7f58a8197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 -- 172.21.15.42:0/3972343545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a819f680 con 0x7f58a8102960 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.445+0000 7f58a7fff640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8197fa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f589002ca30 tx=0x7f5890004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.446+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890043020 con 0x7f58a8102960 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.446+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5890004440 con 0x7f58a8102960 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.446+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a819f910 con 0x7f58a8102960 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.446+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890003e10 con 0x7f58a8102960 2024-03-31T23:14:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.446+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a819feb0 con 0x7f58a8102960 2024-03-31T23:14:58.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.447+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a81089c0 con 0x7f58a8102960 2024-03-31T23:14:58.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.448+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f5890046020 con 0x7f58a8102960 2024-03-31T23:14:58.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.448+0000 7f58a5ffb640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58940a2520 0x7f58940a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:14:58.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.449+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f58900f0500 con 0x7f58a8102960 2024-03-31T23:14:58.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.449+0000 7f58acd81640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58940a2520 0x7f58940a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:14:58.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.449+0000 7f58acd81640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58940a2520 0x7f58940a49e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58a81027c0 tx=0x7f58a0007600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:14:58.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.453+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f589004d020 con 0x7f58a8102960 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6832/524584837,v1:172.21.15.188:6833/524584837] up:boot 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: fsmap 1 up:standby 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:58.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:58 smithi094 ceph-mon[36167]: Deploying daemon mds.k on smithi094 2024-03-31T23:14:58.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.677+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58a802d170 con 0x7f58a8102960 2024-03-31T23:14:58.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.678+0000 7f58a5ffb640 1 -- 172.21.15.42:0/3972343545 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f58900bdb60 con 0x7f58a8102960 2024-03-31T23:14:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:14:58.679 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-31T23:14:58.679 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 2 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58940a2520 msgr2=0x7f58940a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58940a2520 0x7f58940a49e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58a81027c0 tx=0x7f58a0007600 comp rx=0 tx=0).stop 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 msgr2=0x7f58a8197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8197fa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f589002ca30 tx=0x7f5890004040 comp rx=0 tx=0).stop 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 shutdown_connections 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58a8103320 0x7f58a819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58940a2520 0x7f58940a49e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a8102960 0x7f58a8197fa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 --2- 172.21.15.42:0/3972343545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58a8101770 0x7f58a8197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 >> 172.21.15.42:0/3972343545 conn(0x7f58a80fcd00 msgr2=0x7f58a8105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 shutdown_connections 2024-03-31T23:14:58.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:14:58.680+0000 7f58aefe5640 1 -- 172.21.15.42:0/3972343545 wait complete. 2024-03-31T23:14:58.690 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6832/524584837,v1:172.21.15.188:6833/524584837] up:boot 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: fsmap 1 up:standby 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:58.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:58 smithi042 ceph-mon[32380]: Deploying daemon mds.k on smithi094 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6832/524584837,v1:172.21.15.188:6833/524584837] up:boot 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: fsmap 1 up:standby 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:14:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:58 smithi188 ceph-mon[36068]: Deploying daemon mds.k on smithi094 2024-03-31T23:14:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:14:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3972343545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:14:59.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:14:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3972343545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:14:59.922 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:14:59 smithi094 systemd[1]: Starting Ceph mds.k for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:14:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:14:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3972343545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:00.316 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 podman[65677]: 2024-03-31 23:14:59.959256728 +0000 UTC m=+0.017893100 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:00.316 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 podman[65677]: 2024-03-31 23:15:00.071208632 +0000 UTC m=+0.129844989 container create edc1229fc2b8b94d8ec0b3e303c65747d2d1b3d27bd66551ee3488705af4f9c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS) 2024-03-31T23:15:00.316 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 podman[65677]: 2024-03-31 23:15:00.316420961 +0000 UTC m=+0.375057334 container init edc1229fc2b8b94d8ec0b3e303c65747d2d1b3d27bd66551ee3488705af4f9c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0) 2024-03-31T23:15:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 podman[65677]: 2024-03-31 23:15:00.319017464 +0000 UTC m=+0.377653821 container start edc1229fc2b8b94d8ec0b3e303c65747d2d1b3d27bd66551ee3488705af4f9c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-mds[65696]: -- 172.21.15.94:0/2176785923 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596c0f29a40 con 0x5596c0efc800 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k[65692]: starting mds.k at 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 bash[65677]: edc1229fc2b8b94d8ec0b3e303c65747d2d1b3d27bd66551ee3488705af4f9c8 2024-03-31T23:15:00.673 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:15:00 smithi094 systemd[1]: Started Ceph mds.k for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:00.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 -- 172.21.15.42:0/157624415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 msgr2=0x7f0c90101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 --2- 172.21.15.42:0/157624415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c90101ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009900 tx=0x7f0c7c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 -- 172.21.15.42:0/157624415 shutdown_connections 2024-03-31T23:15:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 --2- 172.21.15.42:0/157624415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90102220 0x7f0c90108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 --2- 172.21.15.42:0/157624415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c90101ce0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 --2- 172.21.15.42:0/157624415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90100670 0x7f0c90100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 -- 172.21.15.42:0/157624415 >> 172.21.15.42:0/157624415 conn(0x7f0c900fbbe0 msgr2=0x7f0c900fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 -- 172.21.15.42:0/157624415 shutdown_connections 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.797+0000 7f0c96d35640 1 -- 172.21.15.42:0/157624415 wait complete. 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 Processor -- start 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 -- start start 2024-03-31T23:15:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90100670 0x7f0c90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c9019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90102220 0x7f0c901a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9010c3d0 con 0x7f0c90101860 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9010c250 con 0x7f0c90100670 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c96d35640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9010c550 con 0x7f0c90102220 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c9019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c9019eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42530/0 (socket says 172.21.15.42:42530) 2024-03-31T23:15:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 -- 172.21.15.42:0/2322354807 learned_addr learned my addr 172.21.15.42:0/2322354807 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c94ad1640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90100670 0x7f0c90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c952d2640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90102220 0x7f0c901a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 -- 172.21.15.42:0/2322354807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90102220 msgr2=0x7f0c901a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90102220 0x7f0c901a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 -- 172.21.15.42:0/2322354807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90100670 msgr2=0x7f0c90069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90100670 0x7f0c90069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c8ffff640 1 -- 172.21.15.42:0/2322354807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c901a19e0 con 0x7f0c90101860 2024-03-31T23:15:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.798+0000 7f0c94ad1640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90100670 0x7f0c90069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c952d2640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90102220 0x7f0c901a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c8ffff640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c9019eca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c02ca30 tx=0x7f0c7c02c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c043020 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c901a1c10 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c7c0042d0 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c003cc0 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.799+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c901a21b0 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.800+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c90107a10 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.801+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f0c7c046020 con 0x7f0c90101860 2024-03-31T23:15:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.802+0000 7f0c8dffb640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c800a24d0 0x7f0c800a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.802+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0c7c0f0800 con 0x7f0c90101860 2024-03-31T23:15:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.802+0000 7f0c94ad1640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c800a24d0 0x7f0c800a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.803+0000 7f0c94ad1640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c800a24d0 0x7f0c800a4990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c84005d00 tx=0x7f0c84005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:00.806+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0c7c04d020 con 0x7f0c90101860 2024-03-31T23:15:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:00.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:00.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:00 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:00 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.043+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c9002d3b0 con 0x7f0c90101860 2024-03-31T23:15:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.044+0000 7f0c8dffb640 1 -- 172.21.15.42:0/2322354807 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f0c7c03e450 con 0x7f0c90101860 2024-03-31T23:15:01.045 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:01.045 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-31T23:15:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c800a24d0 msgr2=0x7f0c800a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c800a24d0 0x7f0c800a4990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c84005d00 tx=0x7f0c84005ef0 comp rx=0 tx=0).stop 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 msgr2=0x7f0c9019eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c9019eca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c02ca30 tx=0x7f0c7c02c710 comp rx=0 tx=0).stop 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 shutdown_connections 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c90102220 0x7f0c901a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c800a24d0 0x7f0c800a4990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c90101860 0x7f0c9019eca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 --2- 172.21.15.42:0/2322354807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c90100670 0x7f0c90069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 >> 172.21.15.42:0/2322354807 conn(0x7f0c900fbbe0 msgr2=0x7f0c90104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 shutdown_connections 2024-03-31T23:15:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:01.046+0000 7f0c96d35640 1 -- 172.21.15.42:0/2322354807 wait complete. 2024-03-31T23:15:01.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:01 smithi094 ceph-mon[36167]: Deploying daemon mds.j on smithi042 2024-03-31T23:15:01.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:01 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6832/2977205291,v1:172.21.15.94:6833/2977205291] up:boot 2024-03-31T23:15:01.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:01 smithi094 ceph-mon[36167]: fsmap 2 up:standby 2024-03-31T23:15:01.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:01 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:15:01.731 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:01 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2322354807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:01.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:01 smithi042 ceph-mon[32380]: Deploying daemon mds.j on smithi042 2024-03-31T23:15:01.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:01 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6832/2977205291,v1:172.21.15.94:6833/2977205291] up:boot 2024-03-31T23:15:01.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:01 smithi042 ceph-mon[32380]: fsmap 2 up:standby 2024-03-31T23:15:01.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:01 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:15:01.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:01 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2322354807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:01 smithi188 ceph-mon[36068]: Deploying daemon mds.j on smithi042 2024-03-31T23:15:01.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:01 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6832/2977205291,v1:172.21.15.94:6833/2977205291] up:boot 2024-03-31T23:15:01.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:01 smithi188 ceph-mon[36068]: fsmap 2 up:standby 2024-03-31T23:15:01.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:01 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:15:01.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:01 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2322354807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:02 smithi042 ceph-mon[32380]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:02.826 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:02 smithi042 systemd[1]: Starting Ceph mds.j for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:02 smithi094 ceph-mon[36167]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:02.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:02 smithi188 ceph-mon[36068]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:03.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:03.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 -- 172.21.15.42:0/994611050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 msgr2=0x7fd47c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:03.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 --2- 172.21.15.42:0/994611050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c100ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009900 tx=0x7fd46c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:03.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 -- 172.21.15.42:0/994611050 shutdown_connections 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 --2- 172.21.15.42:0/994611050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c102240 0x7fd47c108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 --2- 172.21.15.42:0/994611050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c101880 0x7fd47c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 --2- 172.21.15.42:0/994611050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c100ab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 -- 172.21.15.42:0/994611050 >> 172.21.15.42:0/994611050 conn(0x7fd47c0fbc00 msgr2=0x7fd47c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 -- 172.21.15.42:0/994611050 shutdown_connections 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.165+0000 7fd48288f640 1 -- 172.21.15.42:0/994611050 wait complete. 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 Processor -- start 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 -- start start 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c101880 0x7fd47c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c102240 0x7fd47c19f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c10d500 con 0x7fd47c100690 2024-03-31T23:15:03.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c10d380 con 0x7fd47c102240 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd48288f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c10d680 con 0x7fd47c101880 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42548/0 (socket says 172.21.15.42:42548) 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 -- 172.21.15.42:0/2969496707 learned_addr learned my addr 172.21.15.42:0/2969496707 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47b7fe640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c101880 0x7fd47c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd480e2c640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c102240 0x7fd47c19f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 -- 172.21.15.42:0/2969496707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c101880 msgr2=0x7fd47c1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c101880 0x7fd47c1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 -- 172.21.15.42:0/2969496707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c102240 msgr2=0x7fd47c19f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c102240 0x7fd47c19f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47bfff640 1 -- 172.21.15.42:0/2969496707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c19f7a0 con 0x7fd47c100690 2024-03-31T23:15:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.166+0000 7fd47b7fe640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c101880 0x7fd47c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.167+0000 7fd47bfff640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c197b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000c00 tx=0x7fd46c02c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.167+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c043020 con 0x7fd47c100690 2024-03-31T23:15:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.167+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd46c0042d0 con 0x7fd47c100690 2024-03-31T23:15:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.167+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47c19fa30 con 0x7fd47c100690 2024-03-31T23:15:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.167+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c003cc0 con 0x7fd47c100690 2024-03-31T23:15:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.167+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd47c19ff80 con 0x7fd47c100690 2024-03-31T23:15:03.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.168+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd47c068990 con 0x7fd47c100690 2024-03-31T23:15:03.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.169+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fd46c046020 con 0x7fd47c100690 2024-03-31T23:15:03.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.169+0000 7fd4797fa640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd4640a24a0 0x7fd4640a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:03.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.170+0000 7fd47b7fe640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd4640a24a0 0x7fd4640a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:03.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.170+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd46c0f0480 con 0x7fd47c100690 2024-03-31T23:15:03.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.170+0000 7fd47b7fe640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd4640a24a0 0x7fd4640a4960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd47c199090 tx=0x7fd470005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.174+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd46c04d020 con 0x7fd47c100690 2024-03-31T23:15:03.176 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:02 smithi042 podman[70323]: 2024-03-31 23:15:02.825593456 +0000 UTC m=+0.017889961 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:03.176 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:02 smithi042 podman[70323]: 2024-03-31 23:15:02.939312256 +0000 UTC m=+0.131608760 container create fb2ead0503e3f69076870b4437606d0cf59a443621e33daef381542ddc36481c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j, org.label-schema.build-date=20240326, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-31T23:15:03.176 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:03 smithi042 podman[70323]: 2024-03-31 23:15:03.175956731 +0000 UTC m=+0.368253244 container init fb2ead0503e3f69076870b4437606d0cf59a443621e33daef381542ddc36481c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-31T23:15:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.421+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd47c02d210 con 0x7fd47c100690 2024-03-31T23:15:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.422+0000 7fd4797fa640 1 -- 172.21.15.42:0/2969496707 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7fd47c02d210 con 0x7fd47c100690 2024-03-31T23:15:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:03.423 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-31T23:15:03.423 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd4640a24a0 msgr2=0x7fd4640a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd4640a24a0 0x7fd4640a4960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd47c199090 tx=0x7fd470005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 msgr2=0x7fd47c197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c197b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000c00 tx=0x7fd46c02c710 comp rx=0 tx=0).stop 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 shutdown_connections 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c102240 0x7fd47c19f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd47c101880 0x7fd47c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd4640a24a0 0x7fd4640a4960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 --2- 172.21.15.42:0/2969496707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c100690 0x7fd47c197b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 >> 172.21.15.42:0/2969496707 conn(0x7fd47c0fbc00 msgr2=0x7fd47c104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 shutdown_connections 2024-03-31T23:15:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:03.424+0000 7fd48288f640 1 -- 172.21.15.42:0/2969496707 wait complete. 2024-03-31T23:15:03.435 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:03 smithi042 podman[70323]: 2024-03-31 23:15:03.179305344 +0000 UTC m=+0.371601842 container start fb2ead0503e3f69076870b4437606d0cf59a443621e33daef381542ddc36481c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:15:03.435 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:03 smithi042 ceph-mds[70381]: -- 172.21.15.42:0/3546069848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563113fa9a40 con 0x563113f7cc00 2024-03-31T23:15:03.435 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j[70338]: starting mds.j at 2024-03-31T23:15:03.435 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:03 smithi042 bash[70323]: fb2ead0503e3f69076870b4437606d0cf59a443621e33daef381542ddc36481c 2024-03-31T23:15:03.436 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:15:03 smithi042 systemd[1]: Started Ceph mds.j for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: Deploying daemon mds.d on smithi042 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2969496707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.42:6834/957043264,v1:172.21.15.42:6835/957043264] up:boot 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: fsmap 3 up:standby 2024-03-31T23:15:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:04 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:04.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: Deploying daemon mds.d on smithi042 2024-03-31T23:15:04.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2969496707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:04.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.42:6834/957043264,v1:172.21.15.42:6835/957043264] up:boot 2024-03-31T23:15:04.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: fsmap 3 up:standby 2024-03-31T23:15:04.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:04 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-31T23:15:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: Deploying daemon mds.d on smithi042 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2969496707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.42:6834/957043264,v1:172.21.15.42:6835/957043264] up:boot 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: fsmap 3 up:standby 2024-03-31T23:15:04.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:04 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-31T23:15:05.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- 172.21.15.42:0/557003791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90102220 msgr2=0x7f8f90108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- 172.21.15.42:0/557003791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90102220 0x7f8f90108ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009ca0 tx=0x7f8f8802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- 172.21.15.42:0/557003791 shutdown_connections 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- 172.21.15.42:0/557003791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90102220 0x7f8f90108ab0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- 172.21.15.42:0/557003791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 0x7f8f90101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- 172.21.15.42:0/557003791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f90100670 0x7f8f90100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- 172.21.15.42:0/557003791 >> 172.21.15.42:0/557003791 conn(0x7f8f900fbc00 msgr2=0x7f8f900fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- 172.21.15.42:0/557003791 shutdown_connections 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- 172.21.15.42:0/557003791 wait complete. 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 Processor -- start 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- start start 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 0x7f8f901969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 0x7f8f90196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f90102220 0x7f8f9019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9010c420 con 0x7f8f90100670 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9010c2a0 con 0x7f8f90101860 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.559+0000 7f8f971bc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9010c5a0 con 0x7f8f90102220 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 0x7f8f901969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 0x7f8f901969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60942/0 (socket says 172.21.15.42:60942) 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 -- 172.21.15.42:0/3116426778 learned_addr learned my addr 172.21.15.42:0/3116426778 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f8ffff640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 0x7f8f90196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f95759640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f90102220 0x7f8f9019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 -- 172.21.15.42:0/3116426778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f90102220 msgr2=0x7f8f9019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f90102220 0x7f8f9019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 -- 172.21.15.42:0/3116426778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 msgr2=0x7f8f90196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:05.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 0x7f8f90196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 -- 172.21.15.42:0/3116426778 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9019e600 con 0x7f8f90100670 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f8ffff640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 0x7f8f90196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f94f58640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 0x7f8f901969e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400e9c0 tx=0x7f8f8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.560+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400cd80 con 0x7f8f90100670 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.561+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f840035f0 con 0x7f8f90100670 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.561+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9019e8f0 con 0x7f8f90100670 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.561+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84010670 con 0x7f8f90100670 2024-03-31T23:15:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.561+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9019edf0 con 0x7f8f90100670 2024-03-31T23:15:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.562+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f901078c0 con 0x7f8f90100670 2024-03-31T23:15:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.563+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f8f840037a0 con 0x7f8f90100670 2024-03-31T23:15:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.563+0000 7f8f8dffb640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f800a24a0 0x7f8f800a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.563+0000 7f8f8ffff640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f800a24a0 0x7f8f800a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.563+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8f840ce600 con 0x7f8f90100670 2024-03-31T23:15:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.564+0000 7f8f8ffff640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f800a24a0 0x7f8f800a4960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f90197ef0 tx=0x7f8f7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.571+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8f8409bc60 con 0x7f8f90100670 2024-03-31T23:15:05.575 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 systemd[1]: Starting Ceph mds.d for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.803+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f9002d530 con 0x7f8f90100670 2024-03-31T23:15:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.803+0000 7f8f8dffb640 1 -- 172.21.15.42:0/3116426778 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7f8f8409b560 con 0x7f8f90100670 2024-03-31T23:15:05.804 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:05.804 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-31T23:15:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 4 2024-03-31T23:15:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.805+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f800a24a0 msgr2=0x7f8f800a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.805+0000 7f8f971bc640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f800a24a0 0x7f8f800a4960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f90197ef0 tx=0x7f8f7c00a2d0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.805+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 msgr2=0x7f8f901969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.805+0000 7f8f971bc640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 0x7f8f901969e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400e9c0 tx=0x7f8f8400ee80 comp rx=0 tx=0).stop 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.805+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 shutdown_connections 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.805+0000 7f8f971bc640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f90102220 0x7f8f9019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.806+0000 7f8f971bc640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f90101860 0x7f8f90196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.806+0000 7f8f971bc640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f800a24a0 0x7f8f800a4960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.806+0000 7f8f971bc640 1 --2- 172.21.15.42:0/3116426778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f90100670 0x7f8f901969e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.806+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 >> 172.21.15.42:0/3116426778 conn(0x7f8f900fbc00 msgr2=0x7f8f90104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.806+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 shutdown_connections 2024-03-31T23:15:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:05.806+0000 7f8f971bc640 1 -- 172.21.15.42:0/3116426778 wait complete. 2024-03-31T23:15:05.983 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 podman[70730]: 2024-03-31 23:15:05.620527704 +0000 UTC m=+0.018009810 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:05.983 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 podman[70730]: 2024-03-31 23:15:05.720991024 +0000 UTC m=+0.118473113 container create 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-03-31T23:15:05.983 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 podman[70730]: 2024-03-31 23:15:05.957447412 +0000 UTC m=+0.354929514 container init 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:15:05.983 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 podman[70730]: 2024-03-31 23:15:05.96012641 +0000 UTC m=+0.357608497 container start 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:15:06.325 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 ceph-mds[70751]: -- 172.21.15.42:0/1613468033 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f229ada40 con 0x563f22981000 2024-03-31T23:15:06.325 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d[70747]: starting mds.d at 2024-03-31T23:15:06.326 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:06 smithi042 bash[70730]: 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 2024-03-31T23:15:06.326 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:15:06 smithi042 systemd[1]: Started Ceph mds.d for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3116426778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:06.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:06.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3116426778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:06.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3116426778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:06.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:07 smithi094 ceph-mon[36167]: Deploying daemon mds.e on smithi094 2024-03-31T23:15:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:07 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.42:6836/795209517,v1:172.21.15.42:6837/795209517] up:boot 2024-03-31T23:15:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:07 smithi094 ceph-mon[36167]: fsmap 4 up:standby 2024-03-31T23:15:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:07 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-31T23:15:07.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:07 smithi188 ceph-mon[36068]: Deploying daemon mds.e on smithi094 2024-03-31T23:15:07.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:07 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.42:6836/795209517,v1:172.21.15.42:6837/795209517] up:boot 2024-03-31T23:15:07.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:07 smithi188 ceph-mon[36068]: fsmap 4 up:standby 2024-03-31T23:15:07.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:07 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-31T23:15:07.819 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:07.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:07 smithi042 ceph-mon[32380]: Deploying daemon mds.e on smithi094 2024-03-31T23:15:07.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:07 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.42:6836/795209517,v1:172.21.15.42:6837/795209517] up:boot 2024-03-31T23:15:07.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:07 smithi042 ceph-mon[32380]: fsmap 4 up:standby 2024-03-31T23:15:07.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:07 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-31T23:15:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 -- 172.21.15.42:0/3784716360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c100670 msgr2=0x7f0b7c100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 --2- 172.21.15.42:0/3784716360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c100670 0x7f0b7c100a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009900 tx=0x7f0b6c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 -- 172.21.15.42:0/3784716360 shutdown_connections 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 --2- 172.21.15.42:0/3784716360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b7c102220 0x7f0b7c108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 --2- 172.21.15.42:0/3784716360 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c101860 0x7f0b7c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 --2- 172.21.15.42:0/3784716360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c100670 0x7f0b7c100a90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 -- 172.21.15.42:0/3784716360 >> 172.21.15.42:0/3784716360 conn(0x7f0b7c0fbbe0 msgr2=0x7f0b7c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 -- 172.21.15.42:0/3784716360 shutdown_connections 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.935+0000 7f0b81f43640 1 -- 172.21.15.42:0/3784716360 wait complete. 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 Processor -- start 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 -- start start 2024-03-31T23:15:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c100670 0x7f0b7c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 0x7f0b7c196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b7c102220 0x7f0b7c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10c3d0 con 0x7f0b7c101860 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10c250 con 0x7f0b7c102220 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b81f43640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10c550 con 0x7f0b7c100670 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b7affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 0x7f0b7c196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b7affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 0x7f0b7c196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60986/0 (socket says 172.21.15.42:60986) 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b7affd640 1 -- 172.21.15.42:0/2749924823 learned_addr learned my addr 172.21.15.42:0/2749924823 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.936+0000 7f0b7bfff640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b7c102220 0x7f0b7c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7b7fe640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c100670 0x7f0b7c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7affd640 1 -- 172.21.15.42:0/2749924823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c100670 msgr2=0x7f0b7c1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7affd640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c100670 0x7f0b7c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7affd640 1 -- 172.21.15.42:0/2749924823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b7c102220 msgr2=0x7f0b7c19dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7affd640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b7c102220 0x7f0b7c19dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7affd640 1 -- 172.21.15.42:0/2749924823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c19e610 con 0x7f0b7c101860 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b7affd640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 0x7f0b7c196f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b70007b50 tx=0x7f0b7000e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70007c40 con 0x7f0b7c101860 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c068910 con 0x7f0b7c101860 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b70007de0 con 0x7f0b7c101860 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b700153f0 con 0x7f0b7c101860 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.937+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c068e60 con 0x7f0b7c101860 2024-03-31T23:15:07.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.938+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c068540 con 0x7f0b7c101860 2024-03-31T23:15:07.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.939+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f0b7000a440 con 0x7f0b7c101860 2024-03-31T23:15:07.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.940+0000 7f0b78ff9640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b640a24a0 0x7f0b640a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:07.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.940+0000 7f0b7b7fe640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b640a24a0 0x7f0b640a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:07.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.940+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0b700cf8c0 con 0x7f0b7c101860 2024-03-31T23:15:07.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.940+0000 7f0b7b7fe640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b640a24a0 0x7f0b640a4960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c02ca30 tx=0x7f0b6c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:07.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:07.944+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0b70023060 con 0x7f0b7c101860 2024-03-31T23:15:08.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.166+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b7c107510 con 0x7f0b7c101860 2024-03-31T23:15:08.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.167+0000 7f0b78ff9640 1 -- 172.21.15.42:0/2749924823 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3862 (secure 0 0 0) 0x7f0b7009cfb0 con 0x7f0b7c101860 2024-03-31T23:15:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:08.168 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-31T23:15:08.168 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 5 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b640a24a0 msgr2=0x7f0b640a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b640a24a0 0x7f0b640a4960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c02ca30 tx=0x7f0b6c000bc0 comp rx=0 tx=0).stop 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 msgr2=0x7f0b7c196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 0x7f0b7c196f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b70007b50 tx=0x7f0b7000e420 comp rx=0 tx=0).stop 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 shutdown_connections 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b7c102220 0x7f0b7c19dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b640a24a0 0x7f0b640a4960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7c101860 0x7f0b7c196f30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:08.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 --2- 172.21.15.42:0/2749924823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c100670 0x7f0b7c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 >> 172.21.15.42:0/2749924823 conn(0x7f0b7c0fbbe0 msgr2=0x7f0b7c104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 shutdown_connections 2024-03-31T23:15:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:08.169+0000 7f0b81f43640 1 -- 172.21.15.42:0/2749924823 wait complete. 2024-03-31T23:15:08.342 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 systemd[1]: Starting Ceph mds.e for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:08.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:08 smithi042 ceph-mon[32380]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:08.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:08 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2749924823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:08.610 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:08 smithi094 ceph-mon[36167]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:08.610 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:08 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2749924823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:08.610 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 podman[65996]: 2024-03-31 23:15:08.354170827 +0000 UTC m=+0.018470249 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:08.610 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 podman[65996]: 2024-03-31 23:15:08.462850828 +0000 UTC m=+0.127150224 container create b3f19d8e60c2beefe2d19b2b4ed78dc000e23a9d93b4ae1adcf096b471c73566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:15:08.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:08 smithi188 ceph-mon[36068]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:08.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:08 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2749924823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:09.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 podman[65996]: 2024-03-31 23:15:08.708150611 +0000 UTC m=+0.372450019 container init b3f19d8e60c2beefe2d19b2b4ed78dc000e23a9d93b4ae1adcf096b471c73566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-31T23:15:09.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 podman[65996]: 2024-03-31 23:15:08.71074583 +0000 UTC m=+0.375045237 container start b3f19d8e60c2beefe2d19b2b4ed78dc000e23a9d93b4ae1adcf096b471c73566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-31T23:15:09.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 ceph-mds[66015]: -- 172.21.15.94:0/1962727709 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557662089a40 con 0x55766205c800 2024-03-31T23:15:09.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e[66011]: starting mds.e at 2024-03-31T23:15:09.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 bash[65996]: b3f19d8e60c2beefe2d19b2b4ed78dc000e23a9d93b4ae1adcf096b471c73566 2024-03-31T23:15:09.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:15:08 smithi094 systemd[1]: Started Ceph mds.e for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: Deploying daemon mds.f on smithi188 2024-03-31T23:15:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6834/1301341988,v1:172.21.15.94:6835/1301341988] up:boot 2024-03-31T23:15:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: fsmap 5 up:standby 2024-03-31T23:15:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:09 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:15:10.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:10.209 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: Deploying daemon mds.f on smithi188 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6834/1301341988,v1:172.21.15.94:6835/1301341988] up:boot 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: fsmap 5 up:standby 2024-03-31T23:15:10.210 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:09 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:15:10.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: Deploying daemon mds.f on smithi188 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6834/1301341988,v1:172.21.15.94:6835/1301341988] up:boot 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: fsmap 5 up:standby 2024-03-31T23:15:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:09 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 -- 172.21.15.42:0/1122246243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708101880 msgr2=0x7fe708101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 --2- 172.21.15.42:0/1122246243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708101880 0x7fe708101d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009900 tx=0x7fe6f402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 -- 172.21.15.42:0/1122246243 shutdown_connections 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 --2- 172.21.15.42:0/1122246243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe708102240 0x7fe708108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 --2- 172.21.15.42:0/1122246243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708101880 0x7fe708101d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 --2- 172.21.15.42:0/1122246243 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708100690 0x7fe708100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 -- 172.21.15.42:0/1122246243 >> 172.21.15.42:0/1122246243 conn(0x7fe7080fbc00 msgr2=0x7fe7080fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:10.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 -- 172.21.15.42:0/1122246243 shutdown_connections 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.296+0000 7fe70ed79640 1 -- 172.21.15.42:0/1122246243 wait complete. 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 Processor -- start 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 -- start start 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 0x7fe70806a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708101880 0x7fe70819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe708102240 0x7fe7081a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe70810c3f0 con 0x7fe708100690 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe70810c270 con 0x7fe708101880 2024-03-31T23:15:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70ed79640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe70810c570 con 0x7fe708102240 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 0x7fe70806a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 0x7fe70806a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32784/0 (socket says 172.21.15.42:32784) 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 -- 172.21.15.42:0/3104630089 learned_addr learned my addr 172.21.15.42:0/3104630089 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70d316640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe708102240 0x7fe7081a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe707fff640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708101880 0x7fe70819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 -- 172.21.15.42:0/3104630089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe708102240 msgr2=0x7fe7081a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe708102240 0x7fe7081a11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 -- 172.21.15.42:0/3104630089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708101880 msgr2=0x7fe70819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708101880 0x7fe70819ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 -- 172.21.15.42:0/3104630089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081a19c0 con 0x7fe708100690 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe707fff640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708101880 0x7fe70819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.297+0000 7fe70cb15640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 0x7fe70806a8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00d950 tx=0x7fe6fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.298+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc017020 con 0x7fe708100690 2024-03-31T23:15:10.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.298+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6fc009c30 con 0x7fe708100690 2024-03-31T23:15:10.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.298+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7081a1c50 con 0x7fe708100690 2024-03-31T23:15:10.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.298+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00f7e0 con 0x7fe708100690 2024-03-31T23:15:10.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.298+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7081a21c0 con 0x7fe708100690 2024-03-31T23:15:10.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.299+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7081079b0 con 0x7fe708100690 2024-03-31T23:15:10.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.300+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fe6fc01a020 con 0x7fe708100690 2024-03-31T23:15:10.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.300+0000 7fe705ffb640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6f80a2550 0x7fe6f80a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:10.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.300+0000 7fe707fff640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6f80a2550 0x7fe6f80a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:10.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.300+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe6fc0cdbb0 con 0x7fe708100690 2024-03-31T23:15:10.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.301+0000 7fe707fff640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6f80a2550 0x7fe6f80a4a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4006010 tx=0x7fe6f402c9f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:10.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.305+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe6fc021070 con 0x7fe708100690 2024-03-31T23:15:10.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.528+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe70802d380 con 0x7fe708100690 2024-03-31T23:15:10.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.528+0000 7fe705ffb640 1 -- 172.21.15.42:0/3104630089 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4687 (secure 0 0 0) 0x7fe6fc09b210 con 0x7fe708100690 2024-03-31T23:15:10.529 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:10.530 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-31T23:15:10.530 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 6 2024-03-31T23:15:10.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6f80a2550 msgr2=0x7fe6f80a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:10.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6f80a2550 0x7fe6f80a4a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4006010 tx=0x7fe6f402c9f0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 msgr2=0x7fe70806a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:10.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 0x7fe70806a8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00d950 tx=0x7fe6fc00de10 comp rx=0 tx=0).stop 2024-03-31T23:15:10.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 shutdown_connections 2024-03-31T23:15:10.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe708102240 0x7fe7081a11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe708101880 0x7fe70819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe6f80a2550 0x7fe6f80a4a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 --2- 172.21.15.42:0/3104630089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe708100690 0x7fe70806a8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:10.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 >> 172.21.15.42:0/3104630089 conn(0x7fe7080fbc00 msgr2=0x7fe708104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:10.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 shutdown_connections 2024-03-31T23:15:10.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:10.530+0000 7fe70ed79640 1 -- 172.21.15.42:0/3104630089 wait complete. 2024-03-31T23:15:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:10 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3104630089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:11.191 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:10 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3104630089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:11.191 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:10 smithi188 systemd[1]: Starting Ceph mds.f for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:11.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:10 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3104630089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:11.455 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 podman[66339]: 2024-03-31 23:15:11.093658691 +0000 UTC m=+0.018221114 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:11.455 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 podman[66339]: 2024-03-31 23:15:11.206442659 +0000 UTC m=+0.131005116 container create fe1f16ec5f236205f8fad8633f9fbb7363b0bac33a5751aa89bf31e66992de72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-31T23:15:11.455 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 podman[66339]: 2024-03-31 23:15:11.454887966 +0000 UTC m=+0.379450395 container init fe1f16ec5f236205f8fad8633f9fbb7363b0bac33a5751aa89bf31e66992de72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-31T23:15:11.718 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 podman[66339]: 2024-03-31 23:15:11.457512689 +0000 UTC m=+0.382075115 container start fe1f16ec5f236205f8fad8633f9fbb7363b0bac33a5751aa89bf31e66992de72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-31T23:15:11.719 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 ceph-mds[66358]: -- 172.21.15.188:0/3626335772 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5609bd71fa40 con 0x5609bd6f2800 2024-03-31T23:15:11.719 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: starting mds.f at 2024-03-31T23:15:11.719 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 bash[66339]: fe1f16ec5f236205f8fad8633f9fbb7363b0bac33a5751aa89bf31e66992de72 2024-03-31T23:15:11.719 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:15:11 smithi188 systemd[1]: Started Ceph mds.f for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:12.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.659+0000 7f6eb439a640 1 -- 172.21.15.42:0/4210841562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 msgr2=0x7f6eac101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.659+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4210841562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac101ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009900 tx=0x7f6ea002bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- 172.21.15.42:0/4210841562 shutdown_connections 2024-03-31T23:15:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4210841562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac102220 0x7f6eac108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4210841562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac101ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4210841562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6eac100670 0x7f6eac100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- 172.21.15.42:0/4210841562 >> 172.21.15.42:0/4210841562 conn(0x7f6eac0fbbe0 msgr2=0x7f6eac0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- 172.21.15.42:0/4210841562 shutdown_connections 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- 172.21.15.42:0/4210841562 wait complete. 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 Processor -- start 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- start start 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac100670 0x7f6eac104600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6eac102220 0x7f6eac103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10c3d0 con 0x7f6eac101860 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10c250 con 0x7f6eac100670 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.660+0000 7f6eb439a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10c550 con 0x7f6eac102220 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32812/0 (socket says 172.21.15.42:32812) 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 -- 172.21.15.42:0/4081144545 learned_addr learned my addr 172.21.15.42:0/4081144545 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb2136640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac100670 0x7f6eac104600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb2937640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6eac102220 0x7f6eac103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 -- 172.21.15.42:0/4081144545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6eac102220 msgr2=0x7f6eac103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6eac102220 0x7f6eac103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 -- 172.21.15.42:0/4081144545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac100670 msgr2=0x7f6eac104600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac100670 0x7f6eac104600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 -- 172.21.15.42:0/4081144545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eac103a10 con 0x7f6eac101860 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb1935640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac102c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ea002ca30 tx=0x7f6ea002c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0043020 con 0x7f6eac101860 2024-03-31T23:15:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ea00042d0 con 0x7f6eac101860 2024-03-31T23:15:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eac1a1c90 con 0x7f6eac101860 2024-03-31T23:15:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0003cc0 con 0x7f6eac101860 2024-03-31T23:15:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.661+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eac1a2180 con 0x7f6eac101860 2024-03-31T23:15:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.662+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eac1a2350 con 0x7f6eac101860 2024-03-31T23:15:12.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.663+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f6ea0046020 con 0x7f6eac101860 2024-03-31T23:15:12.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.664+0000 7f6eab7fe640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e940a2520 0x7f6e940a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:12.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.664+0000 7f6eb2136640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e940a2520 0x7f6e940a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:12.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.664+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6ea00f02f0 con 0x7f6eac101860 2024-03-31T23:15:12.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.664+0000 7f6eb2136640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e940a2520 0x7f6e940a49e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005fd0 tx=0x7f6ea400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.668+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6ea004d020 con 0x7f6eac101860 2024-03-31T23:15:12.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: Deploying daemon mds.c on smithi188 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:boot 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: fsmap 6 up:standby 2024-03-31T23:15:12.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:12 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:15:12.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.890+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6eac1a26e0 con 0x7f6eac101860 2024-03-31T23:15:12.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.891+0000 7f6eab7fe640 1 -- 172.21.15.42:0/4081144545 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7f6ea00bdb00 con 0x7f6eac101860 2024-03-31T23:15:12.892 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:12.892 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-03-31T23:15:12.892 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e940a2520 msgr2=0x7f6e940a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e940a2520 0x7f6e940a49e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005fd0 tx=0x7f6ea400b390 comp rx=0 tx=0).stop 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 msgr2=0x7f6eac102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac102c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ea002ca30 tx=0x7f6ea002c710 comp rx=0 tx=0).stop 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 shutdown_connections 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6eac102220 0x7f6eac103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e940a2520 0x7f6e940a49e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6eac101860 0x7f6eac102c40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 --2- 172.21.15.42:0/4081144545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac100670 0x7f6eac104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:12.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 >> 172.21.15.42:0/4081144545 conn(0x7f6eac0fbbe0 msgr2=0x7f6eac0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:12.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 shutdown_connections 2024-03-31T23:15:12.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:12.893+0000 7f6eb439a640 1 -- 172.21.15.42:0/4081144545 wait complete. 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: Deploying daemon mds.c on smithi188 2024-03-31T23:15:12.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:boot 2024-03-31T23:15:12.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: fsmap 6 up:standby 2024-03-31T23:15:12.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:12 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:15:12.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:12.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:12.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:12.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:12.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:12.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: Deploying daemon mds.c on smithi188 2024-03-31T23:15:12.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:boot 2024-03-31T23:15:12.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: fsmap 6 up:standby 2024-03-31T23:15:12.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:12 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:15:13.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:13 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/4081144545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:13.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:13 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/4081144545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:13.969 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:13 smithi188 systemd[1]: Starting Ceph mds.c for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:14.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:13 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4081144545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:14.327 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 podman[66654]: 2024-03-31 23:15:13.970942003 +0000 UTC m=+0.017966636 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:14.327 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 podman[66654]: 2024-03-31 23:15:14.074189016 +0000 UTC m=+0.121213637 container create 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:15:14.327 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 podman[66654]: 2024-03-31 23:15:14.327179618 +0000 UTC m=+0.374204240 container init 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-31T23:15:14.650 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 podman[66654]: 2024-03-31 23:15:14.329864533 +0000 UTC m=+0.376889149 container start 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:15:14.650 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mds[66672]: -- 172.21.15.188:0/3903958115 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c7fdbefa40 con 0x55c7fdbc2c00 2024-03-31T23:15:14.650 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: starting mds.c at 2024-03-31T23:15:14.650 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 bash[66654]: 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c 2024-03-31T23:15:14.650 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:15:14 smithi188 systemd[1]: Started Ceph mds.c for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:14.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:14 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:14.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:14 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:14.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:14.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:14 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:15.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- 172.21.15.42:0/2450361982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec102220 msgr2=0x7faeec108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2450361982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec102220 0x7faeec108ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faee8009ca0 tx=0x7faee802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- 172.21.15.42:0/2450361982 shutdown_connections 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2450361982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec102220 0x7faeec108ab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2450361982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeec101860 0x7faeec101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2450361982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeec100670 0x7faeec100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- 172.21.15.42:0/2450361982 >> 172.21.15.42:0/2450361982 conn(0x7faeec0fbbe0 msgr2=0x7faeec0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- 172.21.15.42:0/2450361982 shutdown_connections 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- 172.21.15.42:0/2450361982 wait complete. 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 Processor -- start 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- start start 2024-03-31T23:15:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 0x7faeec104600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeec101860 0x7faeec102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeec102220 0x7faeec103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faeec10c420 con 0x7faeec100670 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.019+0000 7faef3b7a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faeec10c2a0 con 0x7faeec101860 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef3b7a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faeec10c5a0 con 0x7faeec102220 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 0x7faeec104600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 0x7faeec104600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48700/0 (socket says 172.21.15.42:48700) 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 -- 172.21.15.42:0/2845621346 learned_addr learned my addr 172.21.15.42:0/2845621346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1115640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeec101860 0x7faeec102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef2117640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeec102220 0x7faeec103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 -- 172.21.15.42:0/2845621346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeec102220 msgr2=0x7faeec103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeec102220 0x7faeec103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 -- 172.21.15.42:0/2845621346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeec101860 msgr2=0x7faeec102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeec101860 0x7faeec102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 -- 172.21.15.42:0/2845621346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec103a10 con 0x7faeec100670 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef1916640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 0x7faeec104600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faee400e9c0 tx=0x7faee400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee400cd80 con 0x7faeec100670 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faee40035f0 con 0x7faeec100670 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4010690 con 0x7faeec100670 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec1a1c10 con 0x7faeec100670 2024-03-31T23:15:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.020+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec1a2110 con 0x7faeec100670 2024-03-31T23:15:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.021+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec1a2340 con 0x7faeec100670 2024-03-31T23:15:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.022+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7faee40037a0 con 0x7faeec100670 2024-03-31T23:15:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.023+0000 7faee2ffd640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faed80a2520 0x7faed80a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.023+0000 7faef1115640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faed80a2520 0x7faed80a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.023+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7faee40ce800 con 0x7faeec100670 2024-03-31T23:15:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.024+0000 7faef1115640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faed80a2520 0x7faed80a49e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faeec104370 tx=0x7faedc00a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:15.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.028+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7faee409bdc0 con 0x7faeec100670 2024-03-31T23:15:15.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.251+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faeec1a2510 con 0x7faeec100670 2024-03-31T23:15:15.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.252+0000 7faee2ffd640 1 -- 172.21.15.42:0/2845621346 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6337 (secure 0 0 0) 0x7faee409b6c0 con 0x7faeec100670 2024-03-31T23:15:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:15.253 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-03-31T23:15:15.253 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-03-31T23:15:15.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faed80a2520 msgr2=0x7faed80a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:15.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faed80a2520 0x7faed80a49e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faeec104370 tx=0x7faedc00a250 comp rx=0 tx=0).stop 2024-03-31T23:15:15.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 msgr2=0x7faeec104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:15.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 0x7faeec104600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faee400e9c0 tx=0x7faee400ee80 comp rx=0 tx=0).stop 2024-03-31T23:15:15.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 shutdown_connections 2024-03-31T23:15:15.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeec102220 0x7faeec103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeec101860 0x7faeec102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faed80a2520 0x7faed80a49e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 --2- 172.21.15.42:0/2845621346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeec100670 0x7faeec104600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 >> 172.21.15.42:0/2845621346 conn(0x7faeec0fbbe0 msgr2=0x7faeec0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 shutdown_connections 2024-03-31T23:15:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:15.254+0000 7faef3b7a640 1 -- 172.21.15.42:0/2845621346 wait complete. 2024-03-31T23:15:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:15 smithi094 ceph-mon[36167]: Deploying daemon mds.h on smithi094 2024-03-31T23:15:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:15 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:boot 2024-03-31T23:15:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:15 smithi094 ceph-mon[36167]: fsmap 7 up:standby 2024-03-31T23:15:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:15 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:15:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:15 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2845621346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:15 smithi188 ceph-mon[36068]: Deploying daemon mds.h on smithi094 2024-03-31T23:15:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:15 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:boot 2024-03-31T23:15:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:15 smithi188 ceph-mon[36068]: fsmap 7 up:standby 2024-03-31T23:15:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:15 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:15:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:15 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2845621346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:16.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:15 smithi042 ceph-mon[32380]: Deploying daemon mds.h on smithi094 2024-03-31T23:15:16.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:15 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:boot 2024-03-31T23:15:16.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:15 smithi042 ceph-mon[32380]: fsmap 7 up:standby 2024-03-31T23:15:16.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:15 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:15:16.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:15 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2845621346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:16 smithi094 ceph-mon[36167]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:16.922 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:16 smithi094 systemd[1]: Starting Ceph mds.h for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:16 smithi188 ceph-mon[36068]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:17.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:16 smithi042 ceph-mon[32380]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:17.201 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:16 smithi094 podman[66305]: 2024-03-31 23:15:16.845482217 +0000 UTC m=+0.017600471 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:17.201 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:16 smithi094 podman[66305]: 2024-03-31 23:15:16.964695594 +0000 UTC m=+0.136813867 container create 427c02c34b76077a5a2d74aacd307a4cb20c2bef835196ece98a315c9bbc0605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:15:17.201 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:17 smithi094 podman[66305]: 2024-03-31 23:15:17.20128557 +0000 UTC m=+0.373403849 container init 427c02c34b76077a5a2d74aacd307a4cb20c2bef835196ece98a315c9bbc0605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-384f31f) 2024-03-31T23:15:17.267 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:17.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 -- 172.21.15.42:0/2573120594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130101860 msgr2=0x7f5130101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 --2- 172.21.15.42:0/2573120594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130101860 0x7f5130101ce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5118009900 tx=0x7f511802bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 -- 172.21.15.42:0/2573120594 shutdown_connections 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 --2- 172.21.15.42:0/2573120594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130102220 0x7f5130108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 --2- 172.21.15.42:0/2573120594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130101860 0x7f5130101ce0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 --2- 172.21.15.42:0/2573120594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130100670 0x7f5130100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 -- 172.21.15.42:0/2573120594 >> 172.21.15.42:0/2573120594 conn(0x7f51300fbbe0 msgr2=0x7f51300fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 -- 172.21.15.42:0/2573120594 shutdown_connections 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 -- 172.21.15.42:0/2573120594 wait complete. 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 Processor -- start 2024-03-31T23:15:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.392+0000 7f5136623640 1 -- start start 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5136623640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 0x7f5130197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5136623640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130101860 0x7f5130198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5136623640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130102220 0x7f513019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5136623640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f513010c3d0 con 0x7f5130100670 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5136623640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f513010c250 con 0x7f5130102220 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5136623640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f513010c550 con 0x7f5130101860 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 0x7f5130197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 0x7f5130197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48706/0 (socket says 172.21.15.42:48706) 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 -- 172.21.15.42:0/2500501484 learned_addr learned my addr 172.21.15.42:0/2500501484 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512f7fe640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130101860 0x7f5130198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5134bc0640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130102220 0x7f513019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 -- 172.21.15.42:0/2500501484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130101860 msgr2=0x7f5130198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130101860 0x7f5130198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 -- 172.21.15.42:0/2500501484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130102220 msgr2=0x7f513019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130102220 0x7f513019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 -- 172.21.15.42:0/2500501484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513019f730 con 0x7f5130100670 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f5134bc0640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130102220 0x7f513019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512f7fe640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130101860 0x7f5130198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.393+0000 7f512ffff640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 0x7f5130197b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f512000c970 tx=0x7f512000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.394+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120007c10 con 0x7f5130100670 2024-03-31T23:15:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.394+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5120007db0 con 0x7f5130100670 2024-03-31T23:15:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.394+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513019fa20 con 0x7f5130100670 2024-03-31T23:15:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.394+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512000fa40 con 0x7f5130100670 2024-03-31T23:15:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.394+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513019ff40 con 0x7f5130100670 2024-03-31T23:15:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.395+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5130068540 con 0x7f5130100670 2024-03-31T23:15:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.396+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f512000fbe0 con 0x7f5130100670 2024-03-31T23:15:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.396+0000 7f512d7fa640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f511c0a24a0 0x7f511c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.397+0000 7f512f7fe640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f511c0a24a0 0x7f511c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.397+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f51200ce6c0 con 0x7f5130100670 2024-03-31T23:15:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.397+0000 7f512f7fe640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f511c0a24a0 0x7f511c0a4960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5118006010 tx=0x7f5118005be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:17.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.401+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f512009bdb0 con 0x7f5130100670 2024-03-31T23:15:17.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.622+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51301a01d0 con 0x7f5130100670 2024-03-31T23:15:17.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.623+0000 7f512d7fa640 1 -- 172.21.15.42:0/2500501484 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6337 (secure 0 0 0) 0x7f512009b6b0 con 0x7f5130100670 2024-03-31T23:15:17.624 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:17.624 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-03-31T23:15:17.624 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f511c0a24a0 msgr2=0x7f511c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f511c0a24a0 0x7f511c0a4960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5118006010 tx=0x7f5118005be0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 msgr2=0x7f5130197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 0x7f5130197b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f512000c970 tx=0x7f512000ce30 comp rx=0 tx=0).stop 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 shutdown_connections 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5130102220 0x7f513019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5130101860 0x7f5130198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f511c0a24a0 0x7f511c0a4960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 --2- 172.21.15.42:0/2500501484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5130100670 0x7f5130197b10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 >> 172.21.15.42:0/2500501484 conn(0x7f51300fbbe0 msgr2=0x7f51300fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 shutdown_connections 2024-03-31T23:15:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:17.625+0000 7f5136623640 1 -- 172.21.15.42:0/2500501484 wait complete. 2024-03-31T23:15:17.672 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:17 smithi094 podman[66305]: 2024-03-31 23:15:17.203983558 +0000 UTC m=+0.376101816 container start 427c02c34b76077a5a2d74aacd307a4cb20c2bef835196ece98a315c9bbc0605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, GIT_BRANCH=HEAD) 2024-03-31T23:15:17.672 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:17 smithi094 ceph-mds[66325]: -- 172.21.15.94:0/4057900407 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf2f171a40 con 0x55bf2f144800 2024-03-31T23:15:17.672 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: starting mds.h at 2024-03-31T23:15:17.672 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:17 smithi094 bash[66305]: 427c02c34b76077a5a2d74aacd307a4cb20c2bef835196ece98a315c9bbc0605 2024-03-31T23:15:17.672 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:15:17 smithi094 systemd[1]: Started Ceph mds.h for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:18.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:19.126 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.126 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.127 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.127 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:19.127 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:19.127 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:19.127 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: Deploying daemon mds.i on smithi188 2024-03-31T23:15:19.128 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2500501484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:19.128 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:boot 2024-03-31T23:15:19.128 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: fsmap 8 up:standby 2024-03-31T23:15:19.128 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:18 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:15:19.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:19.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: Deploying daemon mds.i on smithi188 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2500501484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:boot 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: fsmap 8 up:standby 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:18 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:19.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:19.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:19.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: Deploying daemon mds.i on smithi188 2024-03-31T23:15:19.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2500501484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:19.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:boot 2024-03-31T23:15:19.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: fsmap 8 up:standby 2024-03-31T23:15:19.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:18 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:15:19.638 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:19.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:19 smithi188 systemd[1]: Starting Ceph mds.i for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:19.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:19 smithi188 podman[66960]: 2024-03-31 23:15:19.620368226 +0000 UTC m=+0.018064581 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 -- 172.21.15.42:0/1381075413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa858104b20 msgr2=0x7fa858106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 --2- 172.21.15.42:0/1381075413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa858104b20 0x7fa858106f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009900 tx=0x7fa84c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 -- 172.21.15.42:0/1381075413 shutdown_connections 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 --2- 172.21.15.42:0/1381075413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858107450 0x7fa8581098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 --2- 172.21.15.42:0/1381075413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa858104b20 0x7fa858106f10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 --2- 172.21.15.42:0/1381075413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8581021f0 0x7fa8581045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.752+0000 7fa85dde9640 1 -- 172.21.15.42:0/1381075413 >> 172.21.15.42:0/1381075413 conn(0x7fa8580fbbe0 msgr2=0x7fa8580fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.753+0000 7fa85dde9640 1 -- 172.21.15.42:0/1381075413 shutdown_connections 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.753+0000 7fa85dde9640 1 -- 172.21.15.42:0/1381075413 wait complete. 2024-03-31T23:15:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.753+0000 7fa85dde9640 1 Processor -- start 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.753+0000 7fa85dde9640 1 -- start start 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa85dde9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 0x7fa858101b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa85dde9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858104b20 0x7fa8581001a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa85dde9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa858107450 0x7fa8581006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa85dde9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa85810d550 con 0x7fa8581021f0 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa85dde9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa85810d3d0 con 0x7fa858104b20 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa85dde9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa85810d6d0 con 0x7fa858107450 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 0x7fa858101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa856ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858104b20 0x7fa8581001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:19.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 0x7fa858101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48730/0 (socket says 172.21.15.42:48730) 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 -- 172.21.15.42:0/174856181 learned_addr learned my addr 172.21.15.42:0/174856181 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa857fff640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa858107450 0x7fa8581006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 -- 172.21.15.42:0/174856181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa858107450 msgr2=0x7fa8581006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa858107450 0x7fa8581006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 -- 172.21.15.42:0/174856181 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858104b20 msgr2=0x7fa8581001a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858104b20 0x7fa8581001a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 -- 172.21.15.42:0/174856181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa858100f70 con 0x7fa8581021f0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa856ffd640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858104b20 0x7fa8581001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa8577fe640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 0x7fa858101b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa84800ea80 tx=0x7fa84800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.754+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84800ce40 con 0x7fa8581021f0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.755+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa848004b20 con 0x7fa8581021f0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.755+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8581a1d10 con 0x7fa8581021f0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.755+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848011830 con 0x7fa8581021f0 2024-03-31T23:15:19.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.755+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8581a2180 con 0x7fa8581021f0 2024-03-31T23:15:19.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.756+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8580fd6d0 con 0x7fa8581021f0 2024-03-31T23:15:19.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.757+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fa848004cd0 con 0x7fa8581021f0 2024-03-31T23:15:19.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.757+0000 7fa854ff9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8400a24a0 0x7fa8400a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:19.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.757+0000 7fa856ffd640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8400a24a0 0x7fa8400a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:19.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.757+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa8480ce820 con 0x7fa8581021f0 2024-03-31T23:15:19.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.758+0000 7fa856ffd640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8400a24a0 0x7fa8400a4960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa84c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:19.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.761+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa848016030 con 0x7fa8581021f0 2024-03-31T23:15:19.968 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:19 smithi188 podman[66960]: 2024-03-31 23:15:19.738030743 +0000 UTC m=+0.135727076 container create 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f) 2024-03-31T23:15:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.982+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa85802d170 con 0x7fa8581021f0 2024-03-31T23:15:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.983+0000 7fa854ff9640 1 -- 172.21.15.42:0/174856181 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7162 (secure 0 0 0) 0x7fa84809b830 con 0x7fa8581021f0 2024-03-31T23:15:19.984 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:19.984 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-31T23:15:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 9 2024-03-31T23:15:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8400a24a0 msgr2=0x7fa8400a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8400a24a0 0x7fa8400a4960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa84c005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 msgr2=0x7fa858101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 0x7fa858101b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa84800ea80 tx=0x7fa84800ef40 comp rx=0 tx=0).stop 2024-03-31T23:15:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 shutdown_connections 2024-03-31T23:15:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa858107450 0x7fa8581006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa858104b20 0x7fa8581001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8400a24a0 0x7fa8400a4960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 --2- 172.21.15.42:0/174856181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8581021f0 0x7fa858101b60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 >> 172.21.15.42:0/174856181 conn(0x7fa8580fbbe0 msgr2=0x7fa858102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 shutdown_connections 2024-03-31T23:15:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:19.985+0000 7fa85dde9640 1 -- 172.21.15.42:0/174856181 wait complete. 2024-03-31T23:15:20.357 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:19 smithi188 podman[66960]: 2024-03-31 23:15:19.974206857 +0000 UTC m=+0.371903199 container init 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-31T23:15:20.357 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:19 smithi188 podman[66960]: 2024-03-31 23:15:19.976868618 +0000 UTC m=+0.374564962 container start 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326) 2024-03-31T23:15:20.358 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:19 smithi188 ceph-mds[66979]: -- 172.21.15.188:0/3970382970 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb52465a40 con 0x55bb52438c00 2024-03-31T23:15:20.358 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: starting mds.i at 2024-03-31T23:15:20.358 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:20 smithi188 bash[66960]: 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 2024-03-31T23:15:20.358 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:15:20 smithi188 systemd[1]: Started Ceph mds.i for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/174856181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:20.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:20 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:20.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/174856181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:20 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/174856181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:20.776 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:20 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:21.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:21 smithi188 ceph-mon[36068]: Deploying daemon mds.g on smithi042 2024-03-31T23:15:21.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:21 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:boot 2024-03-31T23:15:21.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:21 smithi188 ceph-mon[36068]: fsmap 9 up:standby 2024-03-31T23:15:21.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:21 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:15:21.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:21 smithi094 ceph-mon[36167]: Deploying daemon mds.g on smithi042 2024-03-31T23:15:21.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:21 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:boot 2024-03-31T23:15:21.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:21 smithi094 ceph-mon[36167]: fsmap 9 up:standby 2024-03-31T23:15:21.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:21 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:15:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:21 smithi042 ceph-mon[32380]: Deploying daemon mds.g on smithi042 2024-03-31T23:15:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:21 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:boot 2024-03-31T23:15:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:21 smithi042 ceph-mon[32380]: fsmap 9 up:standby 2024-03-31T23:15:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:21 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:15:21.998 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:22.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 -- 172.21.15.42:0/463363355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb01021f0 msgr2=0x7faeb01045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:22.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 --2- 172.21.15.42:0/463363355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb01021f0 0x7faeb01045e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faea4009900 tx=0x7faea402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:22.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 -- 172.21.15.42:0/463363355 shutdown_connections 2024-03-31T23:15:22.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 --2- 172.21.15.42:0/463363355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeb0107450 0x7faeb01098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 --2- 172.21.15.42:0/463363355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb0104b20 0x7faeb0106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 --2- 172.21.15.42:0/463363355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb01021f0 0x7faeb01045e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 -- 172.21.15.42:0/463363355 >> 172.21.15.42:0/463363355 conn(0x7faeb00fbbe0 msgr2=0x7faeb00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 -- 172.21.15.42:0/463363355 shutdown_connections 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.279+0000 7faeb64c9640 1 -- 172.21.15.42:0/463363355 wait complete. 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 Processor -- start 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 -- start start 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb01021f0 0x7faeb0197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 0x7faeb01980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeb0107450 0x7faeb019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faeb010d4d0 con 0x7faeb0104b20 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faeb010d350 con 0x7faeb01021f0 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeb64c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faeb010d650 con 0x7faeb0107450 2024-03-31T23:15:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeaf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 0x7faeb01980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeaf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 0x7faeb01980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48736/0 (socket says 172.21.15.42:48736) 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeaffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb01021f0 0x7faeb0197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.280+0000 7faeaf7fe640 1 -- 172.21.15.42:0/1223361420 learned_addr learned my addr 172.21.15.42:0/1223361420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeb4a66640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeb0107450 0x7faeb019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaffff640 1 -- 172.21.15.42:0/1223361420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeb0107450 msgr2=0x7faeb019f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaffff640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeb0107450 0x7faeb019f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaffff640 1 -- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 msgr2=0x7faeb01980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaffff640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 0x7faeb01980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaffff640 1 -- 172.21.15.42:0/1223361420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb019f7a0 con 0x7faeb01021f0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaf7fe640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 0x7faeb01980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeaffff640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb01021f0 0x7faeb0197b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faea4009230 tx=0x7faea4004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4043020 con 0x7faeb01021f0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faea4004250 con 0x7faeb01021f0 2024-03-31T23:15:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb019fa30 con 0x7faeb01021f0 2024-03-31T23:15:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea40039d0 con 0x7faeb01021f0 2024-03-31T23:15:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.281+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb019ff80 con 0x7faeb01021f0 2024-03-31T23:15:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.282+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb00fd6d0 con 0x7faeb01021f0 2024-03-31T23:15:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.283+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7faea4046020 con 0x7faeb01021f0 2024-03-31T23:15:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.284+0000 7faead7fa640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fae980a24a0 0x7fae980a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.284+0000 7faeaf7fe640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fae980a24a0 0x7fae980a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.284+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7faea40f0840 con 0x7faeb01021f0 2024-03-31T23:15:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.284+0000 7faeaf7fe640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fae980a24a0 0x7fae980a4960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faeb0199090 tx=0x7faea0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:22.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.287+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7faea404d020 con 0x7faeb01021f0 2024-03-31T23:15:22.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.525+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faeb002d290 con 0x7faeb01021f0 2024-03-31T23:15:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.526+0000 7faead7fa640 1 -- 172.21.15.42:0/1223361420 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7992 (secure 0 0 0) 0x7faea40bde00 con 0x7faeb01021f0 2024-03-31T23:15:22.527 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:22.527 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-31T23:15:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2024-03-31T23:15:22.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fae980a24a0 msgr2=0x7fae980a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fae980a24a0 0x7fae980a4960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faeb0199090 tx=0x7faea0005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb01021f0 msgr2=0x7faeb0197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb01021f0 0x7faeb0197b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faea4009230 tx=0x7faea4004a30 comp rx=0 tx=0).stop 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 shutdown_connections 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faeb0107450 0x7faeb019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fae980a24a0 0x7fae980a4960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faeb0104b20 0x7faeb01980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 --2- 172.21.15.42:0/1223361420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeb01021f0 0x7faeb0197b80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 >> 172.21.15.42:0/1223361420 conn(0x7faeb00fbbe0 msgr2=0x7faeb0102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 shutdown_connections 2024-03-31T23:15:22.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:22.528+0000 7faeb64c9640 1 -- 172.21.15.42:0/1223361420 wait complete. 2024-03-31T23:15:22.540 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:22 smithi042 ceph-mon[32380]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:22.540 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 systemd[1]: Starting Ceph mds.g for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:22.666 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:22 smithi094 ceph-mon[36167]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:22.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:22 smithi188 ceph-mon[36068]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:22.793 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 podman[71328]: 2024-03-31 23:15:22.52814951 +0000 UTC m=+0.019564026 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:22.793 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 podman[71328]: 2024-03-31 23:15:22.644100852 +0000 UTC m=+0.135515400 container create b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-31T23:15:23.075 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 podman[71328]: 2024-03-31 23:15:22.89738231 +0000 UTC m=+0.388796825 container init b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:15:23.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 podman[71328]: 2024-03-31 23:15:22.900205723 +0000 UTC m=+0.391620236 container start b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-31T23:15:23.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 ceph-mds[71348]: -- 172.21.15.42:0/1762034719 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556155767a40 con 0x55615573a800 2024-03-31T23:15:23.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g[71344]: starting mds.g at 2024-03-31T23:15:23.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 bash[71328]: b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 2024-03-31T23:15:23.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:15:22 smithi042 systemd[1]: Started Ceph mds.g for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:23.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1223361420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:23.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:23.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:23.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:23 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:23.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1223361420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:23.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:23.703 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:23.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:23 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:23.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1223361420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:23.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:23.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:23.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:23.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:23 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:24.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:24.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 -- 172.21.15.42:0/3946407709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c101860 msgr2=0x7f521c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:24.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 --2- 172.21.15.42:0/3946407709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c101860 0x7f521c101ce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f520c009900 tx=0x7f520c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:24.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 -- 172.21.15.42:0/3946407709 shutdown_connections 2024-03-31T23:15:24.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 --2- 172.21.15.42:0/3946407709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c102220 0x7f521c108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 --2- 172.21.15.42:0/3946407709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c101860 0x7f521c101ce0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 --2- 172.21.15.42:0/3946407709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f521c100670 0x7f521c100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 -- 172.21.15.42:0/3946407709 >> 172.21.15.42:0/3946407709 conn(0x7f521c0fbbe0 msgr2=0x7f521c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:24.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 -- 172.21.15.42:0/3946407709 shutdown_connections 2024-03-31T23:15:24.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.658+0000 7f5223999640 1 -- 172.21.15.42:0/3946407709 wait complete. 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 Processor -- start 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 -- start start 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c100670 0x7f521c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f521c101860 0x7f521c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 0x7f521c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10c3d0 con 0x7f521c102220 2024-03-31T23:15:24.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10c250 con 0x7f521c101860 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5223999640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10c550 con 0x7f521c100670 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5221f36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 0x7f521c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5221f36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 0x7f521c19f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49824/0 (socket says 172.21.15.42:49824) 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.659+0000 7f5221f36640 1 -- 172.21.15.42:0/4162416021 learned_addr learned my addr 172.21.15.42:0/4162416021 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221735640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c100670 0x7f521c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5220f34640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f521c101860 0x7f521c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221f36640 1 -- 172.21.15.42:0/4162416021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c100670 msgr2=0x7f521c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221f36640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c100670 0x7f521c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221f36640 1 -- 172.21.15.42:0/4162416021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f521c101860 msgr2=0x7f521c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221f36640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f521c101860 0x7f521c198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221f36640 1 -- 172.21.15.42:0/4162416021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c19f760 con 0x7f521c102220 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221735640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c100670 0x7f521c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5221f36640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 0x7f521c19f0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f521400eb10 tx=0x7f521400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214004b20 con 0x7f521c102220 2024-03-31T23:15:24.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5214004cc0 con 0x7f521c102220 2024-03-31T23:15:24.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c19fa50 con 0x7f521c102220 2024-03-31T23:15:24.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140107f0 con 0x7f521c102220 2024-03-31T23:15:24.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.660+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c19ffa0 con 0x7f521c102220 2024-03-31T23:15:24.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.661+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c1a0230 con 0x7f521c102220 2024-03-31T23:15:24.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.662+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f5214005000 con 0x7f521c102220 2024-03-31T23:15:24.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.663+0000 7f52127fc640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f52080a24a0 0x7f52080a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:24.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.663+0000 7f5221735640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f52080a24a0 0x7f52080a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:24.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.663+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f52140ceb50 con 0x7f521c102220 2024-03-31T23:15:24.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.664+0000 7f5221735640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f52080a24a0 0x7f52080a4960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5218005d00 tx=0x7f5218005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:24.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.667+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5214053280 con 0x7f521c102220 2024-03-31T23:15:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:24 smithi094 ceph-mon[36167]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:24 smithi094 ceph-mon[36167]: Deploying daemon mds.a on smithi042 2024-03-31T23:15:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:24 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.42:6838/2174921226,v1:172.21.15.42:6839/2174921226] up:boot 2024-03-31T23:15:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:24 smithi094 ceph-mon[36167]: fsmap 10 up:standby 2024-03-31T23:15:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:24 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:15:24.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:24 smithi042 ceph-mon[32380]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:24.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:24 smithi042 ceph-mon[32380]: Deploying daemon mds.a on smithi042 2024-03-31T23:15:24.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:24 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.42:6838/2174921226,v1:172.21.15.42:6839/2174921226] up:boot 2024-03-31T23:15:24.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:24 smithi042 ceph-mon[32380]: fsmap 10 up:standby 2024-03-31T23:15:24.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:24 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:15:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:24 smithi188 ceph-mon[36068]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:24 smithi188 ceph-mon[36068]: Deploying daemon mds.a on smithi042 2024-03-31T23:15:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:24 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.42:6838/2174921226,v1:172.21.15.42:6839/2174921226] up:boot 2024-03-31T23:15:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:24 smithi188 ceph-mon[36068]: fsmap 10 up:standby 2024-03-31T23:15:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:24 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:15:24.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.899+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f521c1a0400 con 0x7f521c102220 2024-03-31T23:15:24.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.899+0000 7f52127fc640 1 -- 172.21.15.42:0/4162416021 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8818 (secure 0 0 0) 0x7f521409c110 con 0x7f521c102220 2024-03-31T23:15:24.901 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-31T23:15:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 11 2024-03-31T23:15:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f52080a24a0 msgr2=0x7f52080a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f52080a24a0 0x7f52080a4960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5218005d00 tx=0x7f5218005ef0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 msgr2=0x7f521c19f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 0x7f521c19f0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f521400eb10 tx=0x7f521400c2d0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 shutdown_connections 2024-03-31T23:15:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f52080a24a0 0x7f52080a4960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f521c102220 0x7f521c19f0f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f521c101860 0x7f521c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 --2- 172.21.15.42:0/4162416021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f521c100670 0x7f521c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 >> 172.21.15.42:0/4162416021 conn(0x7f521c0fbbe0 msgr2=0x7f521c0fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 shutdown_connections 2024-03-31T23:15:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:24.902+0000 7f5223999640 1 -- 172.21.15.42:0/4162416021 wait complete. 2024-03-31T23:15:25.326 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 systemd[1]: Starting Ceph mds.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:25.653 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:25 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4162416021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:25.653 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 podman[71689]: 2024-03-31 23:15:25.315245863 +0000 UTC m=+0.018181314 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:25.654 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 podman[71689]: 2024-03-31 23:15:25.425952556 +0000 UTC m=+0.128888006 container create d804080dd6db4c56300e7300147b072d1f30b9f0bde1f9bee92185a0b44f9f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:15:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:25 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/4162416021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:25.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:25 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/4162416021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:26.007 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 podman[71689]: 2024-03-31 23:15:25.653620595 +0000 UTC m=+0.356556055 container init d804080dd6db4c56300e7300147b072d1f30b9f0bde1f9bee92185a0b44f9f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-31T23:15:26.007 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 podman[71689]: 2024-03-31 23:15:25.656554171 +0000 UTC m=+0.359489625 container start d804080dd6db4c56300e7300147b072d1f30b9f0bde1f9bee92185a0b44f9f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:15:26.008 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 ceph-mds[71710]: -- 172.21.15.42:0/3523091977 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c890063a40 con 0x55c890037000 2024-03-31T23:15:26.008 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a[71706]: starting mds.a at 2024-03-31T23:15:26.008 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 bash[71689]: d804080dd6db4c56300e7300147b072d1f30b9f0bde1f9bee92185a0b44f9f82 2024-03-31T23:15:26.008 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:15:25 smithi042 systemd[1]: Started Ceph mds.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:26.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:26.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:26 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:26.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:26.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:26 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:26.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:26.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:26.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-31T23:15:26.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-31T23:15:26.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:26 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:26.916 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 -- 172.21.15.42:0/592408880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 msgr2=0x7fa588108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 --2- 172.21.15.42:0/592408880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa588108b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa580009ca0 tx=0x7fa58002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 -- 172.21.15.42:0/592408880 shutdown_connections 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 --2- 172.21.15.42:0/592408880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa588108b30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 --2- 172.21.15.42:0/592408880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5881018e0 0x7fa588101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 --2- 172.21.15.42:0/592408880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 0x7fa588100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 -- 172.21.15.42:0/592408880 >> 172.21.15.42:0/592408880 conn(0x7fa5880fbc80 msgr2=0x7fa5880fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 -- 172.21.15.42:0/592408880 shutdown_connections 2024-03-31T23:15:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 -- 172.21.15.42:0/592408880 wait complete. 2024-03-31T23:15:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 Processor -- start 2024-03-31T23:15:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.035+0000 7fa58e502640 1 -- start start 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58e502640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 0x7fa58806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58e502640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5881018e0 0x7fa58819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58e502640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa58819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58e502640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa58810c430 con 0x7fa5881022a0 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58e502640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa58810c2b0 con 0x7fa5881006f0 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58e502640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa58810c5b0 con 0x7fa5881018e0 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa58819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa58819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49870/0 (socket says 172.21.15.42:49870) 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 -- 172.21.15.42:0/3958136380 learned_addr learned my addr 172.21.15.42:0/3958136380 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa5877fe640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5881018e0 0x7fa58819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa587fff640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 0x7fa58806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 -- 172.21.15.42:0/3958136380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5881018e0 msgr2=0x7fa58819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5881018e0 0x7fa58819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 -- 172.21.15.42:0/3958136380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 msgr2=0x7fa58806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 0x7fa58806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 -- 172.21.15.42:0/3958136380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58819f710 con 0x7fa5881022a0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa587fff640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 0x7fa58806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.036+0000 7fa58ca9f640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa58819ee50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa58002c700 tx=0x7fa5800346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.037+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580039040 con 0x7fa5881022a0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.037+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58819f9a0 con 0x7fa5881022a0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.037+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa580044070 con 0x7fa5881022a0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.037+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5800043c0 con 0x7fa5881022a0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.037+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58819fe90 con 0x7fa5881022a0 2024-03-31T23:15:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.038+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa588107940 con 0x7fa5881022a0 2024-03-31T23:15:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.039+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fa5800045a0 con 0x7fa5881022a0 2024-03-31T23:15:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.039+0000 7fa5857fa640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5740a24a0 0x7fa5740a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.040+0000 7fa587fff640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5740a24a0 0x7fa5740a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.040+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa5800f09f0 con 0x7fa5881022a0 2024-03-31T23:15:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.040+0000 7fa587fff640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5740a24a0 0x7fa5740a4960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa588101740 tx=0x7fa570005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:27.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.044+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa5800be050 con 0x7fa5881022a0 2024-03-31T23:15:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.267+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa58802d170 con 0x7fa5881022a0 2024-03-31T23:15:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.267+0000 7fa5857fa640 1 -- 172.21.15.42:0/3958136380 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9644 (secure 0 0 0) 0x7fa5800bd950 con 0x7fa5881022a0 2024-03-31T23:15:27.268 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:27.268 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-31T23:15:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 12 2024-03-31T23:15:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.269+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5740a24a0 msgr2=0x7fa5740a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.269+0000 7fa58e502640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5740a24a0 0x7fa5740a4960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa588101740 tx=0x7fa570005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.269+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 msgr2=0x7fa58819ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.269+0000 7fa58e502640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa58819ee50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa58002c700 tx=0x7fa5800346d0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 shutdown_connections 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5740a24a0 0x7fa5740a4960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5881022a0 0x7fa58819ee50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5881018e0 0x7fa58819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 --2- 172.21.15.42:0/3958136380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5881006f0 0x7fa58806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 >> 172.21.15.42:0/3958136380 conn(0x7fa5880fbc80 msgr2=0x7fa588104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 shutdown_connections 2024-03-31T23:15:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:27.270+0000 7fa58e502640 1 -- 172.21.15.42:0/3958136380 wait complete. 2024-03-31T23:15:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:27 smithi042 ceph-mon[32380]: Deploying daemon mds.b on smithi094 2024-03-31T23:15:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:27 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.42:6840/1878678856,v1:172.21.15.42:6841/1878678856] up:boot 2024-03-31T23:15:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:27 smithi042 ceph-mon[32380]: fsmap 11 up:standby 2024-03-31T23:15:27.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:27 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:15:27.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:27 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3958136380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:27 smithi094 ceph-mon[36167]: Deploying daemon mds.b on smithi094 2024-03-31T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:27 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.42:6840/1878678856,v1:172.21.15.42:6841/1878678856] up:boot 2024-03-31T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:27 smithi094 ceph-mon[36167]: fsmap 11 up:standby 2024-03-31T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:27 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:27 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3958136380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:27 smithi188 ceph-mon[36068]: Deploying daemon mds.b on smithi094 2024-03-31T23:15:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:27 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.42:6840/1878678856,v1:172.21.15.42:6841/1878678856] up:boot 2024-03-31T23:15:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:27 smithi188 ceph-mon[36068]: fsmap 11 up:standby 2024-03-31T23:15:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:27 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:15:27.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:27 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3958136380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:28.387 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 systemd[1]: Starting Ceph mds.b for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:15:28.660 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:28 smithi094 ceph-mon[36167]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:28.660 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 podman[66628]: 2024-03-31 23:15:28.306157461 +0000 UTC m=+0.017484851 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:15:28.660 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 podman[66628]: 2024-03-31 23:15:28.423716835 +0000 UTC m=+0.135044217 container create f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-31T23:15:28.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:28 smithi188 ceph-mon[36068]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:28.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:28 smithi042 ceph-mon[32380]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:28.922 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 podman[66628]: 2024-03-31 23:15:28.660338406 +0000 UTC m=+0.371665803 container init f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-384f31f, ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-31T23:15:28.922 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 podman[66628]: 2024-03-31 23:15:28.663369151 +0000 UTC m=+0.374696541 container start f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-384f31f, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-31T23:15:28.922 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 ceph-mds[66647]: -- 172.21.15.94:0/2196540096 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56332f5b1a40 con 0x56332f584c00 2024-03-31T23:15:28.922 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: starting mds.b at 2024-03-31T23:15:28.922 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 bash[66628]: f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a 2024-03-31T23:15:28.922 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:28 smithi094 systemd[1]: Started Ceph mds.b for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:15:29.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:29.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 -- 172.21.15.42:0/987791771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 msgr2=0x7f8a90100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 --2- 172.21.15.42:0/987791771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90100a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009ca0 tx=0x7f8a8002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 -- 172.21.15.42:0/987791771 shutdown_connections 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 --2- 172.21.15.42:0/987791771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a90102220 0x7f8a90108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 --2- 172.21.15.42:0/987791771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a90101860 0x7f8a90101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 --2- 172.21.15.42:0/987791771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90100a90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 -- 172.21.15.42:0/987791771 >> 172.21.15.42:0/987791771 conn(0x7f8a900fbbe0 msgr2=0x7f8a900fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 -- 172.21.15.42:0/987791771 shutdown_connections 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.385+0000 7f8a9618c640 1 -- 172.21.15.42:0/987791771 wait complete. 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 Processor -- start 2024-03-31T23:15:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 -- start start 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a90101860 0x7f8a90198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a90102220 0x7f8a9019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010c420 con 0x7f8a90100670 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010c2a0 con 0x7f8a90101860 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a9618c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010c5a0 con 0x7f8a90102220 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a8f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a8f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49882/0 (socket says 172.21.15.42:49882) 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a8f7fe640 1 -- 172.21.15.42:0/666381160 learned_addr learned my addr 172.21.15.42:0/666381160 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a8effd640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a90101860 0x7f8a90198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.386+0000 7f8a8ffff640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a90102220 0x7f8a9019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.387+0000 7f8a8f7fe640 1 -- 172.21.15.42:0/666381160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a90102220 msgr2=0x7f8a9019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.387+0000 7f8a8f7fe640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a90102220 0x7f8a9019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.387+0000 7f8a8f7fe640 1 -- 172.21.15.42:0/666381160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a90101860 msgr2=0x7f8a90198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.387+0000 7f8a8f7fe640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a90101860 0x7f8a90198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.387+0000 7f8a8f7fe640 1 -- 172.21.15.42:0/666381160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9019f810 con 0x7f8a90100670 2024-03-31T23:15:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.387+0000 7f8a8f7fe640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90197c40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8a80000f80 tx=0x7f8a80034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.389+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80039040 con 0x7f8a90100670 2024-03-31T23:15:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.389+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a90102a80 con 0x7f8a90100670 2024-03-31T23:15:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.389+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a80044070 con 0x7f8a90100670 2024-03-31T23:15:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.389+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a800045d0 con 0x7f8a90100670 2024-03-31T23:15:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.389+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a90102f90 con 0x7f8a90100670 2024-03-31T23:15:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.390+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a901031f0 con 0x7f8a90100670 2024-03-31T23:15:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.391+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f8a80003970 con 0x7f8a90100670 2024-03-31T23:15:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.392+0000 7f8a8cff9640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8a780a24a0 0x7f8a780a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.392+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8a800f1410 con 0x7f8a90100670 2024-03-31T23:15:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.392+0000 7f8a8effd640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8a780a24a0 0x7f8a780a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.392+0000 7f8a8effd640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8a780a24a0 0x7f8a780a4960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a90199100 tx=0x7f8a8400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:29.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.396+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8a800bea70 con 0x7f8a90100670 2024-03-31T23:15:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.635+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a901033c0 con 0x7f8a90100670 2024-03-31T23:15:29.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.636+0000 7f8a8cff9640 1 -- 172.21.15.42:0/666381160 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10470 (secure 0 0 0) 0x7f8a800be370 con 0x7f8a90100670 2024-03-31T23:15:29.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:29.637 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-03-31T23:15:29.637 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 13 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8a780a24a0 msgr2=0x7f8a780a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8a780a24a0 0x7f8a780a4960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a90199100 tx=0x7f8a8400b390 comp rx=0 tx=0).stop 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 msgr2=0x7f8a90197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90197c40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8a80000f80 tx=0x7f8a80034670 comp rx=0 tx=0).stop 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 shutdown_connections 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a90102220 0x7f8a9019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a90101860 0x7f8a90198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8a780a24a0 0x7f8a780a4960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 --2- 172.21.15.42:0/666381160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a90100670 0x7f8a90197c40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 >> 172.21.15.42:0/666381160 conn(0x7f8a900fbbe0 msgr2=0x7f8a900fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 shutdown_connections 2024-03-31T23:15:29.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.638+0000 7f8a9618c640 1 -- 172.21.15.42:0/666381160 wait complete. 2024-03-31T23:15:29.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:29.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 -- 172.21.15.42:0/1419910139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec100670 msgr2=0x7f2bec100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/1419910139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec100670 0x7f2bec100a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009900 tx=0x7f2bdc02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 -- 172.21.15.42:0/1419910139 shutdown_connections 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/1419910139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2bec102220 0x7f2bec108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/1419910139 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec101860 0x7f2bec101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/1419910139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec100670 0x7f2bec100a90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 -- 172.21.15.42:0/1419910139 >> 172.21.15.42:0/1419910139 conn(0x7f2bec0fbbe0 msgr2=0x7f2bec0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.756+0000 7f2bf1c15640 1 -- 172.21.15.42:0/1419910139 shutdown_connections 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 -- 172.21.15.42:0/1419910139 wait complete. 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 Processor -- start 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 -- start start 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec100670 0x7f2bec069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2bec101860 0x7f2bec19c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 0x7f2bec19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec10c3d0 con 0x7f2bec102220 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec10c250 con 0x7f2bec100670 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bf1c15640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec10c550 con 0x7f2bec101860 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bebfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 0x7f2bec19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.757+0000 7f2bebfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 0x7f2bec19eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49894/0 (socket says 172.21.15.42:49894) 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 -- 172.21.15.42:0/3866057801 learned_addr learned my addr 172.21.15.42:0/3866057801 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2beaffd640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2bec101860 0x7f2bec19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2beb7fe640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec100670 0x7f2bec069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 -- 172.21.15.42:0/3866057801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2bec101860 msgr2=0x7f2bec19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2bec101860 0x7f2bec19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 -- 172.21.15.42:0/3866057801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec100670 msgr2=0x7f2bec069480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec100670 0x7f2bec069480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 -- 172.21.15.42:0/3866057801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bec19f760 con 0x7f2bec102220 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2beb7fe640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec100670 0x7f2bec069480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bebfff640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 0x7f2bec19eea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2be400eb10 tx=0x7f2be400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4004b20 con 0x7f2bec102220 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2be4004cc0 con 0x7f2bec102220 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bec19fa50 con 0x7f2bec102220 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be40107f0 con 0x7f2bec102220 2024-03-31T23:15:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.758+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bec19ffa0 con 0x7f2bec102220 2024-03-31T23:15:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.759+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bec107990 con 0x7f2bec102220 2024-03-31T23:15:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.760+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f2be4005020 con 0x7f2bec102220 2024-03-31T23:15:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.761+0000 7f2be8ff9640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2bd40a24a0 0x7f2bd40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.761+0000 7f2beb7fe640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2bd40a24a0 0x7f2bd40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.761+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2be40ce850 con 0x7f2bec102220 2024-03-31T23:15:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.762+0000 7f2beb7fe640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2bd40a24a0 0x7f2bd40a4960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc036040 tx=0x7f2bdc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.766+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2be409beb0 con 0x7f2bec102220 2024-03-31T23:15:29.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.953+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bec02d3c0 con 0x7f2bec102220 2024-03-31T23:15:29.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.954+0000 7f2be8ff9640 1 -- 172.21.15.42:0/3866057801 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18394 (secure 0 0 0) 0x7f2be409b7b0 con 0x7f2bec102220 2024-03-31T23:15:29.955 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:29.955 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:14:45.851873+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2bd40a24a0 msgr2=0x7f2bd40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2bd40a24a0 0x7f2bd40a4960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc036040 tx=0x7f2bdc000bc0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 msgr2=0x7f2bec19eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 0x7f2bec19eea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2be400eb10 tx=0x7f2be400c2d0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 shutdown_connections 2024-03-31T23:15:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2bd40a24a0 0x7f2bd40a4960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bec102220 0x7f2bec19eea0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2bec101860 0x7f2bec19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 --2- 172.21.15.42:0/3866057801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bec100670 0x7f2bec069480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 >> 172.21.15.42:0/3866057801 conn(0x7f2bec0fbbe0 msgr2=0x7f2bec104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 shutdown_connections 2024-03-31T23:15:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:29.956+0000 7f2bf1c15640 1 -- 172.21.15.42:0/3866057801 wait complete. 2024-03-31T23:15:29.967 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] up:boot 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: fsmap 12 up:standby 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:15:29.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:29 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/666381160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:29.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T23:15:29.970 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:15:30.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:30.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] up:boot 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: fsmap 12 up:standby 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:15:30.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:29 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/666381160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] up:boot 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: fsmap 12 up:standby 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:15:30.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:29 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/666381160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 -- 172.21.15.42:0/984130990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70100650 msgr2=0x7fda70100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 --2- 172.21.15.42:0/984130990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70100650 0x7fda70100a70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fda68009900 tx=0x7fda6802bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 -- 172.21.15.42:0/984130990 shutdown_connections 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 --2- 172.21.15.42:0/984130990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 0x7fda70108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 --2- 172.21.15.42:0/984130990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda70101840 0x7fda70101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 --2- 172.21.15.42:0/984130990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70100650 0x7fda70100a70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 -- 172.21.15.42:0/984130990 >> 172.21.15.42:0/984130990 conn(0x7fda700fbbe0 msgr2=0x7fda700fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 -- 172.21.15.42:0/984130990 shutdown_connections 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.078+0000 7fda781c9640 1 -- 172.21.15.42:0/984130990 wait complete. 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 Processor -- start 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 -- start start 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda70100650 0x7fda70197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 0x7fda701980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 0x7fda7019f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda7010d4c0 con 0x7fda70101840 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fda7010d340 con 0x7fda70102200 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fda7010d640 con 0x7fda70100650 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 0x7fda701980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 0x7fda701980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49918/0 (socket says 172.21.15.42:49918) 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 -- 172.21.15.42:0/579512174 learned_addr learned my addr 172.21.15.42:0/579512174 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75f65640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda70100650 0x7fda70197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda76766640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 0x7fda7019f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 -- 172.21.15.42:0/579512174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda70100650 msgr2=0x7fda70197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda70100650 0x7fda70197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 -- 172.21.15.42:0/579512174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 msgr2=0x7fda7019f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 0x7fda7019f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 -- 172.21.15.42:0/579512174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7019f780 con 0x7fda70101840 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda76766640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 0x7fda7019f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda75764640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 0x7fda701980a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e9f0 tx=0x7fda6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6400cd80 con 0x7fda70101840 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda64005520 con 0x7fda70101840 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7019fa70 con 0x7fda70101840 2024-03-31T23:15:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.079+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64010690 con 0x7fda70101840 2024-03-31T23:15:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.080+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7019ff70 con 0x7fda70101840 2024-03-31T23:15:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.080+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda70107970 con 0x7fda70101840 2024-03-31T23:15:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.081+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fda640046c0 con 0x7fda70101840 2024-03-31T23:15:30.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.082+0000 7fda6effd640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fda580a24a0 0x7fda580a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.082+0000 7fda75f65640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fda580a24a0 0x7fda580a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.082+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fda640ce740 con 0x7fda70101840 2024-03-31T23:15:30.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.082+0000 7fda75f65640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fda580a24a0 0x7fda580a4960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda68000c00 tx=0x7fda68005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:30.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.086+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fda6409bda0 con 0x7fda70101840 2024-03-31T23:15:30.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.271+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fda7002d390 con 0x7fda70101840 2024-03-31T23:15:30.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.271+0000 7fda6effd640 1 -- 172.21.15.42:0/579512174 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fda6409b6a0 con 0x7fda70101840 2024-03-31T23:15:30.272 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fda580a24a0 msgr2=0x7fda580a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fda580a24a0 0x7fda580a4960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda68000c00 tx=0x7fda68005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 msgr2=0x7fda701980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 0x7fda701980a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e9f0 tx=0x7fda6400edf0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 shutdown_connections 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda70102200 0x7fda7019f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fda580a24a0 0x7fda580a4960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda70101840 0x7fda701980a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 --2- 172.21.15.42:0/579512174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda70100650 0x7fda70197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 >> 172.21.15.42:0/579512174 conn(0x7fda700fbbe0 msgr2=0x7fda70104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 shutdown_connections 2024-03-31T23:15:30.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.274+0000 7fda781c9640 1 -- 172.21.15.42:0/579512174 wait complete. 2024-03-31T23:15:30.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-31T23:15:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 -- 172.21.15.42:0/3672943900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 msgr2=0x7f3b24100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3672943900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b24100a70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009900 tx=0x7f3b1802bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 -- 172.21.15.42:0/3672943900 shutdown_connections 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3672943900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b24102200 0x7f3b24108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3672943900 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b24101840 0x7f3b24101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3672943900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b24100a70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 -- 172.21.15.42:0/3672943900 >> 172.21.15.42:0/3672943900 conn(0x7f3b240fbbc0 msgr2=0x7f3b240fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 -- 172.21.15.42:0/3672943900 shutdown_connections 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.398+0000 7f3b294a4640 1 -- 172.21.15.42:0/3672943900 wait complete. 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 Processor -- start 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 -- start start 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b2406a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b24101840 0x7f3b2419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b24102200 0x7f3b241a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410c3b0 con 0x7f3b24100650 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410c230 con 0x7f3b24101840 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b294a4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410c530 con 0x7f3b24102200 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b2406a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b2406a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49938/0 (socket says 172.21.15.42:49938) 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 -- 172.21.15.42:0/3547907909 learned_addr learned my addr 172.21.15.42:0/3547907909 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b237fe640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b24102200 0x7f3b241a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b227fc640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b24101840 0x7f3b2419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 -- 172.21.15.42:0/3547907909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b24102200 msgr2=0x7f3b241a11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b24102200 0x7f3b241a11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 -- 172.21.15.42:0/3547907909 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b24101840 msgr2=0x7f3b2419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b24101840 0x7f3b2419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.399+0000 7f3b22ffd640 1 -- 172.21.15.42:0/3547907909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b241a19a0 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.400+0000 7f3b22ffd640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b2406a9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b18000c00 tx=0x7f3b1802c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.400+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18043020 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.400+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b241a1bd0 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.400+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3b180042d0 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.400+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18003cc0 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.400+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b241a2170 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.401+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b24107970 con 0x7f3b24100650 2024-03-31T23:15:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.402+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f3b18046020 con 0x7f3b24100650 2024-03-31T23:15:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.403+0000 7f3b0bfff640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3b0c0a24d0 0x7f3b0c0a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.403+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3b180f0750 con 0x7f3b24100650 2024-03-31T23:15:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.404+0000 7f3b227fc640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3b0c0a24d0 0x7f3b0c0a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.404+0000 7f3b227fc640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3b0c0a24d0 0x7f3b0c0a4990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b2406a710 tx=0x7f3b1400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.408+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3b1804d020 con 0x7f3b24100650 2024-03-31T23:15:30.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.605+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3b2402d3c0 con 0x7f3b24100650 2024-03-31T23:15:30.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.606+0000 7f3b0bfff640 1 -- 172.21.15.42:0/3547907909 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f3b180bde40 con 0x7f3b24100650 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:15:30.607 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-03-31T23:15:30.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3b0c0a24d0 msgr2=0x7f3b0c0a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3b0c0a24d0 0x7f3b0c0a4990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b2406a710 tx=0x7f3b1400b390 comp rx=0 tx=0).stop 2024-03-31T23:15:30.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 msgr2=0x7f3b2406a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b2406a9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b18000c00 tx=0x7f3b1802c710 comp rx=0 tx=0).stop 2024-03-31T23:15:30.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 shutdown_connections 2024-03-31T23:15:30.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b24102200 0x7f3b241a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b24101840 0x7f3b2419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3b0c0a24d0 0x7f3b0c0a4990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 --2- 172.21.15.42:0/3547907909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24100650 0x7f3b2406a9a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 >> 172.21.15.42:0/3547907909 conn(0x7f3b240fbbc0 msgr2=0x7f3b24104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 shutdown_connections 2024-03-31T23:15:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.608+0000 7f3b294a4640 1 -- 172.21.15.42:0/3547907909 wait complete. 2024-03-31T23:15:30.620 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-31T23:15:30.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-31T23:15:30.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 -- 172.21.15.42:0/121092841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 msgr2=0x7f6bec109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 --2- 172.21.15.42:0/121092841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec109d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009ca0 tx=0x7f6be402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 -- 172.21.15.42:0/121092841 shutdown_connections 2024-03-31T23:15:30.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 --2- 172.21.15.42:0/121092841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec109d60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 --2- 172.21.15.42:0/121092841 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0ff7f0 0x7f6bec0ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 --2- 172.21.15.42:0/121092841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bec102d80 0x7f6bec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 -- 172.21.15.42:0/121092841 >> 172.21.15.42:0/121092841 conn(0x7f6bec0fb350 msgr2=0x7f6bec0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.734+0000 7f6bf444e640 1 -- 172.21.15.42:0/121092841 shutdown_connections 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 -- 172.21.15.42:0/121092841 wait complete. 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 Processor -- start 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 -- start start 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bec0ff7f0 0x7f6bec197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec102d80 0x7f6bec19f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec10d580 con 0x7f6bec1001b0 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec10d400 con 0x7f6bec0ff7f0 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf444e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec10d700 con 0x7f6bec102d80 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf19e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf19e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49962/0 (socket says 172.21.15.42:49962) 2024-03-31T23:15:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf19e9640 1 -- 172.21.15.42:0/953454773 learned_addr learned my addr 172.21.15.42:0/953454773 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf29eb640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec102d80 0x7f6bec19f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.735+0000 7f6bf21ea640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bec0ff7f0 0x7f6bec197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf19e9640 1 -- 172.21.15.42:0/953454773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec102d80 msgr2=0x7f6bec19f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf19e9640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec102d80 0x7f6bec19f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf19e9640 1 -- 172.21.15.42:0/953454773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bec0ff7f0 msgr2=0x7f6bec197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf19e9640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bec0ff7f0 0x7f6bec197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf19e9640 1 -- 172.21.15.42:0/953454773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec19f6f0 con 0x7f6bec1001b0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf19e9640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec198010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6be800e9f0 tx=0x7f6be800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be800cd80 con 0x7f6bec1001b0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec19f9e0 con 0x7f6bec1001b0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6be8005520 con 0x7f6bec1001b0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8010690 con 0x7f6bec1001b0 2024-03-31T23:15:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.736+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec19fee0 con 0x7f6bec1001b0 2024-03-31T23:15:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.737+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec108b70 con 0x7f6bec1001b0 2024-03-31T23:15:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.738+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f6be80046c0 con 0x7f6bec1001b0 2024-03-31T23:15:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.739+0000 7f6bdf7fe640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6bd80a24a0 0x7f6bd80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.739+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6be80ce8a0 con 0x7f6bec1001b0 2024-03-31T23:15:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.739+0000 7f6bf21ea640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6bd80a24a0 0x7f6bd80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.739+0000 7f6bf21ea640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6bd80a24a0 0x7f6bd80a4960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bec069a60 tx=0x7f6be000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:30.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.742+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6be8053280 con 0x7f6bec1001b0 2024-03-31T23:15:30.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:30.927+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6bec02d3c0 con 0x7f6bec1001b0 2024-03-31T23:15:31.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3866057801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/579512174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3547907909' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:30 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3866057801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/579512174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3547907909' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:30 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3866057801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/579512174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3547907909' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:30 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:31.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.812+0000 7f6bdf7fe640 1 -- 172.21.15.42:0/953454773 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f6be809bf00 con 0x7f6bec1001b0 2024-03-31T23:15:31.813 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-03-31T23:15:31.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6bd80a24a0 msgr2=0x7f6bd80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6bd80a24a0 0x7f6bd80a4960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bec069a60 tx=0x7f6be000b390 comp rx=0 tx=0).stop 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 msgr2=0x7f6bec198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec198010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6be800e9f0 tx=0x7f6be800edf0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 shutdown_connections 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec102d80 0x7f6bec19f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6bd80a24a0 0x7f6bd80a4960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bec1001b0 0x7f6bec198010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 --2- 172.21.15.42:0/953454773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bec0ff7f0 0x7f6bec197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 >> 172.21.15.42:0/953454773 conn(0x7f6bec0fb350 msgr2=0x7f6bec105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 shutdown_connections 2024-03-31T23:15:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.815+0000 7f6bf444e640 1 -- 172.21.15.42:0/953454773 wait complete. 2024-03-31T23:15:31.831 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-31T23:15:31.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/702516762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64100690 msgr2=0x7fcf64100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/702516762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64100690 0x7fcf64100ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009900 tx=0x7fcf6002bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/702516762 shutdown_connections 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/702516762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64102240 0x7fcf64108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/702516762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64101880 0x7fcf64101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/702516762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64100690 0x7fcf64100ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/702516762 >> 172.21.15.42:0/702516762 conn(0x7fcf640fbc00 msgr2=0x7fcf640fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/702516762 shutdown_connections 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/702516762 wait complete. 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 Processor -- start 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.953+0000 7fcf6b7c2640 1 -- start start 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6b7c2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64100690 0x7fcf64199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6b7c2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 0x7fcf6419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6b7c2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 0x7fcf641a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6b7c2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6410c3e0 con 0x7fcf64102240 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6b7c2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6410c260 con 0x7fcf64100690 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6b7c2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6410c560 con 0x7fcf64101880 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf69d5f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 0x7fcf641a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 0x7fcf6419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6955e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64100690 0x7fcf64199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 0x7fcf6419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38370/0 (socket says 172.21.15.42:38370) 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf69d5f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 0x7fcf641a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49984/0 (socket says 172.21.15.42:49984) 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 -- 172.21.15.42:0/3741707343 learned_addr learned my addr 172.21.15.42:0/3741707343 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 -- 172.21.15.42:0/3741707343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64100690 msgr2=0x7fcf64199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64100690 0x7fcf64199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 -- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 msgr2=0x7fcf641a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 0x7fcf641a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 -- 172.21.15.42:0/3741707343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf641a1a50 con 0x7fcf64101880 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf69d5f640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 0x7fcf641a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf6955e640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64100690 0x7fcf64199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf68d5d640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 0x7fcf6419a3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e9f0 tx=0x7fcf5400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.954+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400cd80 con 0x7fcf64101880 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.955+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf641a1d40 con 0x7fcf64101880 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.955+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcf54010930 con 0x7fcf64101880 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.955+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54018b00 con 0x7fcf64101880 2024-03-31T23:15:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.955+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf641a2280 con 0x7fcf64101880 2024-03-31T23:15:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.956+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf641a24b0 con 0x7fcf64101880 2024-03-31T23:15:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.958+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fcf54018ca0 con 0x7fcf64101880 2024-03-31T23:15:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.958+0000 7fcf5a7fc640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf500a24a0 0x7fcf500a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.958+0000 7fcf6955e640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf500a24a0 0x7fcf500a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.958+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7fcf540ce8a0 con 0x7fcf64101880 2024-03-31T23:15:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.959+0000 7fcf6955e640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf500a24a0 0x7fcf500a4960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf60005ab0 tx=0x7fcf60005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:31.963+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcf5409b740 con 0x7fcf64101880 2024-03-31T23:15:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:31 smithi042 ceph-mon[32380]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:31 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/953454773' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-31T23:15:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:15:32.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:32.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:31 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:15:32.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.158+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fcf641a2680 con 0x7fcf64101880 2024-03-31T23:15:32.160 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:31 smithi094 ceph-mon[36167]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:32.160 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:31 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/953454773' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-31T23:15:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:15:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:31 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:15:32.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:31 smithi188 ceph-mon[36068]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:32.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:31 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/953454773' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-31T23:15:32.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:32.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:15:32.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:32.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:31 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:15:32.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.824+0000 7fcf5a7fc640 1 -- 172.21.15.42:0/3741707343 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7fcf5409f7e0 con 0x7fcf64101880 2024-03-31T23:15:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-03-31T23:15:32.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf500a24a0 msgr2=0x7fcf500a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:32.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf500a24a0 0x7fcf500a4960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf60005ab0 tx=0x7fcf60005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 msgr2=0x7fcf6419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:32.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 0x7fcf6419a3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e9f0 tx=0x7fcf5400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 shutdown_connections 2024-03-31T23:15:32.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf500a24a0 0x7fcf500a4960 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf60005ab0 tx=0x7fcf60005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf64102240 0x7fcf641a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf64101880 0x7fcf6419a3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 --2- 172.21.15.42:0/3741707343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf64100690 0x7fcf64199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.838+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 >> 172.21.15.42:0/3741707343 conn(0x7fcf640fbc00 msgr2=0x7fcf64069a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:32.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.839+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 shutdown_connections 2024-03-31T23:15:32.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.839+0000 7fcf6b7c2640 1 -- 172.21.15.42:0/3741707343 wait complete. 2024-03-31T23:15:32.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:32 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/953454773' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-31T23:15:32.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:32 smithi042 ceph-mon[32380]: osdmap e82: 12 total, 12 up, 12 in 2024-03-31T23:15:32.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:32 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3741707343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-31T23:15:32.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:32 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-31T23:15:32.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-31T23:15:32.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 -- 172.21.15.42:0/256942600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c101840 msgr2=0x7f1d6c101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 --2- 172.21.15.42:0/256942600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c101840 0x7f1d6c101cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009900 tx=0x7f1d5402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 -- 172.21.15.42:0/256942600 shutdown_connections 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 --2- 172.21.15.42:0/256942600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d6c102200 0x7f1d6c108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 --2- 172.21.15.42:0/256942600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c101840 0x7f1d6c101cc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 --2- 172.21.15.42:0/256942600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d6c100650 0x7f1d6c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 -- 172.21.15.42:0/256942600 >> 172.21.15.42:0/256942600 conn(0x7f1d6c0fbbe0 msgr2=0x7f1d6c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 -- 172.21.15.42:0/256942600 shutdown_connections 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 -- 172.21.15.42:0/256942600 wait complete. 2024-03-31T23:15:32.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 Processor -- start 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 -- start start 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.967+0000 7f1d71623640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 0x7f1d6c199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d6c101840 0x7f1d6c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d6c102200 0x7f1d6c1a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c10c3b0 con 0x7f1d6c100650 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c10c230 con 0x7f1d6c102200 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c10c530 con 0x7f1d6c101840 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 0x7f1d6c199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 0x7f1d6c199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50002/0 (socket says 172.21.15.42:50002) 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 -- 172.21.15.42:0/2653775167 learned_addr learned my addr 172.21.15.42:0/2653775167 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6b7fe640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d6c102200 0x7f1d6c1a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d63fff640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d6c101840 0x7f1d6c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:32.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 -- 172.21.15.42:0/2653775167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d6c101840 msgr2=0x7f1d6c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d6c101840 0x7f1d6c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 -- 172.21.15.42:0/2653775167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d6c102200 msgr2=0x7f1d6c1a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d6c102200 0x7f1d6c1a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 -- 172.21.15.42:0/2653775167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c1a1950 con 0x7f1d6c100650 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d6affd640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 0x7f1d6c199d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00e9c0 tx=0x7f1d5c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00cd80 con 0x7f1d6c100650 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c1a1c40 con 0x7f1d6c100650 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d5c0035f0 con 0x7f1d6c100650 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c010690 con 0x7f1d6c100650 2024-03-31T23:15:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.968+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6c1a2190 con 0x7f1d6c100650 2024-03-31T23:15:32.973 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:32 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/953454773' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-31T23:15:32.973 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:32 smithi188 ceph-mon[36068]: osdmap e82: 12 total, 12 up, 12 in 2024-03-31T23:15:32.973 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:32 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3741707343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-31T23:15:32.973 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:32 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-31T23:15:32.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.969+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c1a23c0 con 0x7f1d6c100650 2024-03-31T23:15:32.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.971+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f1d5c0037a0 con 0x7f1d6c100650 2024-03-31T23:15:32.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.972+0000 7f1d68ff9640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d580a24a0 0x7f1d580a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:32.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.972+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f1d5c0cea90 con 0x7f1d6c100650 2024-03-31T23:15:32.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.972+0000 7f1d63fff640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d580a24a0 0x7f1d580a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:32.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.972+0000 7f1d63fff640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d580a24a0 0x7f1d580a4960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d54000c00 tx=0x7f1d54005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:32.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:32.976+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1d5c09be00 con 0x7f1d6c100650 2024-03-31T23:15:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:32 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/953454773' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-31T23:15:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:32 smithi094 ceph-mon[36167]: osdmap e82: 12 total, 12 up, 12 in 2024-03-31T23:15:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:32 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3741707343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-31T23:15:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:32 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-31T23:15:33.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:33.210+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1d6c1a2590 con 0x7f1d6c100650 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: pgmap v278: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: osdmap e83: 12 total, 12 up, 12 in 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:34.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:15:34.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2653775167' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-31T23:15:34.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:33 smithi042 ceph-mon[32380]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-31T23:15:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.131+0000 7f1d68ff9640 1 -- 172.21.15.42:0/2653775167 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1d5c086110 con 0x7f1d6c100650 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d580a24a0 msgr2=0x7f1d580a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d580a24a0 0x7f1d580a4960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d54000c00 tx=0x7f1d54005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 msgr2=0x7f1d6c199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 0x7f1d6c199d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00e9c0 tx=0x7f1d5c00ee80 comp rx=0 tx=0).stop 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 shutdown_connections 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d6c102200 0x7f1d6c1a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d6c101840 0x7f1d6c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d580a24a0 0x7f1d580a4960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 --2- 172.21.15.42:0/2653775167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d6c100650 0x7f1d6c199d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.134+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 >> 172.21.15.42:0/2653775167 conn(0x7f1d6c0fbbe0 msgr2=0x7f1d6c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.135+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 shutdown_connections 2024-03-31T23:15:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.135+0000 7f1d71623640 1 -- 172.21.15.42:0/2653775167 wait complete. 2024-03-31T23:15:34.152 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-31T23:15:34.152 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: pgmap v278: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: osdmap e83: 12 total, 12 up, 12 in 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2653775167' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-31T23:15:34.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:33 smithi094 ceph-mon[36167]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-31T23:15:34.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: pgmap v278: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:15:34.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-31T23:15:34.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: osdmap e83: 12 total, 12 up, 12 in 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2653775167' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-31T23:15:34.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:33 smithi188 ceph-mon[36068]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 -- 172.21.15.42:0/2238580323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844101c00 msgr2=0x7f6844102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 --2- 172.21.15.42:0/2238580323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844101c00 0x7f6844102020 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6834009900 tx=0x7f683402de40 comp rx=0 tx=0).stop 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 -- 172.21.15.42:0/2238580323 shutdown_connections 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 --2- 172.21.15.42:0/2238580323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68441012f0 0x7f6844108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 --2- 172.21.15.42:0/2238580323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6844100930 0x7f6844100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 --2- 172.21.15.42:0/2238580323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844101c00 0x7f6844102020 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 -- 172.21.15.42:0/2238580323 >> 172.21.15.42:0/2238580323 conn(0x7f68440fb360 msgr2=0x7f68440fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 -- 172.21.15.42:0/2238580323 shutdown_connections 2024-03-31T23:15:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 -- 172.21.15.42:0/2238580323 wait complete. 2024-03-31T23:15:34.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.270+0000 7f6849a49640 1 Processor -- start 2024-03-31T23:15:34.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 -- start start 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 0x7f6844195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68441012f0 0x7f6844195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6844101c00 0x7f684419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f684410b330 con 0x7f6844100930 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f684410b1b0 con 0x7f68441012f0 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6849a49640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f684410b4b0 con 0x7f6844101c00 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 0x7f6844195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 0x7f6844195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36922/0 (socket says 172.21.15.42:36922) 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 -- 172.21.15.42:0/3621182745 learned_addr learned my addr 172.21.15.42:0/3621182745 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f68437fe640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6844101c00 0x7f684419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 -- 172.21.15.42:0/3621182745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6844101c00 msgr2=0x7f684419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6844101c00 0x7f684419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f68427fc640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68441012f0 0x7f6844195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 -- 172.21.15.42:0/3621182745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68441012f0 msgr2=0x7f6844195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68441012f0 0x7f6844195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 -- 172.21.15.42:0/3621182745 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684419d5a0 con 0x7f6844100930 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6842ffd640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 0x7f6844195980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6834000c00 tx=0x7f6834004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.271+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834045020 con 0x7f6844100930 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.272+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684419d830 con 0x7f6844100930 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.272+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6834036c00 con 0x7f6844100930 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.272+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834004c70 con 0x7f6844100930 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.272+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684419ddd0 con 0x7f6844100930 2024-03-31T23:15:34.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.272+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6844107a70 con 0x7f6844100930 2024-03-31T23:15:34.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.274+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f6834048020 con 0x7f6844100930 2024-03-31T23:15:34.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.274+0000 7f6848a47640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f682c0a24a0 0x7f682c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.274+0000 7f68427fc640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f682c0a24a0 0x7f682c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.275+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f68340f3720 con 0x7f6844100930 2024-03-31T23:15:34.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.275+0000 7f68427fc640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f682c0a24a0 0x7f682c0a4960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6838005fd0 tx=0x7f6838005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:34.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.279+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f683404f020 con 0x7f6844100930 2024-03-31T23:15:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.470+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f684402d170 con 0x7f6844100930 2024-03-31T23:15:34.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.825+0000 7f6848a47640 1 -- 172.21.15.42:0/3621182745 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f68340c0a30 con 0x7f6844100930 2024-03-31T23:15:34.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f682c0a24a0 msgr2=0x7f682c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f682c0a24a0 0x7f682c0a4960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6838005fd0 tx=0x7f6838005c70 comp rx=0 tx=0).stop 2024-03-31T23:15:34.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 msgr2=0x7f6844195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 0x7f6844195980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6834000c00 tx=0x7f6834004270 comp rx=0 tx=0).stop 2024-03-31T23:15:34.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 shutdown_connections 2024-03-31T23:15:34.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6844101c00 0x7f684419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68441012f0 0x7f6844195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f682c0a24a0 0x7f682c0a4960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 --2- 172.21.15.42:0/3621182745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6844100930 0x7f6844195980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 >> 172.21.15.42:0/3621182745 conn(0x7f68440fb360 msgr2=0x7f6844104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:34.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 shutdown_connections 2024-03-31T23:15:34.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.828+0000 7f6849a49640 1 -- 172.21.15.42:0/3621182745 wait complete. 2024-03-31T23:15:34.841 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-31T23:15:34.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 -- 172.21.15.42:0/4144562657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341006f0 msgr2=0x7f6e34100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 --2- 172.21.15.42:0/4144562657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341006f0 0x7f6e34100b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009900 tx=0x7f6e3002bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:34.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 -- 172.21.15.42:0/4144562657 shutdown_connections 2024-03-31T23:15:34.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 --2- 172.21.15.42:0/4144562657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e341022a0 0x7f6e34108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 --2- 172.21.15.42:0/4144562657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 0x7f6e34101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 --2- 172.21.15.42:0/4144562657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341006f0 0x7f6e34100b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 -- 172.21.15.42:0/4144562657 >> 172.21.15.42:0/4144562657 conn(0x7f6e340fbc60 msgr2=0x7f6e340fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 -- 172.21.15.42:0/4144562657 shutdown_connections 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 -- 172.21.15.42:0/4144562657 wait complete. 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 Processor -- start 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.955+0000 7f6e3b615640 1 -- start start 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e341006f0 0x7f6e34197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 0x7f6e341980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 0x7f6e3419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3410d4d0 con 0x7f6e341022a0 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3410d350 con 0x7f6e341018e0 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3410d650 con 0x7f6e341006f0 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 0x7f6e3419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 0x7f6e3419f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36928/0 (socket says 172.21.15.42:36928) 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 -- 172.21.15.42:0/3720996716 learned_addr learned my addr 172.21.15.42:0/3720996716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e393b1640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e341006f0 0x7f6e34197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e38bb0640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 0x7f6e341980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 -- 172.21.15.42:0/3720996716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e341006f0 msgr2=0x7f6e34197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e341006f0 0x7f6e34197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 -- 172.21.15.42:0/3720996716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 msgr2=0x7f6e341980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 0x7f6e341980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 -- 172.21.15.42:0/3720996716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3419f790 con 0x7f6e341022a0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e38bb0640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 0x7f6e341980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e39bb2640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 0x7f6e3419f120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00cad0 tx=0x7f6e2c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00ae20 con 0x7f6e341022a0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e2c004b20 con 0x7f6e341022a0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3419fa80 con 0x7f6e341022a0 2024-03-31T23:15:34.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00f780 con 0x7f6e341022a0 2024-03-31T23:15:34.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.956+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3419ffd0 con 0x7f6e341022a0 2024-03-31T23:15:34.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.957+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e34107a10 con 0x7f6e341022a0 2024-03-31T23:15:34.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.958+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f6e2c004cd0 con 0x7f6e341022a0 2024-03-31T23:15:34.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.959+0000 7f6e2a7fc640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e200a2520 0x7f6e200a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:34.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.959+0000 7f6e393b1640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e200a2520 0x7f6e200a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:34.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.959+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f6e2c0ce720 con 0x7f6e341022a0 2024-03-31T23:15:34.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.960+0000 7f6e393b1640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e200a2520 0x7f6e200a49e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e30005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:34.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:34.963+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6e2c014030 con 0x7f6e341022a0 2024-03-31T23:15:35.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:34 smithi042 ceph-mon[32380]: osdmap e84: 12 total, 12 up, 12 in 2024-03-31T23:15:35.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:34 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2653775167' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-31T23:15:35.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:34 smithi042 ceph-mon[32380]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-31T23:15:35.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:34 smithi042 ceph-mon[32380]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-31T23:15:35.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:34 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3621182745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-03-31T23:15:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:35.146+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6e34062350 con 0x7f6e341022a0 2024-03-31T23:15:35.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:34 smithi094 ceph-mon[36167]: osdmap e84: 12 total, 12 up, 12 in 2024-03-31T23:15:35.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:34 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2653775167' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-31T23:15:35.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:34 smithi094 ceph-mon[36167]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-31T23:15:35.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:34 smithi094 ceph-mon[36167]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-31T23:15:35.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:34 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3621182745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-03-31T23:15:35.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:34 smithi188 ceph-mon[36068]: osdmap e84: 12 total, 12 up, 12 in 2024-03-31T23:15:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:34 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2653775167' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-31T23:15:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:34 smithi188 ceph-mon[36068]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-31T23:15:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:34 smithi188 ceph-mon[36068]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-31T23:15:35.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:34 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3621182745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: pgmap v281: 97 pgs: 43 creating+peering, 14 unknown, 40 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3621182745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: osdmap e85: 12 total, 12 up, 12 in 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: Cluster is now healthy 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] up:active 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:35 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3720996716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-31T23:15:36.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: pgmap v281: 97 pgs: 43 creating+peering, 14 unknown, 40 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3621182745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: osdmap e85: 12 total, 12 up, 12 in 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: Cluster is now healthy 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] up:active 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:36.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:35 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3720996716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-31T23:15:36.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: pgmap v281: 97 pgs: 43 creating+peering, 14 unknown, 40 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-03-31T23:15:36.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3621182745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: osdmap e85: 12 total, 12 up, 12 in 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: Cluster is now healthy 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] up:active 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:36.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:35 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3720996716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-31T23:15:37.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.148+0000 7f6e2a7fc640 1 -- 172.21.15.42:0/3720996716 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7f6e2c09b8b0 con 0x7f6e341022a0 2024-03-31T23:15:37.149 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data_ec' created 2024-03-31T23:15:37.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e200a2520 msgr2=0x7f6e200a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:37.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e200a2520 0x7f6e200a49e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e30005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 msgr2=0x7f6e3419f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 0x7f6e3419f120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00cad0 tx=0x7f6e2c00cf90 comp rx=0 tx=0).stop 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 shutdown_connections 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e200a2520 0x7f6e200a49e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e341022a0 0x7f6e3419f120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e341018e0 0x7f6e341980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 --2- 172.21.15.42:0/3720996716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e341006f0 0x7f6e34197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.151+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 >> 172.21.15.42:0/3720996716 conn(0x7f6e340fbc60 msgr2=0x7f6e34104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.152+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 shutdown_connections 2024-03-31T23:15:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.152+0000 7f6e3b615640 1 -- 172.21.15.42:0/3720996716 wait complete. 2024-03-31T23:15:37.171 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-31T23:15:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 -- 172.21.15.42:0/3904784353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374107490 msgr2=0x7fe374109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 --2- 172.21.15.42:0/3904784353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374107490 0x7fe374109880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe364009ca0 tx=0x7fe36402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 -- 172.21.15.42:0/3904784353 shutdown_connections 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 --2- 172.21.15.42:0/3904784353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374107490 0x7fe374109880 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 --2- 172.21.15.42:0/3904784353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe374104b60 0x7fe374106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 --2- 172.21.15.42:0/3904784353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe374102230 0x7fe374104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 -- 172.21.15.42:0/3904784353 >> 172.21.15.42:0/3904784353 conn(0x7fe3740fbbe0 msgr2=0x7fe3740fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 -- 172.21.15.42:0/3904784353 shutdown_connections 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.282+0000 7fe379623640 1 -- 172.21.15.42:0/3904784353 wait complete. 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 Processor -- start 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 -- start start 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 0x7fe374197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe374104b60 0x7fe374198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe374107490 0x7fe37419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe37410d500 con 0x7fe374102230 2024-03-31T23:15:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe37410d380 con 0x7fe374104b60 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe379623640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe37410d680 con 0x7fe374107490 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe372ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 0x7fe374197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe372ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 0x7fe374197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36948/0 (socket says 172.21.15.42:36948) 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe372ffd640 1 -- 172.21.15.42:0/275453595 learned_addr learned my addr 172.21.15.42:0/275453595 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.283+0000 7fe3727fc640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe374104b60 0x7fe374198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe3737fe640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe374107490 0x7fe37419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe372ffd640 1 -- 172.21.15.42:0/275453595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe374107490 msgr2=0x7fe37419f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe372ffd640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe374107490 0x7fe37419f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe372ffd640 1 -- 172.21.15.42:0/275453595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe374104b60 msgr2=0x7fe374198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe372ffd640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe374104b60 0x7fe374198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe372ffd640 1 -- 172.21.15.42:0/275453595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37419f730 con 0x7fe374102230 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe372ffd640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 0x7fe374197b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e9f0 tx=0x7fe36c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00cd80 con 0x7fe374102230 2024-03-31T23:15:37.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe36c010930 con 0x7fe374102230 2024-03-31T23:15:37.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37419fa20 con 0x7fe374102230 2024-03-31T23:15:37.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c018b00 con 0x7fe374102230 2024-03-31T23:15:37.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.284+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37419ff70 con 0x7fe374102230 2024-03-31T23:15:37.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.285+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374068540 con 0x7fe374102230 2024-03-31T23:15:37.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.286+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fe36c018ca0 con 0x7fe374102230 2024-03-31T23:15:37.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.287+0000 7fe36bfff640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe3600a24a0 0x7fe3600a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:37.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.287+0000 7fe3727fc640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe3600a24a0 0x7fe3600a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:37.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.287+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7fe36c0cf0b0 con 0x7fe374102230 2024-03-31T23:15:37.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.287+0000 7fe3727fc640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe3600a24a0 0x7fe3600a4960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe374199020 tx=0x7fe35c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:37.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.291+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe36c09b9a0 con 0x7fe374102230 2024-03-31T23:15:37.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:37 smithi094 ceph-mon[36167]: osdmap e86: 12 total, 12 up, 12 in 2024-03-31T23:15:37.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:37 smithi188 ceph-mon[36068]: osdmap e86: 12 total, 12 up, 12 in 2024-03-31T23:15:37.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:37.472+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe3740fd6d0 con 0x7fe374102230 2024-03-31T23:15:37.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:37 smithi042 ceph-mon[32380]: osdmap e86: 12 total, 12 up, 12 in 2024-03-31T23:15:38.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.149+0000 7fe36bfff640 1 -- 172.21.15.42:0/275453595 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7fe36c09fa40 con 0x7fe374102230 2024-03-31T23:15:38.150 INFO:teuthology.orchestra.run.smithi042.stderr:set pool 4 allow_ec_overwrites to true 2024-03-31T23:15:38.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe3600a24a0 msgr2=0x7fe3600a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:38.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe3600a24a0 0x7fe3600a4960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe374199020 tx=0x7fe35c005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:38.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 msgr2=0x7fe374197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:38.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 0x7fe374197b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e9f0 tx=0x7fe36c00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 shutdown_connections 2024-03-31T23:15:38.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe374107490 0x7fe37419f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe374104b60 0x7fe374198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe3600a24a0 0x7fe3600a4960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 --2- 172.21.15.42:0/275453595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe374102230 0x7fe374197b10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.153+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 >> 172.21.15.42:0/275453595 conn(0x7fe3740fbbe0 msgr2=0x7fe374102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:38.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.154+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 shutdown_connections 2024-03-31T23:15:38.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.154+0000 7fe379623640 1 -- 172.21.15.42:0/275453595 wait complete. 2024-03-31T23:15:38.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-31T23:15:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 -- 172.21.15.42:0/3954105101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 msgr2=0x7f0464101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 --2- 172.21.15.42:0/3954105101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464101ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f044c009900 tx=0x7f044c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 -- 172.21.15.42:0/3954105101 shutdown_connections 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 --2- 172.21.15.42:0/3954105101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0464102220 0x7f0464108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 --2- 172.21.15.42:0/3954105101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464101ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 --2- 172.21.15.42:0/3954105101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464100670 0x7f0464100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 -- 172.21.15.42:0/3954105101 >> 172.21.15.42:0/3954105101 conn(0x7f04640fbbe0 msgr2=0x7f04640fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 -- 172.21.15.42:0/3954105101 shutdown_connections 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.287+0000 7f046986b640 1 -- 172.21.15.42:0/3954105101 wait complete. 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 Processor -- start 2024-03-31T23:15:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 -- start start 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464100670 0x7f0464197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0464102220 0x7f046419f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f046410c3d0 con 0x7f0464101860 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f046410c250 con 0x7f0464102220 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f046986b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f046410c550 con 0x7f0464100670 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f045a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f045a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36972/0 (socket says 172.21.15.42:36972) 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f045a7fc640 1 -- 172.21.15.42:0/2840946397 learned_addr learned my addr 172.21.15.42:0/2840946397 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.288+0000 7f04637fe640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0464102220 0x7f046419f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f0462ffd640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464100670 0x7f0464197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f045a7fc640 1 -- 172.21.15.42:0/2840946397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464100670 msgr2=0x7f0464197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f045a7fc640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464100670 0x7f0464197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f045a7fc640 1 -- 172.21.15.42:0/2840946397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0464102220 msgr2=0x7f046419f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f045a7fc640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0464102220 0x7f046419f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f045a7fc640 1 -- 172.21.15.42:0/2840946397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046419f800 con 0x7f0464101860 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f045a7fc640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464198170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f044c006010 tx=0x7f044c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c043020 con 0x7f0464101860 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f044c004250 con 0x7f0464101860 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046419fa90 con 0x7f0464101860 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0039e0 con 0x7f0464101860 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.289+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046419ffe0 con 0x7f0464101860 2024-03-31T23:15:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.290+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04641a01b0 con 0x7f0464101860 2024-03-31T23:15:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.292+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f044c046020 con 0x7f0464101860 2024-03-31T23:15:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.292+0000 7f0468869640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f04500a24a0 0x7f04500a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.292+0000 7f0462ffd640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f04500a24a0 0x7f04500a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.292+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f044c0f11f0 con 0x7f0464101860 2024-03-31T23:15:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.293+0000 7f0462ffd640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f04500a24a0 0x7f04500a4960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0454005d00 tx=0x7f0454005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:38.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.296+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f044c04d020 con 0x7f0464101860 2024-03-31T23:15:38.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:38 smithi094 ceph-mon[36167]: pgmap v284: 97 pgs: 43 creating+peering, 54 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-03-31T23:15:38.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:38 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3720996716' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-31T23:15:38.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:38 smithi094 ceph-mon[36167]: osdmap e87: 12 total, 12 up, 12 in 2024-03-31T23:15:38.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:38 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/275453595' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-03-31T23:15:38.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:38 smithi188 ceph-mon[36068]: pgmap v284: 97 pgs: 43 creating+peering, 54 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-03-31T23:15:38.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:38 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3720996716' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-31T23:15:38.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:38 smithi188 ceph-mon[36068]: osdmap e87: 12 total, 12 up, 12 in 2024-03-31T23:15:38.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:38 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/275453595' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-03-31T23:15:38.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:38.519+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f04641a0380 con 0x7f0464101860 2024-03-31T23:15:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:38 smithi042 ceph-mon[32380]: pgmap v284: 97 pgs: 43 creating+peering, 54 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-03-31T23:15:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:38 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3720996716' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-31T23:15:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:38 smithi042 ceph-mon[32380]: osdmap e87: 12 total, 12 up, 12 in 2024-03-31T23:15:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:38 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/275453595' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-03-31T23:15:39.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.169+0000 7f0468869640 1 -- 172.21.15.42:0/2840946397 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f044c0be190 con 0x7f0464101860 2024-03-31T23:15:39.170 INFO:teuthology.orchestra.run.smithi042.stderr:added data pool 4 to fsmap 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f04500a24a0 msgr2=0x7f04500a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f04500a24a0 0x7f04500a4960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0454005d00 tx=0x7f0454005c50 comp rx=0 tx=0).stop 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 msgr2=0x7f0464198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464198170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f044c006010 tx=0x7f044c004ab0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 shutdown_connections 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0464102220 0x7f046419f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f04500a24a0 0x7f04500a4960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464101860 0x7f0464198170 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 --2- 172.21.15.42:0/2840946397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464100670 0x7f0464197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 >> 172.21.15.42:0/2840946397 conn(0x7f04640fbbe0 msgr2=0x7f0464069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:39.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 shutdown_connections 2024-03-31T23:15:39.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.172+0000 7f046986b640 1 -- 172.21.15.42:0/2840946397 wait complete. 2024-03-31T23:15:39.186 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:39.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.294+0000 7f8edd1dd640 1 -- 172.21.15.42:0/4002307848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8102220 msgr2=0x7f8ed8108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.294+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/4002307848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8102220 0x7f8ed8108ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009be0 tx=0x7f8ec802bef0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 -- 172.21.15.42:0/4002307848 shutdown_connections 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/4002307848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8102220 0x7f8ed8108ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/4002307848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed8101860 0x7f8ed8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/4002307848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 -- 172.21.15.42:0/4002307848 >> 172.21.15.42:0/4002307848 conn(0x7f8ed80fbbe0 msgr2=0x7f8ed80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 -- 172.21.15.42:0/4002307848 shutdown_connections 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 -- 172.21.15.42:0/4002307848 wait complete. 2024-03-31T23:15:39.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 Processor -- start 2024-03-31T23:15:39.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.295+0000 7f8edd1dd640 1 -- start start 2024-03-31T23:15:39.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 0x7f8ed8198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed8102220 0x7f8ed819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed810c420 con 0x7f8ed8100670 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed810c2a0 con 0x7f8ed8101860 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed810c5a0 con 0x7f8ed8102220 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 0x7f8ed8198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed6d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 0x7f8ed8198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:45426/0 (socket says 172.21.15.42:45426) 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 -- 172.21.15.42:0/1599733811 learned_addr learned my addr 172.21.15.42:0/1599733811 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed6d9d640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36994/0 (socket says 172.21.15.42:36994) 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed759e640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed8102220 0x7f8ed819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 -- 172.21.15.42:0/1599733811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed8102220 msgr2=0x7f8ed819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed8102220 0x7f8ed819f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 -- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 msgr2=0x7f8ed8197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 -- 172.21.15.42:0/1599733811 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed819f6f0 con 0x7f8ed8101860 2024-03-31T23:15:39.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed6d9d640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ed659c640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 0x7f8ed8198010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00d770 tx=0x7f8ecc00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc017070 con 0x7f8ed8101860 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ecc005520 con 0x7f8ed8101860 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed819f9e0 con 0x7f8ed8101860 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.296+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc010460 con 0x7f8ed8101860 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.297+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed819fee0 con 0x7f8ed8101860 2024-03-31T23:15:39.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.297+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed81a0110 con 0x7f8ed8101860 2024-03-31T23:15:39.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.298+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f8ecc004ea0 con 0x7f8ed8101860 2024-03-31T23:15:39.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.299+0000 7f8ebffff640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ec00a24a0 0x7f8ec00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.299+0000 7f8ed6d9d640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ec00a24a0 0x7f8ec00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.299+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f8ecc0ce3d0 con 0x7f8ed8101860 2024-03-31T23:15:39.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.299+0000 7f8ed6d9d640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ec00a24a0 0x7f8ec00a4960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00096c0 tx=0x7f8ed0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.308+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8ecc09ad00 con 0x7f8ed8101860 2024-03-31T23:15:39.422 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:39 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:15:39.403+0000 7f0054975700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-31T23:15:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:39 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/275453595' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-03-31T23:15:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:39 smithi094 ceph-mon[36167]: osdmap e88: 12 total, 12 up, 12 in 2024-03-31T23:15:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:39 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2840946397' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-03-31T23:15:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:39 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/275453595' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-03-31T23:15:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:39 smithi188 ceph-mon[36068]: osdmap e88: 12 total, 12 up, 12 in 2024-03-31T23:15:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:39 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2840946397' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-03-31T23:15:39.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.528+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ed81a02e0 con 0x7f8ed8101860 2024-03-31T23:15:39.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.529+0000 7f8ebffff640 1 -- 172.21.15.42:0/1599733811 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11788 (secure 0 0 0) 0x7f8ecc09eda0 con 0x7f8ed8101860 2024-03-31T23:15:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:39.530 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:15:38.521001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-03-31T23:15:39.530 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2024-03-31T23:15:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ec00a24a0 msgr2=0x7f8ec00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ec00a24a0 0x7f8ec00a4960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00096c0 tx=0x7f8ed0009260 comp rx=0 tx=0).stop 2024-03-31T23:15:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 msgr2=0x7f8ed8198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 0x7f8ed8198010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00d770 tx=0x7f8ecc00dc30 comp rx=0 tx=0).stop 2024-03-31T23:15:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 shutdown_connections 2024-03-31T23:15:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed8102220 0x7f8ed819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ed8101860 0x7f8ed8198010 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ec00a24a0 0x7f8ec00a4960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 --2- 172.21.15.42:0/1599733811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed8100670 0x7f8ed8197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 >> 172.21.15.42:0/1599733811 conn(0x7f8ed80fbbe0 msgr2=0x7f8ed80688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 shutdown_connections 2024-03-31T23:15:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.531+0000 7f8edd1dd640 1 -- 172.21.15.42:0/1599733811 wait complete. 2024-03-31T23:15:39.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:39 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/275453595' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-03-31T23:15:39.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:39 smithi042 ceph-mon[32380]: osdmap e88: 12 total, 12 up, 12 in 2024-03-31T23:15:39.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:39 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2840946397' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-03-31T23:15:39.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- 172.21.15.42:0/3247591034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 msgr2=0x7f5b30101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/3247591034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30101ce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009980 tx=0x7f5b1c02de60 comp rx=0 tx=0).stop 2024-03-31T23:15:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- 172.21.15.42:0/3247591034 shutdown_connections 2024-03-31T23:15:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/3247591034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 0x7f5b30108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/3247591034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30101ce0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/3247591034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b30100670 0x7f5b30100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- 172.21.15.42:0/3247591034 >> 172.21.15.42:0/3247591034 conn(0x7f5b300fbc00 msgr2=0x7f5b300fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- 172.21.15.42:0/3247591034 shutdown_connections 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- 172.21.15.42:0/3247591034 wait complete. 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 Processor -- start 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- start start 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b30100670 0x7f5b30195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 0x7f5b3019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010b310 con 0x7f5b30101860 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010b190 con 0x7f5b30102220 2024-03-31T23:15:39.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b36e8f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010b490 con 0x7f5b30100670 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b2ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b2ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37006/0 (socket says 172.21.15.42:37006) 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.644+0000 7f5b2ffff640 1 -- 172.21.15.42:0/1449556446 learned_addr learned my addr 172.21.15.42:0/1449556446 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b3542c640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 0x7f5b3019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b34c2b640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b30100670 0x7f5b30195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2ffff640 1 -- 172.21.15.42:0/1449556446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b30100670 msgr2=0x7f5b30195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2ffff640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b30100670 0x7f5b30195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2ffff640 1 -- 172.21.15.42:0/1449556446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 msgr2=0x7f5b3019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2ffff640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 0x7f5b3019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2ffff640 1 -- 172.21.15.42:0/1449556446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3019d5a0 con 0x7f5b30101860 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b3542c640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 0x7f5b3019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2ffff640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30195ec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009230 tx=0x7f5b1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c045020 con 0x7f5b30101860 2024-03-31T23:15:39.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3019d830 con 0x7f5b30101860 2024-03-31T23:15:39.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5b1c036e50 con 0x7f5b30101860 2024-03-31T23:15:39.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c004ca0 con 0x7f5b30101860 2024-03-31T23:15:39.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.645+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3019dd80 con 0x7f5b30101860 2024-03-31T23:15:39.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.646+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b30107990 con 0x7f5b30101860 2024-03-31T23:15:39.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.647+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f5b1c048020 con 0x7f5b30101860 2024-03-31T23:15:39.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.648+0000 7f5b2dffb640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5b200a24a0 0x7f5b200a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.648+0000 7f5b34c2b640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5b200a24a0 0x7f5b200a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.648+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f5b1c0f2fe0 con 0x7f5b30101860 2024-03-31T23:15:39.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.649+0000 7f5b34c2b640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5b200a24a0 0x7f5b200a4960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005fd0 tx=0x7f5b24005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:39.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.653+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5b1c04f020 con 0x7f5b30101860 2024-03-31T23:15:39.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.835+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b30062350 con 0x7f5b30101860 2024-03-31T23:15:39.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.836+0000 7f5b2dffb640 1 -- 172.21.15.42:0/1449556446 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f5b1c0bff60 con 0x7f5b30101860 2024-03-31T23:15:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:39.837 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:39.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5b200a24a0 msgr2=0x7f5b200a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5b200a24a0 0x7f5b200a4960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005fd0 tx=0x7f5b24005850 comp rx=0 tx=0).stop 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 msgr2=0x7f5b30195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30195ec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009230 tx=0x7f5b1c0042f0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 shutdown_connections 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b30102220 0x7f5b3019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5b200a24a0 0x7f5b200a4960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b30101860 0x7f5b30195ec0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 --2- 172.21.15.42:0/1449556446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b30100670 0x7f5b30195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 >> 172.21.15.42:0/1449556446 conn(0x7f5b300fbc00 msgr2=0x7f5b30104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 shutdown_connections 2024-03-31T23:15:39.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.838+0000 7f5b36e8f640 1 -- 172.21.15.42:0/1449556446 wait complete. 2024-03-31T23:15:39.850 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 -- 172.21.15.42:0/358487034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641018e0 msgr2=0x7fd364101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 --2- 172.21.15.42:0/358487034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641018e0 0x7fd364101d60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd354009900 tx=0x7fd35402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 -- 172.21.15.42:0/358487034 shutdown_connections 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 --2- 172.21.15.42:0/358487034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3641022a0 0x7fd364108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 --2- 172.21.15.42:0/358487034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641018e0 0x7fd364101d60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 --2- 172.21.15.42:0/358487034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 0x7fd364100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 -- 172.21.15.42:0/358487034 >> 172.21.15.42:0/358487034 conn(0x7fd3640fbc80 msgr2=0x7fd3640fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 -- 172.21.15.42:0/358487034 shutdown_connections 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.951+0000 7fd36a86f640 1 -- 172.21.15.42:0/358487034 wait complete. 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 Processor -- start 2024-03-31T23:15:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 -- start start 2024-03-31T23:15:39.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 0x7fd364197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3641018e0 0x7fd364198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 0x7fd36419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd36410d4f0 con 0x7fd3641022a0 2024-03-31T23:15:39.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd36410d370 con 0x7fd3641018e0 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd36a86f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd36410d670 con 0x7fd3641006f0 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd368e0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 0x7fd36419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd368e0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 0x7fd36419f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37028/0 (socket says 172.21.15.42:37028) 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd368e0c640 1 -- 172.21.15.42:0/2207320991 learned_addr learned my addr 172.21.15.42:0/2207320991 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd3637fe640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3641018e0 0x7fd364198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.952+0000 7fd363fff640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 0x7fd364197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd368e0c640 1 -- 172.21.15.42:0/2207320991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 msgr2=0x7fd364197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd368e0c640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 0x7fd364197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd368e0c640 1 -- 172.21.15.42:0/2207320991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3641018e0 msgr2=0x7fd364198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd368e0c640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3641018e0 0x7fd364198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd368e0c640 1 -- 172.21.15.42:0/2207320991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36419f750 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd363fff640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 0x7fd364197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd368e0c640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 0x7fd36419f0e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00eb10 tx=0x7fd35c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c004b20 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd35c004cc0 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36419fa40 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0107f0 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.953+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36419ff60 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.954+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd364107a10 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.955+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fd35c005020 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.955+0000 7fd3617fa640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd34c0a2520 0x7fd34c0a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.955+0000 7fd363fff640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd34c0a2520 0x7fd34c0a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.956+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fd35c0cef40 con 0x7fd3641022a0 2024-03-31T23:15:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.956+0000 7fd363fff640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd34c0a2520 0x7fd34c0a49e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd364101740 tx=0x7fd358005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:39.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:39.960+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd35c09bec0 con 0x7fd3641022a0 2024-03-31T23:15:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.145+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd364062350 con 0x7fd3641022a0 2024-03-31T23:15:40.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.147+0000 7fd3617fa640 1 -- 172.21.15.42:0/2207320991 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7fd35c09b7c0 con 0x7fd3641022a0 2024-03-31T23:15:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:40.148 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd34c0a2520 msgr2=0x7fd34c0a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd34c0a2520 0x7fd34c0a49e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd364101740 tx=0x7fd358005e70 comp rx=0 tx=0).stop 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 msgr2=0x7fd36419f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 0x7fd36419f0e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00eb10 tx=0x7fd35c00c2d0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 shutdown_connections 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd34c0a2520 0x7fd34c0a49e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3641022a0 0x7fd36419f0e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3641018e0 0x7fd364198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 --2- 172.21.15.42:0/2207320991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3641006f0 0x7fd364197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 >> 172.21.15.42:0/2207320991 conn(0x7fd3640fbc80 msgr2=0x7fd364104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 shutdown_connections 2024-03-31T23:15:40.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.149+0000 7fd36a86f640 1 -- 172.21.15.42:0/2207320991 wait complete. 2024-03-31T23:15:40.176 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:15:40.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 -- 172.21.15.42:0/1948440791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 msgr2=0x7fea40108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 --2- 172.21.15.42:0/1948440791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40108ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea30009ca0 tx=0x7fea3002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 -- 172.21.15.42:0/1948440791 shutdown_connections 2024-03-31T23:15:40.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 --2- 172.21.15.42:0/1948440791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40108ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 --2- 172.21.15.42:0/1948440791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 0x7fea40101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 --2- 172.21.15.42:0/1948440791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea40100670 0x7fea40100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 -- 172.21.15.42:0/1948440791 >> 172.21.15.42:0/1948440791 conn(0x7fea400fbbe0 msgr2=0x7fea400fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 -- 172.21.15.42:0/1948440791 shutdown_connections 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.277+0000 7fea456eb640 1 -- 172.21.15.42:0/1948440791 wait complete. 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 Processor -- start 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 -- start start 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea40100670 0x7fea4010aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 0x7fea40109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40109b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea4010d510 con 0x7fea40102220 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea4010d390 con 0x7fea40101860 2024-03-31T23:15:40.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea456eb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea4010d690 con 0x7fea40100670 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea3f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40109b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea3f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40109b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37046/0 (socket says 172.21.15.42:37046) 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea3f7fe640 1 -- 172.21.15.42:0/2470228448 learned_addr learned my addr 172.21.15.42:0/2470228448 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.278+0000 7fea3e7fc640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 0x7fea40109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3effd640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea40100670 0x7fea4010aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3f7fe640 1 -- 172.21.15.42:0/2470228448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea40100670 msgr2=0x7fea4010aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3f7fe640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea40100670 0x7fea4010aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3f7fe640 1 -- 172.21.15.42:0/2470228448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 msgr2=0x7fea40109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3f7fe640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 0x7fea40109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3f7fe640 1 -- 172.21.15.42:0/2470228448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4010a400 con 0x7fea40102220 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3e7fc640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 0x7fea40109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea3f7fe640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40109b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fea3002c630 tx=0x7fea30034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30039040 con 0x7fea40102220 2024-03-31T23:15:40.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea401a1b60 con 0x7fea40102220 2024-03-31T23:15:40.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea30044070 con 0x7fea40102220 2024-03-31T23:15:40.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30004420 con 0x7fea40102220 2024-03-31T23:15:40.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.279+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea401a20b0 con 0x7fea40102220 2024-03-31T23:15:40.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.280+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea401078c0 con 0x7fea40102220 2024-03-31T23:15:40.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.281+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fea300045e0 con 0x7fea40102220 2024-03-31T23:15:40.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.282+0000 7fea37fff640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fea2c0a24a0 0x7fea2c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.282+0000 7fea3effd640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fea2c0a24a0 0x7fea2c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.282+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fea300f1080 con 0x7fea40102220 2024-03-31T23:15:40.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.282+0000 7fea3effd640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fea2c0a24a0 0x7fea2c0a4960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fea38005d00 tx=0x7fea38005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.286+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fea300be000 con 0x7fea40102220 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: pgmap v287: 129 pgs: 8 unknown, 14 creating+peering, 107 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 8 op/s 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: osdmap e89: 12 total, 12 up, 12 in 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2840946397' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1599733811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1449556446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:40 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2207320991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: pgmap v287: 129 pgs: 8 unknown, 14 creating+peering, 107 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 8 op/s 2024-03-31T23:15:40.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-31T23:15:40.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: osdmap e89: 12 total, 12 up, 12 in 2024-03-31T23:15:40.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2840946397' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-03-31T23:15:40.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:40.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1599733811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1449556446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:40 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2207320991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.507+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea40062350 con 0x7fea40102220 2024-03-31T23:15:40.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.507+0000 7fea37fff640 1 -- 172.21.15.42:0/2470228448 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11788 (secure 0 0 0) 0x7fea300bd900 con 0x7fea40102220 2024-03-31T23:15:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:15:38.521001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-03-31T23:15:40.508 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2024-03-31T23:15:40.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fea2c0a24a0 msgr2=0x7fea2c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fea2c0a24a0 0x7fea2c0a4960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fea38005d00 tx=0x7fea38005c50 comp rx=0 tx=0).stop 2024-03-31T23:15:40.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 msgr2=0x7fea40109b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40109b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fea3002c630 tx=0x7fea30034670 comp rx=0 tx=0).stop 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 shutdown_connections 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fea2c0a24a0 0x7fea2c0a4960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea40102220 0x7fea40109b70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea40101860 0x7fea40109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 --2- 172.21.15.42:0/2470228448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea40100670 0x7fea4010aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 >> 172.21.15.42:0/2470228448 conn(0x7fea400fbbe0 msgr2=0x7fea40104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 shutdown_connections 2024-03-31T23:15:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.509+0000 7fea456eb640 1 -- 172.21.15.42:0/2470228448 wait complete. 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: pgmap v287: 129 pgs: 8 unknown, 14 creating+peering, 107 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 8 op/s 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: osdmap e89: 12 total, 12 up, 12 in 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2840946397' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1599733811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1449556446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:40 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2207320991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:40.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.623+0000 7f916333e640 1 -- 172.21.15.42:0/1331980907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1018e0 msgr2=0x7f915c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.623+0000 7f916333e640 1 --2- 172.21.15.42:0/1331980907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1018e0 0x7f915c101d60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f914c009900 tx=0x7f914c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- 172.21.15.42:0/1331980907 shutdown_connections 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 --2- 172.21.15.42:0/1331980907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f915c1022a0 0x7f915c108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 --2- 172.21.15.42:0/1331980907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1018e0 0x7f915c101d60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 --2- 172.21.15.42:0/1331980907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f915c1006f0 0x7f915c100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- 172.21.15.42:0/1331980907 >> 172.21.15.42:0/1331980907 conn(0x7f915c0fbc80 msgr2=0x7f915c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- 172.21.15.42:0/1331980907 shutdown_connections 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- 172.21.15.42:0/1331980907 wait complete. 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 Processor -- start 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- start start 2024-03-31T23:15:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f915c1006f0 0x7f915c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f915c1018e0 0x7f915c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 0x7f915c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f915c10c3e0 con 0x7f915c1022a0 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f915c10c260 con 0x7f915c1006f0 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f916333e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f915c10c560 con 0x7f915c1018e0 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f91618db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 0x7f915c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f91618db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 0x7f915c19f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37070/0 (socket says 172.21.15.42:37070) 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.624+0000 7f91618db640 1 -- 172.21.15.42:0/3989456945 learned_addr learned my addr 172.21.15.42:0/3989456945 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91610da640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f915c1006f0 0x7f915c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91608d9640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f915c1018e0 0x7f915c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91618db640 1 -- 172.21.15.42:0/3989456945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f915c1018e0 msgr2=0x7f915c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91618db640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f915c1018e0 0x7f915c198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91618db640 1 -- 172.21.15.42:0/3989456945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f915c1006f0 msgr2=0x7f915c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91618db640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f915c1006f0 0x7f915c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91618db640 1 -- 172.21.15.42:0/3989456945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c19f760 con 0x7f915c1022a0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91618db640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 0x7f915c19f0f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f915800eaa0 tx=0x7f915800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800cdb0 con 0x7f915c1022a0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915c19fa50 con 0x7f915c1022a0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9158004b20 con 0x7f915c1022a0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915c19fff0 con 0x7f915c1022a0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.625+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158011760 con 0x7f915c1022a0 2024-03-31T23:15:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.626+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915c1a02e0 con 0x7f915c1022a0 2024-03-31T23:15:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.627+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f9158011900 con 0x7f915c1022a0 2024-03-31T23:15:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.628+0000 7f91527fc640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f91480a24a0 0x7f91480a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.628+0000 7f91610da640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f91480a24a0 0x7f91480a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.628+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f91580cef20 con 0x7f915c1022a0 2024-03-31T23:15:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.628+0000 7f91610da640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f91480a24a0 0x7f91480a4960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91540095f0 tx=0x7f9154005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.631+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9158016030 con 0x7f915c1022a0 2024-03-31T23:15:40.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.822+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f915c1a04b0 con 0x7f915c1022a0 2024-03-31T23:15:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.823+0000 7f91527fc640 1 -- 172.21.15.42:0/3989456945 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f915809bea0 con 0x7f915c1022a0 2024-03-31T23:15:40.824 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:40.824 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:40.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f91480a24a0 msgr2=0x7f91480a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f91480a24a0 0x7f91480a4960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91540095f0 tx=0x7f9154005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:40.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 msgr2=0x7f915c19f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 0x7f915c19f0f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f915800eaa0 tx=0x7f915800ef60 comp rx=0 tx=0).stop 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 shutdown_connections 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f91480a24a0 0x7f91480a4960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f915c1022a0 0x7f915c19f0f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f915c1018e0 0x7f915c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 --2- 172.21.15.42:0/3989456945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f915c1006f0 0x7f915c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.825+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 >> 172.21.15.42:0/3989456945 conn(0x7f915c0fbc80 msgr2=0x7f915c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.826+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 shutdown_connections 2024-03-31T23:15:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.826+0000 7f916333e640 1 -- 172.21.15.42:0/3989456945 wait complete. 2024-03-31T23:15:40.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-31T23:15:33.212486+0000', 'modified': '2024-03-31T23:15:38.521001+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6839/1375958649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 1375958649}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 1375958649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-03-31T23:15:40.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-31T23:15:40.839 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/2239773426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c101850 msgr2=0x7fb39c101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/2239773426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c101850 0x7fb39c101cd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb38802bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/2239773426 shutdown_connections 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/2239773426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb39c102210 0x7fb39c108aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/2239773426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c101850 0x7fb39c101cd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/2239773426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c100660 0x7fb39c100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/2239773426 >> 172.21.15.42:0/2239773426 conn(0x7fb39c0fbbf0 msgr2=0x7fb39c0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/2239773426 shutdown_connections 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/2239773426 wait complete. 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 Processor -- start 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 -- start start 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.942+0000 7fb3a2c1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 0x7fb39c06a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c101850 0x7fb39c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb39c102210 0x7fb39c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c10c3c0 con 0x7fb39c100660 2024-03-31T23:15:40.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c10c240 con 0x7fb39c102210 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c10c540 con 0x7fb39c101850 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 0x7fb39c06a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 0x7fb39c06a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37086/0 (socket says 172.21.15.42:37086) 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 -- 172.21.15.42:0/3012073892 learned_addr learned my addr 172.21.15.42:0/3012073892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb39c102210 0x7fb39c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb39bfff640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c101850 0x7fb39c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 -- 172.21.15.42:0/3012073892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c101850 msgr2=0x7fb39c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c101850 0x7fb39c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 -- 172.21.15.42:0/3012073892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb39c102210 msgr2=0x7fb39c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb39c102210 0x7fb39c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 -- 172.21.15.42:0/3012073892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c19f810 con 0x7fb39c100660 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb39bfff640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c101850 0x7fb39c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 0x7fb39c06a8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb39000d950 tx=0x7fb39000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb399ffb640 1 -- 172.21.15.42:0/3012073892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390017070 con 0x7fb39c100660 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39c19faa0 con 0x7fb39c100660 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb399ffb640 1 -- 172.21.15.42:0/3012073892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb39000be10 con 0x7fb39c100660 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb399ffb640 1 -- 172.21.15.42:0/3012073892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39000f6b0 con 0x7fb39c100660 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.943+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c19fff0 con 0x7fb39c100660 2024-03-31T23:15:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.945+0000 7fb399ffb640 1 -- 172.21.15.42:0/3012073892 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fb39001a070 con 0x7fb39c100660 2024-03-31T23:15:40.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 Processor -- start 2024-03-31T23:15:40.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 -- start start 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb399ffb640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb38c0a24a0 0x7fb38c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c459a20 0x56519c459e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c45b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c461e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56519c3b9af0 con 0x56519c45b5b0 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56519c3629d0 con 0x56519c459a20 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a5801740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56519c3b5b90 con 0x56519c45abf0 2024-03-31T23:15:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb38c0a24a0 0x7fb38c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb399ffb640 1 -- 172.21.15.42:0/3012073892 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb3900ce400 con 0x7fb39c100660 2024-03-31T23:15:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a11b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c461e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a09b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c459a20 0x56519c459e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a11b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c461e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37102/0 (socket says 172.21.15.42:37102) 2024-03-31T23:15:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb3a11b9640 1 -- 172.21.15.42:0/4096901499 learned_addr learned my addr 172.21.15.42:0/4096901499 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.946+0000 7fb39bfff640 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c45b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a09b8640 1 -- 172.21.15.42:0/4096901499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 msgr2=0x56519c45b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c45b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a09b8640 1 -- 172.21.15.42:0/4096901499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 msgr2=0x56519c461e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c461e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a09b8640 1 -- 172.21.15.42:0/4096901499 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c0ce2d0 con 0x56519c459a20 2024-03-31T23:15:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb38c0a24a0 0x7fb38c0a4960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb394009fd0 tx=0x7fb394011440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c459a20 0x56519c459e40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cbcc0 tx=0x7fb39009ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6eab14838940db server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb386ffd640 1 -- 172.21.15.42:0/4096901499 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390021070 con 0x56519c459a20 2024-03-31T23:15:40.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb386ffd640 1 -- 172.21.15.42:0/4096901499 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3900cd030 con 0x56519c459a20 2024-03-31T23:15:40.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb386ffd640 1 -- 172.21.15.42:0/4096901499 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390099010 con 0x56519c459a20 2024-03-31T23:15:40.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a5801740 1 -- 172.21.15.42:0/4096901499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c459a20 msgr2=0x56519c459e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.947+0000 7fb3a5801740 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c459a20 0x56519c459e40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cbcc0 tx=0x7fb39009ab80 comp rx=0 tx=0).stop 2024-03-31T23:15:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- 172.21.15.42:0/4096901499 shutdown_connections 2024-03-31T23:15:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c461e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c45b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 --2- 172.21.15.42:0/4096901499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c459a20 0x56519c459e40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- 172.21.15.42:0/4096901499 >> 172.21.15.42:0/4096901499 conn(0x56519c450a00 msgr2=0x56519c450e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- 172.21.15.42:0/4096901499 shutdown_connections 2024-03-31T23:15:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- 172.21.15.42:0/4096901499 wait complete. 2024-03-31T23:15:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- start start 2024-03-31T23:15:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 Processor -- start 2024-03-31T23:15:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 0x56519c463cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c464200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56519c462560 con 0x56519c459a20 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56519c375f70 con 0x56519c45b5b0 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56519c4626e0 con 0x56519c45abf0 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a5801740 10 client.0 _ll_register_callbacks cb 0x56519c0cdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a09b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 0x56519c463cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a09b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 0x56519c463cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37110/0 (socket says 172.21.15.42:37110) 2024-03-31T23:15:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a09b8640 1 -- 172.21.15.42:0/184567056 learned_addr learned my addr 172.21.15.42:0/184567056 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.948+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb39bfff640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c464200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a09b8640 1 -- 172.21.15.42:0/184567056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 msgr2=0x56519c464200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c464200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a09b8640 1 -- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 msgr2=0x56519c46b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a09b8640 1 -- 172.21.15.42:0/184567056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519c1986b0 con 0x56519c459a20 2024-03-31T23:15:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb39bfff640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c464200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 0x56519c463cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cc030 tx=0x7fb390005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9477f9664faa34 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb37bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:15:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb37bfff640 1 -- 172.21.15.42:0/184567056 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3900b2020 con 0x56519c459a20 2024-03-31T23:15:40.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb37bfff640 1 -- 172.21.15.42:0/184567056 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb3900c4860 con 0x56519c459a20 2024-03-31T23:15:40.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3900cd030 con 0x56519c459a20 2024-03-31T23:15:40.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb37bfff640 1 -- 172.21.15.42:0/184567056 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb390021040 con 0x56519c459a20 2024-03-31T23:15:40.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a5801740 10 client.14760 fetch_fsmap learned FSMap version 17 2024-03-31T23:15:40.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x56519c46e220 con 0x56519c459a20 2024-03-31T23:15:40.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb37bfff640 1 -- 172.21.15.42:0/184567056 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3900cd030 con 0x56519c459a20 2024-03-31T23:15:40.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.949+0000 7fb37bfff640 1 -- 172.21.15.42:0/184567056 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb39009a1f0 con 0x56519c459a20 2024-03-31T23:15:40.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb3a5801740 10 client.14760 fetch_fsmap finished waiting for FSMap version 17 2024-03-31T23:15:40.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb3a5801740 10 client.14760 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T23:15:40.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb3a5801740 20 client.14760 populate_metadata read hostname 'smithi042' 2024-03-31T23:15:40.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb3a5801740 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4703d0 0x56519c471840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb3a5801740 4 client.14760 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:15:40.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56519c3c7030 con 0x56519c4703d0 2024-03-31T23:15:40.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb39bfff640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4703d0 0x56519c471840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb37bfff640 10 client.14760 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:15:40.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.950+0000 7fb39bfff640 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4703d0 0x56519c471840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb12c2892d39744 server_cookie=d48818c59407a415 in_seq=0 out_seq=0 2024-03-31T23:15:40.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb37bfff640 1 -- 172.21.15.42:0/184567056 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56519c3c7030 con 0x56519c4703d0 2024-03-31T23:15:40.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb37bfff640 10 client.14760 handle_command_reply: tid=0 2024-03-31T23:15:40.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 client.14760 shutdown 2024-03-31T23:15:40.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 msgr2=0x56519c463cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 0x56519c463cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cc030 tx=0x7fb390005f30 comp rx=0 tx=0).stop 2024-03-31T23:15:40.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 shutdown_connections 2024-03-31T23:15:40.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4703d0 0x56519c471840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c45abf0 0x56519c464200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb37bfff640 0 client.14760 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 --2- 172.21.15.42:0/184567056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c459a20 0x56519c463cc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 >> 172.21.15.42:0/184567056 conn(0x56519c450a00 msgr2=0x56519c44fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 shutdown_connections 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.951+0000 7fb3a5801740 1 -- 172.21.15.42:0/184567056 wait complete. 2024-03-31T23:15:40.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.952+0000 7fb3a5801740 20 client.14760 trim_cache size 0 max 16384 2024-03-31T23:15:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 Processor -- start 2024-03-31T23:15:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 -- start start 2024-03-31T23:15:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c462ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45abf0 0x56519c46b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c462ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56519c46fb80 con 0x56519c45b5b0 2024-03-31T23:15:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56519c470250 con 0x56519c45abf0 2024-03-31T23:15:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a5801740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56519c470920 con 0x56519c459a20 2024-03-31T23:15:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c462ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c462ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37114/0 (socket says 172.21.15.42:37114) 2024-03-31T23:15:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 -- 172.21.15.42:0/2276039369 learned_addr learned my addr 172.21.15.42:0/2276039369 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb39bfff640 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45abf0 0x56519c46b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c462ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 -- 172.21.15.42:0/2276039369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 msgr2=0x56519c462ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c462ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 -- 172.21.15.42:0/2276039369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45abf0 msgr2=0x56519c46b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45abf0 0x56519c46b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 -- 172.21.15.42:0/2276039369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c470dd0 con 0x56519c45b5b0 2024-03-31T23:15:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c462ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c462ff0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb394009860 tx=0x7fb394021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98275bd19f5f26ac server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3867fc640 1 -- 172.21.15.42:0/2276039369 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39402e070 con 0x56519c45b5b0 2024-03-31T23:15:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.970+0000 7fb3867fc640 1 -- 172.21.15.42:0/2276039369 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb394011d40 con 0x56519c45b5b0 2024-03-31T23:15:40.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3867fc640 1 -- 172.21.15.42:0/2276039369 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394029400 con 0x56519c45b5b0 2024-03-31T23:15:40.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 -- 172.21.15.42:0/2276039369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 msgr2=0x56519c462ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c462ff0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb394009860 tx=0x7fb394021000 comp rx=0 tx=0).stop 2024-03-31T23:15:40.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 -- 172.21.15.42:0/2276039369 shutdown_connections 2024-03-31T23:15:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45b5b0 0x56519c462ff0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45abf0 0x56519c46b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 --2- 172.21.15.42:0/2276039369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c462ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 -- 172.21.15.42:0/2276039369 >> 172.21.15.42:0/2276039369 conn(0x56519c450a00 msgr2=0x56519c44b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 -- 172.21.15.42:0/2276039369 shutdown_connections 2024-03-31T23:15:40.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 -- 172.21.15.42:0/2276039369 wait complete. 2024-03-31T23:15:40.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 -- start start 2024-03-31T23:15:40.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.971+0000 7fb3a5801740 1 Processor -- start 2024-03-31T23:15:40.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c466e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 0x56519c467370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56519c4716c0 con 0x56519c45abf0 2024-03-31T23:15:40.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56519c470ff0 con 0x56519c45b5b0 2024-03-31T23:15:40.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56519c471d90 con 0x56519c459a20 2024-03-31T23:15:40.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 10 client.0 _ll_register_callbacks cb 0x7fb394011870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:15:40.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 0x56519c467370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 0x56519c467370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37118/0 (socket says 172.21.15.42:37118) 2024-03-31T23:15:40.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 -- 172.21.15.42:0/398942122 learned_addr learned my addr 172.21.15.42:0/398942122 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:40.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a11b9640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c466e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 -- 172.21.15.42:0/398942122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 msgr2=0x56519c466e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c466e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 -- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 msgr2=0x56519c46a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:15:40.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 -- 172.21.15.42:0/398942122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519c46a980 con 0x56519c45abf0 2024-03-31T23:15:40.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c466e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:40.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb39bfff640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 0x56519c467370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb3880096c0 tx=0x7fb38802cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fbcdcb4918f994 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:40.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb37bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:15:40.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb37bfff640 1 -- 172.21.15.42:0/398942122 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388047030 con 0x56519c45abf0 2024-03-31T23:15:40.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb37bfff640 1 -- 172.21.15.42:0/398942122 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb38803a040 con 0x56519c45abf0 2024-03-31T23:15:40.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.972+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb394011d40 con 0x56519c45abf0 2024-03-31T23:15:40.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb37bfff640 1 -- 172.21.15.42:0/398942122 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb388004040 con 0x56519c45abf0 2024-03-31T23:15:40.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 10 client.14766 fetch_fsmap learned FSMap version 17 2024-03-31T23:15:40.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x56519c4d65c0 con 0x56519c45abf0 2024-03-31T23:15:40.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb37bfff640 1 -- 172.21.15.42:0/398942122 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb394011d40 con 0x56519c45abf0 2024-03-31T23:15:40.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb37bfff640 1 -- 172.21.15.42:0/398942122 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb388043270 con 0x56519c45abf0 2024-03-31T23:15:40.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 10 client.14766 fetch_fsmap finished waiting for FSMap version 17 2024-03-31T23:15:40.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 10 client.14766 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T23:15:40.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 20 client.14766 populate_metadata read hostname 'smithi042' 2024-03-31T23:15:40.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4db280 0x56519c4d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:40.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 4 client.14766 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:15:40.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "status"}) -- 0x56519c3c1380 con 0x56519c4db280 2024-03-31T23:15:40.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.973+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4db280 0x56519c4d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:40.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb37bfff640 10 client.14766 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:15:40.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a09b8640 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4db280 0x56519c4d9f90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=516e817d1635bf42 server_cookie=e15d9dcb0cd236fc in_seq=0 out_seq=0 2024-03-31T23:15:40.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb37bfff640 1 -- 172.21.15.42:0/398942122 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56519c3c1380 con 0x56519c4db280 2024-03-31T23:15:40.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb37bfff640 10 client.14766 handle_command_reply: tid=0 2024-03-31T23:15:40.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 client.14766 shutdown 2024-03-31T23:15:40.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 msgr2=0x56519c467370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:40.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 0x56519c467370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb3880096c0 tx=0x7fb38802cc30 comp rx=0 tx=0).stop 2024-03-31T23:15:40.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 shutdown_connections 2024-03-31T23:15:40.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56519c4db280 0x56519c4d9f90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:40.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56519c45b5b0 0x56519c46a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56519c45abf0 0x56519c467370 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 --2- 172.21.15.42:0/398942122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56519c459a20 0x56519c466e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb37bfff640 0 client.14766 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:15:41.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 >> 172.21.15.42:0/398942122 conn(0x56519c450a00 msgr2=0x56519c462ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:41.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 shutdown_connections 2024-03-31T23:15:41.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 1 -- 172.21.15.42:0/398942122 wait complete. 2024-03-31T23:15:41.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.974+0000 7fb3a5801740 20 client.14766 trim_cache size 0 max 16384 2024-03-31T23:15:41.002 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:15:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:15:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-03-31T23:15:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24497, 2024-03-31T23:15:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:15:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:15:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:15:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.8410081580000002, 2024-03-31T23:15:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 17, 2024-03-31T23:15:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 89, 2024-03-31T23:15:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:15:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 12.286389852999999 2024-03-31T23:15:41.004 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:15:41.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb38c0a24a0 msgr2=0x7fb38c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb38c0a24a0 0x7fb38c0a4960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb394009fd0 tx=0x7fb394011440 comp rx=0 tx=0).stop 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 msgr2=0x7fb39c06a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 0x7fb39c06a8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb39000d950 tx=0x7fb39000dd50 comp rx=0 tx=0).stop 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 shutdown_connections 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb39c102210 0x7fb39c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb39c101850 0x7fb39c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb38c0a24a0 0x7fb38c0a4960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 --2- 172.21.15.42:0/3012073892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb39c100660 0x7fb39c06a8b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 >> 172.21.15.42:0/3012073892 conn(0x7fb39c0fbbf0 msgr2=0x7fb39c104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 shutdown_connections 2024-03-31T23:15:41.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:40.975+0000 7fb3a2c1c640 1 -- 172.21.15.42:0/3012073892 wait complete. 2024-03-31T23:15:41.008 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-31T23:15:41.008 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:41.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph fs ls 2024-03-31T23:15:41.248 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:15:41.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:41 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2470228448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:41 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3989456945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:41.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:41 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2470228448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:41.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:41 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3989456945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:41.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:41 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2470228448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:15:41.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:41 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3989456945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:42.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:42 smithi188 ceph-mon[36068]: pgmap v289: 129 pgs: 4 unknown, 14 creating+peering, 111 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 9 op/s 2024-03-31T23:15:42.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:42 smithi188 ceph-mon[36068]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-31T23:15:42.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:42 smithi188 ceph-mon[36068]: Cluster is now healthy 2024-03-31T23:15:42.507 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:42 smithi042 ceph-mon[32380]: pgmap v289: 129 pgs: 4 unknown, 14 creating+peering, 111 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 9 op/s 2024-03-31T23:15:42.507 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:42 smithi042 ceph-mon[32380]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-31T23:15:42.508 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:42 smithi042 ceph-mon[32380]: Cluster is now healthy 2024-03-31T23:15:42.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:42 smithi094 ceph-mon[36167]: pgmap v289: 129 pgs: 4 unknown, 14 creating+peering, 111 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 9 op/s 2024-03-31T23:15:42.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:42 smithi094 ceph-mon[36167]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-31T23:15:42.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:42 smithi094 ceph-mon[36167]: Cluster is now healthy 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 -- 172.21.15.42:0/3703615234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620107600 msgr2=0x7f762010f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 --2- 172.21.15.42:0/3703615234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620107600 0x7f762010f180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f761800b0a0 tx=0x7f761800b3b0 comp rx=0 tx=0).stop 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 -- 172.21.15.42:0/3703615234 shutdown_connections 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 --2- 172.21.15.42:0/3703615234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620100de0 0x7f76201011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 --2- 172.21.15.42:0/3703615234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620107600 0x7f762010f180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 --2- 172.21.15.42:0/3703615234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7620101790 0x7f7620106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:42.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 -- 172.21.15.42:0/3703615234 >> 172.21.15.42:0/3703615234 conn(0x7f7620076480 msgr2=0x7f7620076890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 -- 172.21.15.42:0/3703615234 shutdown_connections 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.862+0000 7f7624920700 1 -- 172.21.15.42:0/3703615234 wait complete. 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 Processor -- start 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 -- start start 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 0x7f762019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7620101790 0x7f762019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620107600 0x7f7620198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76201126f0 con 0x7f7620100de0 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7620112570 con 0x7f7620101790 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f7624920700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7620112870 con 0x7f7620107600 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 0x7f762019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 0x7f762019e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37136/0 (socket says 172.21.15.42:37136) 2024-03-31T23:15:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 -- 172.21.15.42:0/227073881 learned_addr learned my addr 172.21.15.42:0/227073881 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761dd9b700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7620101790 0x7f762019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761ed9d700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620107600 0x7f7620198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 -- 172.21.15.42:0/227073881 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620107600 msgr2=0x7f7620198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620107600 0x7f7620198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 -- 172.21.15.42:0/227073881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7620101790 msgr2=0x7f762019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7620101790 0x7f762019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761e59c700 1 -- 172.21.15.42:0/227073881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7620199070 con 0x7f7620100de0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.863+0000 7f761ed9d700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620107600 0x7f7620198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.864+0000 7f761e59c700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 0x7f762019e750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f761000d980 tx=0x7f761000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.864+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610017070 con 0x7f7620100de0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.864+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7620199360 con 0x7f7620100de0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.864+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7610005020 con 0x7f7620100de0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.864+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610009d20 con 0x7f7620100de0 2024-03-31T23:15:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.864+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76201a5620 con 0x7f7620100de0 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.865+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7620068f00 con 0x7f7620100de0 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.866+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f76100051d0 con 0x7f7620100de0 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.866+0000 7f760f7fe700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76080a2530 0x7f76080a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.866+0000 7f761dd9b700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76080a2530 0x7f76080a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.866+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f76100cec00 con 0x7f7620100de0 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.867+0000 7f761dd9b700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76080a2530 0x7f76080a49f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f76201088e0 tx=0x7f7614009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:42.870+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7610020020 con 0x7f7620100de0 2024-03-31T23:15:43.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.123+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f762002db30 con 0x7f7620100de0 2024-03-31T23:15:43.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.124+0000 7f760f7fe700 1 -- 172.21.15.42:0/227073881 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f761009bb80 con 0x7f7620100de0 2024-03-31T23:15:43.124 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-31T23:15:43.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.125+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76080a2530 msgr2=0x7f76080a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:43.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.125+0000 7f7624920700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76080a2530 0x7f76080a49f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f76201088e0 tx=0x7f7614009260 comp rx=0 tx=0).stop 2024-03-31T23:15:43.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.125+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 msgr2=0x7f762019e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.125+0000 7f7624920700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 0x7f762019e750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f761000d980 tx=0x7f761000dc90 comp rx=0 tx=0).stop 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 shutdown_connections 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76080a2530 0x7f76080a49f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7620107600 0x7f7620198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7620100de0 0x7f762019e750 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 --2- 172.21.15.42:0/227073881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7620101790 0x7f762019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 >> 172.21.15.42:0/227073881 conn(0x7f7620076480 msgr2=0x7f76200feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 shutdown_connections 2024-03-31T23:15:43.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:43.126+0000 7f7624920700 1 -- 172.21.15.42:0/227073881 wait complete. 2024-03-31T23:15:43.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:43 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/227073881' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-31T23:15:43.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:43 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/227073881' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-31T23:15:43.671 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:43 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/227073881' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-31T23:15:44.057 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T23:15:44.058 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-31T23:15:44.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:44.058 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-03-31T23:15:44.076 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T23:15:44.076 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T23:15:44.076 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T23:15:44.076 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-31T23:15:44.076 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42222sec preferred_lft 42222sec 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-03-31T23:15:44.077 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-31T23:15:44.078 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T23:15:44.078 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-03-31T23:15:44.078 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-03-31T23:15:44.078 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-31T23:15:44.078 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:15:44.078 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:15:44.078 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-03-31T23:15:44.079 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-03-31T23:15:44.079 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-03-31T23:15:44.079 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-31T23:15:44.079 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:15:44.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:15:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:44.275 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:44 smithi042 ceph-mon[32380]: pgmap v290: 129 pgs: 14 creating+peering, 115 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-03-31T23:15:44.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:44.280 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T23:15:44.306 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-03-31T23:15:44.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:44.308 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-03-31T23:15:44.386 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-03-31T23:15:44.386 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T23:15:44.386 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-31T23:15:44.386 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-31T23:15:44.386 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T23:15:44.387 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:15:44.387 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:15:44.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-31T23:15:44.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-31T23:15:44.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-31T23:15:44.387 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:15:44.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:44 smithi188 ceph-mon[36068]: pgmap v290: 129 pgs: 14 creating+peering, 115 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-03-31T23:15:44.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:15:44.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:44 smithi094 ceph-mon[36167]: pgmap v290: 129 pgs: 14 creating+peering, 115 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-03-31T23:15:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:44.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:44.726 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-31T23:15:44.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:44.741 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-03-31T23:15:44.796 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:15:44.796 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:15:44.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-31T23:15:44.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-31T23:15:44.796 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:15:44.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:15:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:44.918 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-31T23:15:44.919 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:15:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:15:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:45.075 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:15:45.075 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:15:45.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-03-31T23:15:45.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-03-31T23:15:45.075 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:15:45.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:15:45.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:45.157 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-31T23:15:45.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T23:15:45.157 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:45.171 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-31T23:15:45.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T23:15:45.171 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:45.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2024-03-31T23:15:45.293 DEBUG:teuthology.orchestra.run.smithi042:> cat /proc/self/mounts | awk '{print $2}' 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/proc 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/sys 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/dev 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/security 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/shm 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/pts 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/run 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/cgroup 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/pstore 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/bpf 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/ 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/selinux 2024-03-31T23:15:45.349 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/mqueue 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/hugepages 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/debug 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/tracing 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/fuse/connections 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/config 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-sysctl.service 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/nfs/rpc_pipefs 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/1000 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/df0871ad1bb83a2a27a170da4833e954884ada3a810e18e5cca3e22b21d0114e/merged 2024-03-31T23:15:45.350 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/5368958398b09168aa1871b6d898a56592a5ba1cd8ccb38feec761fa2687d513/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/0 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/47d01eed4921adccc0d8e726c5d3b3356d71debc943d1196e811b405f7f697ef/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/ae77e32afd739e40b015a6bc660f6aac87987d28cd583246a4012d5ec01749f9/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/f24ad25f709983b674a6d3979a6a368202559b556a4b23607c93ba2da8ee8634/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/48d4ed6e537866fe2ffaed4172b035cdb461f8505bdc2fd3f26945ddf1635bf6/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/86ce7c84dd0c69533686252a55b5fa26529f58c1665184ccd9c9631e7969936e/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/fce62a0b07c52697f24946140aa0eaefdd67057854962990f828d93bb0685269/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/5c04a89ecefb2f9e73b7ea44497da963b96c20ac95af8ea55b40fc7e2036593b/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/ce0c86840739509c881f3f3e14de6ed38b642634cacdab76ff17d1f31f8e5bc9/merged 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-31T23:15:45.351 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-31T23:15:45.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:45.352 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2024-03-31T23:15:45.404 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-31T23:15:45.404 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-31T23:15:45.447 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2024-03-31T23:15:45.473 DEBUG:teuthology.orchestra.run.smithi042:> cat /proc/self/mounts | awk '{print $2}' 2024-03-31T23:15:45.528 INFO:teuthology.orchestra.run.smithi042.stdout:/proc 2024-03-31T23:15:45.528 INFO:teuthology.orchestra.run.smithi042.stdout:/sys 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/dev 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/security 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/shm 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/pts 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/run 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/cgroup 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/pstore 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/bpf 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/ 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/selinux 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/mqueue 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/hugepages 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/debug 2024-03-31T23:15:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/tracing 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/fuse/connections 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/config 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-sysctl.service 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/nfs/rpc_pipefs 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/1000 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/df0871ad1bb83a2a27a170da4833e954884ada3a810e18e5cca3e22b21d0114e/merged 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/5368958398b09168aa1871b6d898a56592a5ba1cd8ccb38feec761fa2687d513/merged 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/0 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-03-31T23:15:45.530 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/47d01eed4921adccc0d8e726c5d3b3356d71debc943d1196e811b405f7f697ef/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/ae77e32afd739e40b015a6bc660f6aac87987d28cd583246a4012d5ec01749f9/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/f24ad25f709983b674a6d3979a6a368202559b556a4b23607c93ba2da8ee8634/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/48d4ed6e537866fe2ffaed4172b035cdb461f8505bdc2fd3f26945ddf1635bf6/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/86ce7c84dd0c69533686252a55b5fa26529f58c1665184ccd9c9631e7969936e/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/fce62a0b07c52697f24946140aa0eaefdd67057854962990f828d93bb0685269/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/5c04a89ecefb2f9e73b7ea44497da963b96c20ac95af8ea55b40fc7e2036593b/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/containers/storage/overlay/ce0c86840739509c881f3f3e14de6ed38b642634cacdab76ff17d1f31f8e5bc9/merged 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-31T23:15:45.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:45.531 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2024-03-31T23:15:45.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:2024-03-31T23:15:45.537+0000 7f348d43c480 -1 init, newargv = 0x559fc1d9bf70 newargc=15 2024-03-31T23:15:45.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[73819]: starting ceph client 2024-03-31T23:15:45.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[73819]: starting fuse 2024-03-31T23:15:45.552 INFO:teuthology.orchestra.run.smithi042.stdout:119 2024-03-31T23:15:45.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-03-31T23:15:45.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo stdin-killer -- python3 -c ' 2024-03-31T23:15:45.552 DEBUG:teuthology.orchestra.run.smithi042:> import glob 2024-03-31T23:15:45.552 DEBUG:teuthology.orchestra.run.smithi042:> import re 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> import subprocess 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> def _find_admin_socket(client_name): 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> files = glob.glob(asok_path) 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> # Given a non-glob path, it better be there 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> if "*" not in asok_path: 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> assert(len(files) == 1) 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> return files[0] 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> for f in files: 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-31T23:15:45.553 DEBUG:teuthology.orchestra.run.smithi042:> contents = proc_f.read() 2024-03-31T23:15:45.554 DEBUG:teuthology.orchestra.run.smithi042:> if mountpoint in contents: 2024-03-31T23:15:45.554 DEBUG:teuthology.orchestra.run.smithi042:> return f 2024-03-31T23:15:45.554 DEBUG:teuthology.orchestra.run.smithi042:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-31T23:15:45.554 DEBUG:teuthology.orchestra.run.smithi042:> 2024-03-31T23:15:45.554 DEBUG:teuthology.orchestra.run.smithi042:> print(_find_admin_socket("client.admin")) 2024-03-31T23:15:45.554 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-03-31T23:15:45.674 INFO:teuthology.orchestra.run.smithi042.stdout:/var/run/ceph/ceph-client.admin.73819.asok 2024-03-31T23:15:45.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:45.684 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.73819.asok 2024-03-31T23:15:45.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:45.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.73819.asok status 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "metadata": { 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_sha1": "384f31f3d3aee7f8ba3f60846b8844c049165583", 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev)", 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "entity_id": "admin", 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": "smithi042", 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "pid": "73819", 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "root": "/" 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_count": 0, 2024-03-31T23:15:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_pinned_count": 0, 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 14778, 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "inst": { 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "name": { 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "client", 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "num": 14778 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 136575909 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-03-31T23:15:45.824 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 136575909 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "inst_str": "client.14778 192.168.0.1:0/136575909", 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "addr_str": "192.168.0.1:0/136575909", 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "inode_count": 1, 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_epoch": 17, 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch": 89, 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch_barrier": 0, 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "blocklisted": false, 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs" 2024-03-31T23:15:45.825 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:15:45.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:45.831 DEBUG:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2024-03-31T23:15:45.831 DEBUG:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:45.846 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2024-03-31T23:15:45.846 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:45.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:45.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:45.913 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-31T23:15:46.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T23:15:46.021 INFO:teuthology.orchestra.run.smithi042.stdout:# file: . 2024-03-31T23:15:46.022 INFO:teuthology.orchestra.run.smithi042.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-31T23:15:46.022 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:46.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:15:46.028 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:15:46.028 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T23:15:46.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 -- 172.21.15.42:0/494142731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0103330 msgr2=0x7f59e0109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 --2- 172.21.15.42:0/494142731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0103330 0x7f59e0109bc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009ca0 tx=0x7f59d802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 -- 172.21.15.42:0/494142731 shutdown_connections 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 --2- 172.21.15.42:0/494142731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0103330 0x7f59e0109bc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 --2- 172.21.15.42:0/494142731 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59e0102970 0x7f59e0102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 --2- 172.21.15.42:0/494142731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0101780 0x7f59e0101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 -- 172.21.15.42:0/494142731 >> 172.21.15.42:0/494142731 conn(0x7f59e00fccf0 msgr2=0x7f59e00ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 -- 172.21.15.42:0/494142731 shutdown_connections 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.188+0000 7f59e53e9640 1 -- 172.21.15.42:0/494142731 wait complete. 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 Processor -- start 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 -- start start 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59e0101780 0x7f59e0075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 0x7f59e0073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0103330 0x7f59e0074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f59e010d530 con 0x7f59e0102970 2024-03-31T23:15:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f59e010d3b0 con 0x7f59e0101780 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59e53e9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59e010d6b0 con 0x7f59e0103330 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 0x7f59e0073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 0x7f59e0073b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34392/0 (socket says 172.21.15.42:34392) 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 -- 172.21.15.42:0/2627303115 learned_addr learned my addr 172.21.15.42:0/2627303115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59deffd640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59e0101780 0x7f59e0075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59df7fe640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0103330 0x7f59e0074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 -- 172.21.15.42:0/2627303115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0103330 msgr2=0x7f59e0074080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0103330 0x7f59e0074080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 -- 172.21.15.42:0/2627303115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59e0101780 msgr2=0x7f59e0075500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59e0101780 0x7f59e0075500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59d7fff640 1 -- 172.21.15.42:0/2627303115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e0074910 con 0x7f59e0102970 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.189+0000 7f59df7fe640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0103330 0x7f59e0074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.190+0000 7f59d7fff640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 0x7f59e0073b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59c800e9f0 tx=0x7f59c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.190+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c800cd80 con 0x7f59e0102970 2024-03-31T23:15:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.190+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f59c8010930 con 0x7f59e0102970 2024-03-31T23:15:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.190+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e01a1cc0 con 0x7f59e0102970 2024-03-31T23:15:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.190+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8018b00 con 0x7f59e0102970 2024-03-31T23:15:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.190+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e01a21c0 con 0x7f59e0102970 2024-03-31T23:15:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.191+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e01089d0 con 0x7f59e0102970 2024-03-31T23:15:46.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.192+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f59c8018ca0 con 0x7f59e0102970 2024-03-31T23:15:46.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.192+0000 7f59dcff9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f59cc0a24a0 0x7f59cc0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.192+0000 7f59deffd640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f59cc0a24a0 0x7f59cc0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.192+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f59c80cecf0 con 0x7f59e0102970 2024-03-31T23:15:46.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.193+0000 7f59deffd640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f59cc0a24a0 0x7f59cc0a4960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f59e01027d0 tx=0x7f59d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:46.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.197+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f59c80d3070 con 0x7f59e0102970 2024-03-31T23:15:46.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.380+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59e0062350 con 0x7f59e0102970 2024-03-31T23:15:46.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.381+0000 7f59dcff9640 1 -- 172.21.15.42:0/2627303115 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f59c809bc70 con 0x7f59e0102970 2024-03-31T23:15:46.382 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:46.383 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:46.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f59cc0a24a0 msgr2=0x7f59cc0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f59cc0a24a0 0x7f59cc0a4960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f59e01027d0 tx=0x7f59d0005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 msgr2=0x7f59e0073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 0x7f59e0073b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59c800e9f0 tx=0x7f59c800eeb0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 shutdown_connections 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59e0103330 0x7f59e0074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f59cc0a24a0 0x7f59cc0a4960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e0102970 0x7f59e0073b40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 --2- 172.21.15.42:0/2627303115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59e0101780 0x7f59e0075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.383+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 >> 172.21.15.42:0/2627303115 conn(0x7f59e00fccf0 msgr2=0x7f59e0105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.384+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 shutdown_connections 2024-03-31T23:15:46.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.384+0000 7f59e53e9640 1 -- 172.21.15.42:0/2627303115 wait complete. 2024-03-31T23:15:46.394 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:46 smithi042 ceph-mon[32380]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s wr, 5 op/s 2024-03-31T23:15:46.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:15:46.396 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:15:46.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:46 smithi188 ceph-mon[36068]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s wr, 5 op/s 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2321679136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50102210 msgr2=0x7f1d50108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2321679136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50102210 0x7f1d50108aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009be0 tx=0x7f1d4802bef0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2321679136 shutdown_connections 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2321679136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50102210 0x7f1d50108aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2321679136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50101850 0x7f1d50101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2321679136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d50100660 0x7f1d50100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2321679136 >> 172.21.15.42:0/2321679136 conn(0x7f1d500fbbd0 msgr2=0x7f1d500fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2321679136 shutdown_connections 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.500+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2321679136 wait complete. 2024-03-31T23:15:46.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 Processor -- start 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 -- start start 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 0x7f1d50199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50101850 0x7f1d5019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d50102210 0x7f1d501a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5010c460 con 0x7f1d50100660 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5010c2e0 con 0x7f1d50101850 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d57eeb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5010c5e0 con 0x7f1d50102210 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 0x7f1d50199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 0x7f1d50199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34420/0 (socket says 172.21.15.42:34420) 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 -- 172.21.15.42:0/2698713783 learned_addr learned my addr 172.21.15.42:0/2698713783 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55486640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50101850 0x7f1d5019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d56488640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d50102210 0x7f1d501a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 -- 172.21.15.42:0/2698713783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d50102210 msgr2=0x7f1d501a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d50102210 0x7f1d501a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 -- 172.21.15.42:0/2698713783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50101850 msgr2=0x7f1d5019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50101850 0x7f1d5019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.501+0000 7f1d55c87640 1 -- 172.21.15.42:0/2698713783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d501a1930 con 0x7f1d50100660 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.502+0000 7f1d55c87640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 0x7f1d50199d20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00d950 tx=0x7f1d4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.502+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c017070 con 0x7f1d50100660 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.502+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d501a1c20 con 0x7f1d50100660 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.502+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d4c009c30 con 0x7f1d50100660 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.502+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00f6b0 con 0x7f1d50100660 2024-03-31T23:15:46.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.502+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501a2120 con 0x7f1d50100660 2024-03-31T23:15:46.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.503+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d501a22f0 con 0x7f1d50100660 2024-03-31T23:15:46.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.504+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f1d4c01a070 con 0x7f1d50100660 2024-03-31T23:15:46.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.504+0000 7f1d46ffd640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d3c0a24a0 0x7f1d3c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.505+0000 7f1d55486640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d3c0a24a0 0x7f1d3c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.505+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f1d4c0ce3d0 con 0x7f1d50100660 2024-03-31T23:15:46.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.505+0000 7f1d55486640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d3c0a24a0 0x7f1d3c0a4960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009530 tx=0x7f1d40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.509+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1d4c009de0 con 0x7f1d50100660 2024-03-31T23:15:46.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:46 smithi094 ceph-mon[36167]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s wr, 5 op/s 2024-03-31T23:15:46.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.691+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1d501a2680 con 0x7f1d50100660 2024-03-31T23:15:46.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.691+0000 7f1d46ffd640 1 -- 172.21.15.42:0/2698713783 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f1d4c09ad00 con 0x7f1d50100660 2024-03-31T23:15:46.692 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:15:46.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d3c0a24a0 msgr2=0x7f1d3c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d3c0a24a0 0x7f1d3c0a4960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009530 tx=0x7f1d40009260 comp rx=0 tx=0).stop 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 msgr2=0x7f1d50199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 0x7f1d50199d20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00d950 tx=0x7f1d4c00de10 comp rx=0 tx=0).stop 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 shutdown_connections 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d50102210 0x7f1d501a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d50101850 0x7f1d5019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1d3c0a24a0 0x7f1d3c0a4960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 --2- 172.21.15.42:0/2698713783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d50100660 0x7f1d50199d20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 >> 172.21.15.42:0/2698713783 conn(0x7f1d500fbbd0 msgr2=0x7f1d500fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 shutdown_connections 2024-03-31T23:15:46.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.694+0000 7f1d57eeb640 1 -- 172.21.15.42:0/2698713783 wait complete. 2024-03-31T23:15:46.705 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:15:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1906803495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df81001c0 msgr2=0x7f3df8109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1906803495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df81001c0 0x7f3df8109d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009ca0 tx=0x7f3de802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1906803495 shutdown_connections 2024-03-31T23:15:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1906803495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df81001c0 0x7f3df8109d70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1906803495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df80ff800 0x7f3df80ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1906803495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3df8102d90 0x7f3df81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1906803495 >> 172.21.15.42:0/1906803495 conn(0x7f3df80fb380 msgr2=0x7f3df80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1906803495 shutdown_connections 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.810+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1906803495 wait complete. 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 Processor -- start 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 -- start start 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 0x7f3df8197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df81001c0 0x7f3df8197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3df8102d90 0x7f3df819f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3df810d500 con 0x7f3df80ff800 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3df810d380 con 0x7f3df81001c0 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3dfccd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3df810d680 con 0x7f3df8102d90 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.811+0000 7f3df659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 0x7f3df8197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 0x7f3df8197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34436/0 (socket says 172.21.15.42:34436) 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 -- 172.21.15.42:0/1483653054 learned_addr learned my addr 172.21.15.42:0/1483653054 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df6d9d640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3df8102d90 0x7f3df819f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df5d9b640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df81001c0 0x7f3df8197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 -- 172.21.15.42:0/1483653054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3df8102d90 msgr2=0x7f3df819f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3df8102d90 0x7f3df819f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 -- 172.21.15.42:0/1483653054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df81001c0 msgr2=0x7f3df8197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df81001c0 0x7f3df8197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 -- 172.21.15.42:0/1483653054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df819f6d0 con 0x7f3df80ff800 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df5d9b640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df81001c0 0x7f3df8197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3df659c640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 0x7f3df8197ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d770 tx=0x7f3df000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0017070 con 0x7f3df80ff800 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3df0009c30 con 0x7f3df80ff800 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df819f9c0 con 0x7f3df80ff800 2024-03-31T23:15:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0003e40 con 0x7f3df80ff800 2024-03-31T23:15:46.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.812+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df819ff10 con 0x7f3df80ff800 2024-03-31T23:15:46.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.813+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df8068990 con 0x7f3df80ff800 2024-03-31T23:15:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.814+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f3df0004000 con 0x7f3df80ff800 2024-03-31T23:15:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.815+0000 7f3de77fe640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3de00a24a0 0x7f3de00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.815+0000 7f3df5d9b640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3de00a24a0 0x7f3de00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.815+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f3df00ce220 con 0x7f3df80ff800 2024-03-31T23:15:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.815+0000 7f3df5d9b640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3de00a24a0 0x7f3de00a4960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3df8198fc0 tx=0x7f3dec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:46.820+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3df0009de0 con 0x7f3df80ff800 2024-03-31T23:15:47.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.002+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3df8062350 con 0x7f3df80ff800 2024-03-31T23:15:47.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.002+0000 7f3de77fe640 1 -- 172.21.15.42:0/1483653054 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f3df009ab50 con 0x7f3df80ff800 2024-03-31T23:15:47.003 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3de00a24a0 msgr2=0x7f3de00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3de00a24a0 0x7f3de00a4960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3df8198fc0 tx=0x7f3dec005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 msgr2=0x7f3df8197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 0x7f3df8197ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d770 tx=0x7f3df000dc30 comp rx=0 tx=0).stop 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 shutdown_connections 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3df8102d90 0x7f3df819f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3df81001c0 0x7f3df8197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f3de00a24a0 0x7f3de00a4960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 --2- 172.21.15.42:0/1483653054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3df80ff800 0x7f3df8197ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 >> 172.21.15.42:0/1483653054 conn(0x7f3df80fb380 msgr2=0x7f3df8105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 shutdown_connections 2024-03-31T23:15:47.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.004+0000 7f3dfccd6640 1 -- 172.21.15.42:0/1483653054 wait complete. 2024-03-31T23:15:47.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:15:47.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 -- 172.21.15.42:0/1502320281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598101840 msgr2=0x7f8598101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 --2- 172.21.15.42:0/1502320281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598101840 0x7f8598101cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f858c009900 tx=0x7f858c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:47.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 -- 172.21.15.42:0/1502320281 shutdown_connections 2024-03-31T23:15:47.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 --2- 172.21.15.42:0/1502320281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8598102200 0x7f8598108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 --2- 172.21.15.42:0/1502320281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598101840 0x7f8598101cc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 --2- 172.21.15.42:0/1502320281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8598100650 0x7f8598100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 -- 172.21.15.42:0/1502320281 >> 172.21.15.42:0/1502320281 conn(0x7f85980fbbc0 msgr2=0x7f85980fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 -- 172.21.15.42:0/1502320281 shutdown_connections 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.121+0000 7f859ded4640 1 -- 172.21.15.42:0/1502320281 wait complete. 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 Processor -- start 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 -- start start 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 0x7f8598199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8598101840 0x7f859819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8598102200 0x7f85981a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f859810d4c0 con 0x7f8598100650 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f859810d340 con 0x7f8598102200 2024-03-31T23:15:47.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f859ded4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f859810d640 con 0x7f8598101840 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f85977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 0x7f8598199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f85977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 0x7f8598199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34452/0 (socket says 172.21.15.42:34452) 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.122+0000 7f85977fe640 1 -- 172.21.15.42:0/2916073318 learned_addr learned my addr 172.21.15.42:0/2916073318 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f8597fff640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8598102200 0x7f85981a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f8596ffd640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8598101840 0x7f859819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f85977fe640 1 -- 172.21.15.42:0/2916073318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8598101840 msgr2=0x7f859819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f85977fe640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8598101840 0x7f859819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f85977fe640 1 -- 172.21.15.42:0/2916073318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8598102200 msgr2=0x7f85981a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f85977fe640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8598102200 0x7f85981a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f85977fe640 1 -- 172.21.15.42:0/2916073318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85981a1970 con 0x7f8598100650 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f85977fe640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 0x7f8598199d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f858800e9c0 tx=0x7f858800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858800cde0 con 0x7f8598100650 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85981a1c60 con 0x7f8598100650 2024-03-31T23:15:47.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8588010930 con 0x7f8598100650 2024-03-31T23:15:47.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588018a60 con 0x7f8598100650 2024-03-31T23:15:47.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.123+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85981a21d0 con 0x7f8598100650 2024-03-31T23:15:47.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.124+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85981a23a0 con 0x7f8598100650 2024-03-31T23:15:47.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.125+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f858801f020 con 0x7f8598100650 2024-03-31T23:15:47.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.126+0000 7f8594ff9640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85800a24a0 0x7f85800a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.126+0000 7f8596ffd640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85800a24a0 0x7f85800a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.126+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f85880cec50 con 0x7f8598100650 2024-03-31T23:15:47.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.126+0000 7f8596ffd640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85800a24a0 0x7f85800a4960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f858c006010 tx=0x7f858c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:47.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.130+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f858809bb70 con 0x7f8598100650 2024-03-31T23:15:47.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.315+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f85981a2570 con 0x7f8598100650 2024-03-31T23:15:47.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.316+0000 7f8594ff9640 1 -- 172.21.15.42:0/2916073318 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f858809b470 con 0x7f8598100650 2024-03-31T23:15:47.317 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85800a24a0 msgr2=0x7f85800a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85800a24a0 0x7f85800a4960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f858c006010 tx=0x7f858c000bc0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 msgr2=0x7f8598199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 0x7f8598199d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f858800e9c0 tx=0x7f858800ee80 comp rx=0 tx=0).stop 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 shutdown_connections 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8598102200 0x7f85981a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8598101840 0x7f859819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85800a24a0 0x7f85800a4960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 --2- 172.21.15.42:0/2916073318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8598100650 0x7f8598199d50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 >> 172.21.15.42:0/2916073318 conn(0x7f85980fbbc0 msgr2=0x7f8598109450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 shutdown_connections 2024-03-31T23:15:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.318+0000 7f859ded4640 1 -- 172.21.15.42:0/2916073318 wait complete. 2024-03-31T23:15:47.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2627303115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:47.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2698713783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:47.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1483653054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:15:47.330 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:15:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 -- 172.21.15.42:0/1750284510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0101850 msgr2=0x7f6de0101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 --2- 172.21.15.42:0/1750284510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0101850 0x7f6de0101cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009900 tx=0x7f6dd402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 -- 172.21.15.42:0/1750284510 shutdown_connections 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 --2- 172.21.15.42:0/1750284510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0102210 0x7f6de0108aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 --2- 172.21.15.42:0/1750284510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0101850 0x7f6de0101cd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 --2- 172.21.15.42:0/1750284510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6de0100660 0x7f6de0100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 -- 172.21.15.42:0/1750284510 >> 172.21.15.42:0/1750284510 conn(0x7f6de00fbbf0 msgr2=0x7f6de00fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 -- 172.21.15.42:0/1750284510 shutdown_connections 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 -- 172.21.15.42:0/1750284510 wait complete. 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 Processor -- start 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.435+0000 7f6de6525640 1 -- start start 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 0x7f6de0196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0101850 0x7f6de0196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6de0102210 0x7f6de019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6de010c3c0 con 0x7f6de0100660 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6de010c240 con 0x7f6de0101850 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6de010c540 con 0x7f6de0102210 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 0x7f6de0196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 0x7f6de0196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34468/0 (socket says 172.21.15.42:34468) 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 -- 172.21.15.42:0/3388501412 learned_addr learned my addr 172.21.15.42:0/3388501412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddf7fe640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0101850 0x7f6de0196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de4ac2640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6de0102210 0x7f6de019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 -- 172.21.15.42:0/3388501412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6de0102210 msgr2=0x7f6de019e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6de0102210 0x7f6de019e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 -- 172.21.15.42:0/3388501412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0101850 msgr2=0x7f6de0196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0101850 0x7f6de0196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 -- 172.21.15.42:0/3388501412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de019e690 con 0x7f6de0100660 2024-03-31T23:15:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddf7fe640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0101850 0x7f6de0196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddffff640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 0x7f6de0196a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009850 tx=0x7f6dd0009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd001d070 con 0x7f6de0100660 2024-03-31T23:15:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6dd0007ca0 con 0x7f6de0100660 2024-03-31T23:15:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de0069d80 con 0x7f6de0100660 2024-03-31T23:15:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0016320 con 0x7f6de0100660 2024-03-31T23:15:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.436+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de006a250 con 0x7f6de0100660 2024-03-31T23:15:47.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.437+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de0068990 con 0x7f6de0100660 2024-03-31T23:15:47.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.438+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f6dd0020070 con 0x7f6de0100660 2024-03-31T23:15:47.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.439+0000 7f6ddd7fa640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6dc80a24a0 0x7f6dc80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.439+0000 7f6ddf7fe640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6dc80a24a0 0x7f6dc80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.439+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f6dd00d03c0 con 0x7f6de0100660 2024-03-31T23:15:47.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.439+0000 7f6ddf7fe640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6dc80a24a0 0x7f6dc80a4960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6dd402c900 tx=0x7f6dd4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:47.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.443+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6dd0027070 con 0x7f6de0100660 2024-03-31T23:15:47.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2627303115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:47.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2698713783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:47.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1483653054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:15:47.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.625+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6de0107700 con 0x7f6de0100660 2024-03-31T23:15:47.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.625+0000 7f6ddd7fa640 1 -- 172.21.15.42:0/3388501412 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f6dd009ccf0 con 0x7f6de0100660 2024-03-31T23:15:47.626 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6dc80a24a0 msgr2=0x7f6dc80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6dc80a24a0 0x7f6dc80a4960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6dd402c900 tx=0x7f6dd4005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 msgr2=0x7f6de0196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 0x7f6de0196a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009850 tx=0x7f6dd0009d10 comp rx=0 tx=0).stop 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 shutdown_connections 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6de0102210 0x7f6de019e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6de0101850 0x7f6de0196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6dc80a24a0 0x7f6dc80a4960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 --2- 172.21.15.42:0/3388501412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6de0100660 0x7f6de0196a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 >> 172.21.15.42:0/3388501412 conn(0x7f6de00fbbf0 msgr2=0x7f6de0104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 shutdown_connections 2024-03-31T23:15:47.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.627+0000 7f6de6525640 1 -- 172.21.15.42:0/3388501412 wait complete. 2024-03-31T23:15:47.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T23:15:47.671 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2627303115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:47.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2698713783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:47.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1483653054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:15:47.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 -- 172.21.15.42:0/2429674775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc102950 msgr2=0x7f2acc102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/2429674775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc102950 0x7f2acc102dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009900 tx=0x7f2abc02bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:47.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 -- 172.21.15.42:0/2429674775 shutdown_connections 2024-03-31T23:15:47.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/2429674775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2acc103310 0x7f2acc109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/2429674775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc102950 0x7f2acc102dd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/2429674775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2acc101760 0x7f2acc101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 -- 172.21.15.42:0/2429674775 >> 172.21.15.42:0/2429674775 conn(0x7f2acc0fccf0 msgr2=0x7f2acc0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 -- 172.21.15.42:0/2429674775 shutdown_connections 2024-03-31T23:15:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.742+0000 7f2ad2e15640 1 -- 172.21.15.42:0/2429674775 wait complete. 2024-03-31T23:15:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 Processor -- start 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 -- start start 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2acc101760 0x7f2acc197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2acc102950 0x7f2acc198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 0x7f2acc19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10d4c0 con 0x7f2acc103310 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10d340 con 0x7f2acc101760 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad2e15640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10d640 con 0x7f2acc102950 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 0x7f2acc19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 0x7f2acc19f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34494/0 (socket says 172.21.15.42:34494) 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 -- 172.21.15.42:0/1940858380 learned_addr learned my addr 172.21.15.42:0/1940858380 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad0bb1640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2acc101760 0x7f2acc197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2acbfff640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2acc102950 0x7f2acc198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 -- 172.21.15.42:0/1940858380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2acc102950 msgr2=0x7f2acc198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2acc102950 0x7f2acc198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 -- 172.21.15.42:0/1940858380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2acc101760 msgr2=0x7f2acc197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2acc101760 0x7f2acc197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.743+0000 7f2ad13b2640 1 -- 172.21.15.42:0/1940858380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc19f760 con 0x7f2acc103310 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.744+0000 7f2ad13b2640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 0x7f2acc19f0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400cce0 tx=0x7f2ac400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.744+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400f450 con 0x7f2acc103310 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.744+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2ac400faf0 con 0x7f2acc103310 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.744+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc19fa50 con 0x7f2acc103310 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.744+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4018cc0 con 0x7f2acc103310 2024-03-31T23:15:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.744+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc19ff70 con 0x7f2acc103310 2024-03-31T23:15:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.745+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc108a80 con 0x7f2acc103310 2024-03-31T23:15:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.746+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f2ac400f5f0 con 0x7f2acc103310 2024-03-31T23:15:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.747+0000 7f2ac9ffb640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2ab80a2520 0x7f2ab80a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.747+0000 7f2ad0bb1640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2ab80a2520 0x7f2ab80a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.747+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f2ac40cee30 con 0x7f2acc103310 2024-03-31T23:15:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.747+0000 7f2ad0bb1640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2ab80a2520 0x7f2ab80a49e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40095f0 tx=0x7f2ab4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.751+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2ac4014030 con 0x7f2acc103310 2024-03-31T23:15:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.945+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2acc02d170 con 0x7f2acc103310 2024-03-31T23:15:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.945+0000 7f2ac9ffb640 1 -- 172.21.15.42:0/1940858380 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+588 (secure 0 0 0) 0x7f2ac409bd50 con 0x7f2acc103310 2024-03-31T23:15:47.946 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/1517474041 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:47.946 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/1517474041 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:47.946 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1353829037 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3347343211 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/99599854 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/510916434 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/355558561 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/3342764964 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/3342764964 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3890423578 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:47.947 INFO:teuthology.orchestra.run.smithi042.stderr:listed 10 entries 2024-03-31T23:15:47.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2ab80a2520 msgr2=0x7f2ab80a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2ab80a2520 0x7f2ab80a49e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40095f0 tx=0x7f2ab4005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:47.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 msgr2=0x7f2acc19f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:47.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 0x7f2acc19f0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400cce0 tx=0x7f2ac400a620 comp rx=0 tx=0).stop 2024-03-31T23:15:47.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 shutdown_connections 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2ab80a2520 0x7f2ab80a49e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2acc103310 0x7f2acc19f0f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2acc102950 0x7f2acc198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 --2- 172.21.15.42:0/1940858380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2acc101760 0x7f2acc197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 >> 172.21.15.42:0/1940858380 conn(0x7f2acc0fccf0 msgr2=0x7f2acc105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 shutdown_connections 2024-03-31T23:15:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:47.947+0000 7f2ad2e15640 1 -- 172.21.15.42:0/1940858380 wait complete. 2024-03-31T23:15:47.959 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:15:47.959 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T23:15:47.974 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:48.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 -- 172.21.15.42:0/1858762630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701006f0 msgr2=0x7f6570100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 --2- 172.21.15.42:0/1858762630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701006f0 0x7f6570100b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6560009900 tx=0x7f656002bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 -- 172.21.15.42:0/1858762630 shutdown_connections 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 --2- 172.21.15.42:0/1858762630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65701022a0 0x7f6570108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 --2- 172.21.15.42:0/1858762630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701018e0 0x7f6570101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 --2- 172.21.15.42:0/1858762630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701006f0 0x7f6570100b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 -- 172.21.15.42:0/1858762630 >> 172.21.15.42:0/1858762630 conn(0x7f65700fbc80 msgr2=0x7f65700fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 -- 172.21.15.42:0/1858762630 shutdown_connections 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.116+0000 7f65749c9640 1 -- 172.21.15.42:0/1858762630 wait complete. 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 Processor -- start 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 -- start start 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65701006f0 0x7f6570197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 0x7f65701980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701022a0 0x7f657019f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f657010d4f0 con 0x7f65701018e0 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f657010d370 con 0x7f65701022a0 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f65749c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f657010d670 con 0x7f65701006f0 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 0x7f65701980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 0x7f65701980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34508/0 (socket says 172.21.15.42:34508) 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 -- 172.21.15.42:0/2988449857 learned_addr learned my addr 172.21.15.42:0/2988449857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656ed9d640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701022a0 0x7f657019f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656e59c640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65701006f0 0x7f6570197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 -- 172.21.15.42:0/2988449857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65701006f0 msgr2=0x7f6570197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65701006f0 0x7f6570197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 -- 172.21.15.42:0/2988449857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701022a0 msgr2=0x7f657019f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701022a0 0x7f657019f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 -- 172.21.15.42:0/2988449857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657019f7c0 con 0x7f65701018e0 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656ed9d640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701022a0 0x7f657019f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.117+0000 7f656dd9b640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 0x7f65701980e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f656400e9f0 tx=0x7f656400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.118+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400cd80 con 0x7f65701018e0 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.118+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657019fab0 con 0x7f65701018e0 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.118+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6564010930 con 0x7f65701018e0 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.118+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564018b00 con 0x7f65701018e0 2024-03-31T23:15:48.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.118+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65701a0000 con 0x7f65701018e0 2024-03-31T23:15:48.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.119+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65701079b0 con 0x7f65701018e0 2024-03-31T23:15:48.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.120+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f6564018ca0 con 0x7f65701018e0 2024-03-31T23:15:48.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.120+0000 7f655f7fe640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f65580a24a0 0x7f65580a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.120+0000 7f656e59c640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f65580a24a0 0x7f65580a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.120+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f65640cefc0 con 0x7f65701018e0 2024-03-31T23:15:48.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.121+0000 7f656e59c640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f65580a24a0 0x7f65580a4960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6560005ab0 tx=0x7f6560005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:48.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.124+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f656409b8f0 con 0x7f65701018e0 2024-03-31T23:15:48.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.311+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f657002d340 con 0x7f65701018e0 2024-03-31T23:15:48.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.313+0000 7f655f7fe640 1 -- 172.21.15.42:0/2988449857 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f656409f990 con 0x7f65701018e0 2024-03-31T23:15:48.314 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:48.314 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f65580a24a0 msgr2=0x7f65580a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f65580a24a0 0x7f65580a4960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6560005ab0 tx=0x7f6560005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 msgr2=0x7f65701980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 0x7f65701980e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f656400e9f0 tx=0x7f656400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 shutdown_connections 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701022a0 0x7f657019f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f65580a24a0 0x7f65580a4960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65701018e0 0x7f65701980e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 --2- 172.21.15.42:0/2988449857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65701006f0 0x7f6570197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 >> 172.21.15.42:0/2988449857 conn(0x7f65700fbc80 msgr2=0x7f6570104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:48.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 shutdown_connections 2024-03-31T23:15:48.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.315+0000 7f65749c9640 1 -- 172.21.15.42:0/2988449857 wait complete. 2024-03-31T23:15:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:48 smithi042 ceph-mon[32380]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 713 B/s wr, 1 op/s 2024-03-31T23:15:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2916073318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:15:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3388501412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:15:48.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1940858380' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:15:48.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:15:48.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- 172.21.15.42:0/47828799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 msgr2=0x7ff5cc100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/47828799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc100a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009ca0 tx=0x7ff5bc02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- 172.21.15.42:0/47828799 shutdown_connections 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/47828799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc102200 0x7ff5cc108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/47828799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5cc101840 0x7ff5cc101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/47828799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc100a70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- 172.21.15.42:0/47828799 >> 172.21.15.42:0/47828799 conn(0x7ff5cc0fbbe0 msgr2=0x7ff5cc0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- 172.21.15.42:0/47828799 shutdown_connections 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- 172.21.15.42:0/47828799 wait complete. 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 Processor -- start 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- start start 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc1045e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc101840 0x7ff5cc102c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5cc102200 0x7ff5cc103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.433+0000 7ff5d17c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc10c400 con 0x7ff5cc100650 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5d17c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc10c280 con 0x7ff5cc101840 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5d17c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc10c580 con 0x7ff5cc102200 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5caffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc1045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc101840 0x7ff5cc102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5caffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc1045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34530/0 (socket says 172.21.15.42:34530) 2024-03-31T23:15:48.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5caffd640 1 -- 172.21.15.42:0/1170302464 learned_addr learned my addr 172.21.15.42:0/1170302464 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5cb7fe640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5cc102200 0x7ff5cc103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 -- 172.21.15.42:0/1170302464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5cc102200 msgr2=0x7ff5cc103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5cc102200 0x7ff5cc103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 -- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 msgr2=0x7ff5cc1045e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc1045e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 -- 172.21.15.42:0/1170302464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc1039f0 con 0x7ff5cc101840 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5caffd640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc1045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5ca7fc640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc101840 0x7ff5cc102c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400e9f0 tx=0x7ff5b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400ccc0 con 0x7ff5cc101840 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc1a1d20 con 0x7ff5cc101840 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5b4005020 con 0x7ff5cc101840 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4004b40 con 0x7ff5cc101840 2024-03-31T23:15:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.434+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc1a21c0 con 0x7ff5cc101840 2024-03-31T23:15:48.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.435+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5cc1a24b0 con 0x7ff5cc101840 2024-03-31T23:15:48.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.436+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7ff5b4004ce0 con 0x7ff5cc101840 2024-03-31T23:15:48.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.437+0000 7ff5c3fff640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff5b80a24a0 0x7ff5b80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.437+0000 7ff5caffd640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff5b80a24a0 0x7ff5b80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.437+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff5b40ce950 con 0x7ff5cc101840 2024-03-31T23:15:48.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.437+0000 7ff5caffd640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff5b80a24a0 0x7ff5b80a4960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc006010 tx=0x7ff5bc004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:48.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.445+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff5b409b870 con 0x7ff5cc101840 2024-03-31T23:15:48.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:48 smithi188 ceph-mon[36068]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 713 B/s wr, 1 op/s 2024-03-31T23:15:48.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2916073318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:15:48.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3388501412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:15:48.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1940858380' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:15:48.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.628+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5cc1a2840 con 0x7ff5cc101840 2024-03-31T23:15:48.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.628+0000 7ff5c3fff640 1 -- 172.21.15.42:0/1170302464 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7ff5b409b170 con 0x7ff5cc101840 2024-03-31T23:15:48.629 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:15:48.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.630+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff5b80a24a0 msgr2=0x7ff5b80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.630+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff5b80a24a0 0x7ff5b80a4960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc006010 tx=0x7ff5bc004a40 comp rx=0 tx=0).stop 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.630+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc101840 msgr2=0x7ff5cc102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.630+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc101840 0x7ff5cc102c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400e9f0 tx=0x7ff5b400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.630+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 shutdown_connections 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5cc102200 0x7ff5cc103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5cc101840 0x7ff5cc102c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff5b80a24a0 0x7ff5b80a4960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 --2- 172.21.15.42:0/1170302464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5cc100650 0x7ff5cc1045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 >> 172.21.15.42:0/1170302464 conn(0x7ff5cc0fbbe0 msgr2=0x7ff5cc0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 shutdown_connections 2024-03-31T23:15:48.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.631+0000 7ff5d17c9640 1 -- 172.21.15.42:0/1170302464 wait complete. 2024-03-31T23:15:48.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:15:48.671 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:48 smithi094 ceph-mon[36167]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 713 B/s wr, 1 op/s 2024-03-31T23:15:48.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2916073318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:15:48.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3388501412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:15:48.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1940858380' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:15:48.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 -- 172.21.15.42:0/3200996868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 msgr2=0x7f9974109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 --2- 172.21.15.42:0/3200996868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f9974109ba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9964009ca0 tx=0x7f996402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 -- 172.21.15.42:0/3200996868 shutdown_connections 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 --2- 172.21.15.42:0/3200996868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f9974109ba0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 --2- 172.21.15.42:0/3200996868 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974102950 0x7f9974102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 --2- 172.21.15.42:0/3200996868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9974101760 0x7f9974101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 -- 172.21.15.42:0/3200996868 >> 172.21.15.42:0/3200996868 conn(0x7f99740fccf0 msgr2=0x7f99740ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 -- 172.21.15.42:0/3200996868 shutdown_connections 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.747+0000 7f997895e640 1 -- 172.21.15.42:0/3200996868 wait complete. 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 Processor -- start 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 -- start start 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974101760 0x7f9974197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9974102950 0x7f9974197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f997419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f997410d510 con 0x7f9974103310 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f997410d390 con 0x7f9974102950 2024-03-31T23:15:48.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f997895e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f997410d690 con 0x7f9974101760 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f9972d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f997419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f9972d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f997419f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34536/0 (socket says 172.21.15.42:34536) 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f9972d9d640 1 -- 172.21.15.42:0/2747107485 learned_addr learned my addr 172.21.15.42:0/2747107485 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.748+0000 7f9971d9b640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9974102950 0x7f9974197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f997259c640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974101760 0x7f9974197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f9972d9d640 1 -- 172.21.15.42:0/2747107485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974101760 msgr2=0x7f9974197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f9972d9d640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974101760 0x7f9974197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f9972d9d640 1 -- 172.21.15.42:0/2747107485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9974102950 msgr2=0x7f9974197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f9972d9d640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9974102950 0x7f9974197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f9972d9d640 1 -- 172.21.15.42:0/2747107485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997419f690 con 0x7f9974103310 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f997259c640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974101760 0x7f9974197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f9972d9d640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f997419f020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f996402c700 tx=0x7f99640346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964039040 con 0x7f9974103310 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9964044070 con 0x7f9974103310 2024-03-31T23:15:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997419f920 con 0x7f9974103310 2024-03-31T23:15:48.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964004400 con 0x7f9974103310 2024-03-31T23:15:48.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.749+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997419fe10 con 0x7f9974103310 2024-03-31T23:15:48.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.750+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99741089b0 con 0x7f9974103310 2024-03-31T23:15:48.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.751+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f99640045c0 con 0x7f9974103310 2024-03-31T23:15:48.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.752+0000 7f996b7fe640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f99600a24a0 0x7f99600a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:48.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.752+0000 7f997259c640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f99600a24a0 0x7f99600a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:48.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.752+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f99640f10f0 con 0x7f9974103310 2024-03-31T23:15:48.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.752+0000 7f997259c640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f99600a24a0 0x7f99600a4960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99741027b0 tx=0x7f996c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.756+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f99640be070 con 0x7f9974103310 2024-03-31T23:15:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.939+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9974062350 con 0x7f9974103310 2024-03-31T23:15:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.940+0000 7f996b7fe640 1 -- 172.21.15.42:0/2747107485 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f99640bd970 con 0x7f9974103310 2024-03-31T23:15:48.941 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:15:48.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f99600a24a0 msgr2=0x7f99600a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f99600a24a0 0x7f99600a4960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99741027b0 tx=0x7f996c005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 msgr2=0x7f997419f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f997419f020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f996402c700 tx=0x7f99640346d0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 shutdown_connections 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f99600a24a0 0x7f99600a4960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9974103310 0x7f997419f020 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9974102950 0x7f9974197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 --2- 172.21.15.42:0/2747107485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9974101760 0x7f9974197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 >> 172.21.15.42:0/2747107485 conn(0x7f99740fccf0 msgr2=0x7f9974105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 shutdown_connections 2024-03-31T23:15:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:48.942+0000 7f997895e640 1 -- 172.21.15.42:0/2747107485 wait complete. 2024-03-31T23:15:48.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.058+0000 7f0aec67c640 1 -- 172.21.15.42:0/3055698290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae4104b20 msgr2=0x7f0ae4106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.058+0000 7f0aec67c640 1 --2- 172.21.15.42:0/3055698290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae4104b20 0x7f0ae4106f10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009900 tx=0x7f0ad402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- 172.21.15.42:0/3055698290 shutdown_connections 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 --2- 172.21.15.42:0/3055698290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae4107450 0x7f0ae41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 --2- 172.21.15.42:0/3055698290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae4104b20 0x7f0ae4106f10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 --2- 172.21.15.42:0/3055698290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae41021f0 0x7f0ae41045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- 172.21.15.42:0/3055698290 >> 172.21.15.42:0/3055698290 conn(0x7f0ae40fbc20 msgr2=0x7f0ae40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- 172.21.15.42:0/3055698290 shutdown_connections 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- 172.21.15.42:0/3055698290 wait complete. 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 Processor -- start 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- start start 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 0x7f0ae4197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae4104b20 0x7f0ae4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae4107450 0x7f0ae419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae410d4d0 con 0x7f0ae41021f0 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae410d350 con 0x7f0ae4104b20 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aec67c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae410d650 con 0x7f0ae4107450 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aea418640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 0x7f0ae4197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aea418640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 0x7f0ae4197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34560/0 (socket says 172.21.15.42:34560) 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0aea418640 1 -- 172.21.15.42:0/723446348 learned_addr learned my addr 172.21.15.42:0/723446348 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.059+0000 7f0ae9c17640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae4104b20 0x7f0ae4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aeac19640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae4107450 0x7f0ae419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aea418640 1 -- 172.21.15.42:0/723446348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae4107450 msgr2=0x7f0ae419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aea418640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae4107450 0x7f0ae419f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aea418640 1 -- 172.21.15.42:0/723446348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae4104b20 msgr2=0x7f0ae4198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aea418640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae4104b20 0x7f0ae4198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aea418640 1 -- 172.21.15.42:0/723446348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae419f760 con 0x7f0ae41021f0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aeac19640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae4107450 0x7f0ae419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aea418640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 0x7f0ae4197b40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c970 tx=0x7f0ae000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0007bb0 con 0x7f0ae41021f0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ae0007d50 con 0x7f0ae41021f0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000f4b0 con 0x7f0ae41021f0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae419fa50 con 0x7f0ae41021f0 2024-03-31T23:15:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.060+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae419ff70 con 0x7f0ae41021f0 2024-03-31T23:15:49.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.061+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae40fd710 con 0x7f0ae41021f0 2024-03-31T23:15:49.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.062+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f0ae00046c0 con 0x7f0ae41021f0 2024-03-31T23:15:49.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.063+0000 7f0adb7fe640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0ad00a2520 0x7f0ad00a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.063+0000 7f0ae9c17640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0ad00a2520 0x7f0ad00a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.063+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f0ae00ce670 con 0x7f0ae41021f0 2024-03-31T23:15:49.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.063+0000 7f0ae9c17640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0ad00a2520 0x7f0ad00a49e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ad402c900 tx=0x7f0ad4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.068+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0ae0014030 con 0x7f0ae41021f0 2024-03-31T23:15:49.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.253+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ae4062380 con 0x7f0ae41021f0 2024-03-31T23:15:49.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.253+0000 7f0adb7fe640 1 -- 172.21.15.42:0/723446348 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f0ae009b5f0 con 0x7f0ae41021f0 2024-03-31T23:15:49.254 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:15:49.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0ad00a2520 msgr2=0x7f0ad00a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0ad00a2520 0x7f0ad00a49e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ad402c900 tx=0x7f0ad4005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 msgr2=0x7f0ae4197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 0x7f0ae4197b40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c970 tx=0x7f0ae000ce30 comp rx=0 tx=0).stop 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 shutdown_connections 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ae4107450 0x7f0ae419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae4104b20 0x7f0ae4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0ad00a2520 0x7f0ad00a49e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 --2- 172.21.15.42:0/723446348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ae41021f0 0x7f0ae4197b40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 >> 172.21.15.42:0/723446348 conn(0x7f0ae40fbc20 msgr2=0x7f0ae4102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 shutdown_connections 2024-03-31T23:15:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.256+0000 7f0aec67c640 1 -- 172.21.15.42:0/723446348 wait complete. 2024-03-31T23:15:49.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:49 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2988449857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:49.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:49 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1170302464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:49.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:49 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2747107485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:15:49.267 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:15:49.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 -- 172.21.15.42:0/3854938795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954102220 msgr2=0x7f2954108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 --2- 172.21.15.42:0/3854938795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954102220 0x7f2954108ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f294c009ca0 tx=0x7f294c02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 -- 172.21.15.42:0/3854938795 shutdown_connections 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 --2- 172.21.15.42:0/3854938795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954102220 0x7f2954108ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 --2- 172.21.15.42:0/3854938795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2954101860 0x7f2954101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 --2- 172.21.15.42:0/3854938795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2954100670 0x7f2954100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 -- 172.21.15.42:0/3854938795 >> 172.21.15.42:0/3854938795 conn(0x7f29540fbc00 msgr2=0x7f29540fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 -- 172.21.15.42:0/3854938795 shutdown_connections 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.372+0000 7f2959f16640 1 -- 172.21.15.42:0/3854938795 wait complete. 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 Processor -- start 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 -- start start 2024-03-31T23:15:49.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 0x7f2954197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2954101860 0x7f2954197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2954102220 0x7f295419f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f295410c420 con 0x7f2954100670 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f295410c2a0 con 0x7f2954102220 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2959f16640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f295410c5a0 con 0x7f2954101860 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 0x7f2954197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 0x7f2954197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34582/0 (socket says 172.21.15.42:34582) 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 -- 172.21.15.42:0/1941386025 learned_addr learned my addr 172.21.15.42:0/1941386025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2953fff640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2954102220 0x7f295419f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f2952ffd640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2954101860 0x7f2954197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 -- 172.21.15.42:0/1941386025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2954101860 msgr2=0x7f2954197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2954101860 0x7f2954197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 -- 172.21.15.42:0/1941386025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2954102220 msgr2=0x7f295419f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2954102220 0x7f295419f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.373+0000 7f29537fe640 1 -- 172.21.15.42:0/1941386025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295419f6a0 con 0x7f2954100670 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.374+0000 7f29537fe640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 0x7f2954197a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f294400e9c0 tx=0x7f294400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.374+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294400ccc0 con 0x7f2954100670 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.374+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295419f990 con 0x7f2954100670 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.374+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29440035f0 con 0x7f2954100670 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.374+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294400ce60 con 0x7f2954100670 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.374+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295419ff30 con 0x7f2954100670 2024-03-31T23:15:49.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.375+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2954068990 con 0x7f2954100670 2024-03-31T23:15:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.376+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f29440037a0 con 0x7f2954100670 2024-03-31T23:15:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.376+0000 7f2950ff9640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f293c0a24a0 0x7f293c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.377+0000 7f2952ffd640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f293c0a24a0 0x7f293c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.377+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f29440cee40 con 0x7f2954100670 2024-03-31T23:15:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.377+0000 7f2952ffd640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f293c0a24a0 0x7f293c0a4960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2954198f90 tx=0x7f294800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:49.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.380+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f294409be50 con 0x7f2954100670 2024-03-31T23:15:49.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:49 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2988449857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:49.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:49 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1170302464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:49.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:49 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2747107485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:15:49.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.562+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f29541a01c0 con 0x7f2954100670 2024-03-31T23:15:49.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.562+0000 7f2950ff9640 1 -- 172.21.15.42:0/1941386025 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f294409b750 con 0x7f2954100670 2024-03-31T23:15:49.563 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:15:49.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f293c0a24a0 msgr2=0x7f293c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f293c0a24a0 0x7f293c0a4960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2954198f90 tx=0x7f294800a2d0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 msgr2=0x7f2954197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 0x7f2954197a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f294400e9c0 tx=0x7f294400edc0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 shutdown_connections 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2954102220 0x7f295419f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2954101860 0x7f2954197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f293c0a24a0 0x7f293c0a4960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 --2- 172.21.15.42:0/1941386025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2954100670 0x7f2954197a80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 >> 172.21.15.42:0/1941386025 conn(0x7f29540fbc00 msgr2=0x7f29540fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 shutdown_connections 2024-03-31T23:15:49.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.564+0000 7f2959f16640 1 -- 172.21.15.42:0/1941386025 wait complete. 2024-03-31T23:15:49.576 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T23:15:49.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:49 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2988449857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:49.718 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:49 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1170302464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:15:49.718 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:49 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2747107485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:15:49.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 -- 172.21.15.42:0/3388740197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c1021d0 msgr2=0x7f1e6c1045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 --2- 172.21.15.42:0/3388740197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c1045c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009900 tx=0x7f1e6402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:49.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 -- 172.21.15.42:0/3388740197 shutdown_connections 2024-03-31T23:15:49.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 --2- 172.21.15.42:0/3388740197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6c107430 0x7f1e6c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 --2- 172.21.15.42:0/3388740197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c104b00 0x7f1e6c106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 --2- 172.21.15.42:0/3388740197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c1045c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 -- 172.21.15.42:0/3388740197 >> 172.21.15.42:0/3388740197 conn(0x7f1e6c0fbbe0 msgr2=0x7f1e6c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 -- 172.21.15.42:0/3388740197 shutdown_connections 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 -- 172.21.15.42:0/3388740197 wait complete. 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.680+0000 7f1e719ac640 1 Processor -- start 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 -- start start 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6c104b00 0x7f1e6c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 0x7f1e6c19f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c10d4b0 con 0x7f1e6c107430 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c10d330 con 0x7f1e6c1021d0 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e719ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c10d630 con 0x7f1e6c104b00 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 0x7f1e6c19f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 0x7f1e6c19f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34608/0 (socket says 172.21.15.42:34608) 2024-03-31T23:15:49.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 -- 172.21.15.42:0/167045943 learned_addr learned my addr 172.21.15.42:0/167045943 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6affd640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6a7fc640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6c104b00 0x7f1e6c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 -- 172.21.15.42:0/167045943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6c104b00 msgr2=0x7f1e6c1980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6c104b00 0x7f1e6c1980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 -- 172.21.15.42:0/167045943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c1021d0 msgr2=0x7f1e6c197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 -- 172.21.15.42:0/167045943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c19f7b0 con 0x7f1e6c107430 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6affd640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.681+0000 7f1e6b7fe640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 0x7f1e6c19f140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009fd0 tx=0x7f1e5c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.682+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c017070 con 0x7f1e6c107430 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.682+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e5c004020 con 0x7f1e6c107430 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.682+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6c19faa0 con 0x7f1e6c107430 2024-03-31T23:15:49.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.682+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0106c0 con 0x7f1e6c107430 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.682+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e6c19fff0 con 0x7f1e6c107430 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.683+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e6c0fd6d0 con 0x7f1e6c107430 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.684+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f1e5c0041d0 con 0x7f1e6c107430 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.684+0000 7f1e709aa640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1e580a2520 0x7f1e580a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.684+0000 7f1e6affd640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1e580a2520 0x7f1e580a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.684+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f1e5c0ce600 con 0x7f1e6c107430 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.685+0000 7f1e6affd640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1e580a2520 0x7f1e580a49e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e6402c900 tx=0x7f1e64005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:49.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.689+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1e5c09b580 con 0x7f1e6c107430 2024-03-31T23:15:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.887+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1e6c062350 con 0x7f1e6c107430 2024-03-31T23:15:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.888+0000 7f1e709aa640 1 -- 172.21.15.42:0/167045943 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+588 (secure 0 0 0) 0x7f1e5c09ae80 con 0x7f1e6c107430 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/1517474041 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/1517474041 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1353829037 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3347343211 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/99599854 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/510916434 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/355558561 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/3342764964 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/3342764964 2024-04-01T23:08:14.773907+0000 2024-03-31T23:15:49.889 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3890423578 2024-04-01T23:08:40.680947+0000 2024-03-31T23:15:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:listed 10 entries 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1e580a2520 msgr2=0x7f1e580a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1e580a2520 0x7f1e580a49e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e6402c900 tx=0x7f1e64005fd0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 msgr2=0x7f1e6c19f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 0x7f1e6c19f140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009fd0 tx=0x7f1e5c00b260 comp rx=0 tx=0).stop 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 shutdown_connections 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1e580a2520 0x7f1e580a49e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e6c107430 0x7f1e6c19f140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6c104b00 0x7f1e6c1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 --2- 172.21.15.42:0/167045943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e6c1021d0 0x7f1e6c197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 >> 172.21.15.42:0/167045943 conn(0x7f1e6c0fbbe0 msgr2=0x7f1e6c102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 shutdown_connections 2024-03-31T23:15:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:49.890+0000 7f1e719ac640 1 -- 172.21.15.42:0/167045943 wait complete. 2024-03-31T23:15:49.901 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi042.front.sepia.ceph.com... 2024-03-31T23:15:49.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:49.902 DEBUG:teuthology.orchestra.run.smithi042:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-31T23:15:49.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[73819]: fuse finished with error 0 and tester_r 0 2024-03-31T23:15:49.928 INFO:teuthology.orchestra.run:waiting for 300 2024-03-31T23:15:50.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:50 smithi188 ceph-mon[36068]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-03-31T23:15:50.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:50 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/723446348' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:15:50.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:50 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1941386025' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:15:50.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:50 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/167045943' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:15:50.573 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:50 smithi094 ceph-mon[36167]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-03-31T23:15:50.573 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:50 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/723446348' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:15:50.573 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:50 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1941386025' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:15:50.573 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:50 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/167045943' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:15:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:50 smithi042 ceph-mon[32380]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-03-31T23:15:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:50 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/723446348' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:15:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:50 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1941386025' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:15:50.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:50 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/167045943' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:15:52.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:52 smithi188 ceph-mon[36068]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 264 B/s wr, 0 op/s 2024-03-31T23:15:52.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:52 smithi042 ceph-mon[32380]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 264 B/s wr, 0 op/s 2024-03-31T23:15:52.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:52 smithi094 ceph-mon[36167]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 264 B/s wr, 0 op/s 2024-03-31T23:15:54.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:54 smithi188 ceph-mon[36068]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-03-31T23:15:54.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:54 smithi042 ceph-mon[32380]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-03-31T23:15:54.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:54 smithi094 ceph-mon[36167]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-03-31T23:15:56.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:15:56.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:15:56.031 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-31T23:15:56.059 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:56.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 -- 172.21.15.42:0/2125146392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc102950 msgr2=0x7fc2bc102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/2125146392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc102950 0x7fc2bc102dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009900 tx=0x7fc2a402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:56.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 -- 172.21.15.42:0/2125146392 shutdown_connections 2024-03-31T23:15:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/2125146392 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2bc103310 0x7fc2bc109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/2125146392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc102950 0x7fc2bc102dd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/2125146392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc101760 0x7fc2bc101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 -- 172.21.15.42:0/2125146392 >> 172.21.15.42:0/2125146392 conn(0x7fc2bc0fcd30 msgr2=0x7fc2bc0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 -- 172.21.15.42:0/2125146392 shutdown_connections 2024-03-31T23:15:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.214+0000 7fc2c0d65640 1 -- 172.21.15.42:0/2125146392 wait complete. 2024-03-31T23:15:56.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 Processor -- start 2024-03-31T23:15:56.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 -- start start 2024-03-31T23:15:56.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2bc101760 0x7fc2bc197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc102950 0x7fc2bc1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 0x7fc2bc19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc10d4c0 con 0x7fc2bc103310 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc10d340 con 0x7fc2bc102950 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.215+0000 7fc2c0d65640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc10d640 con 0x7fc2bc101760 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 0x7fc2bc19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 0x7fc2bc19f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43014/0 (socket says 172.21.15.42:43014) 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 -- 172.21.15.42:0/3613611885 learned_addr learned my addr 172.21.15.42:0/3613611885 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2b3fff640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc102950 0x7fc2bc1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2ba59c640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2bc101760 0x7fc2bc197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 -- 172.21.15.42:0/3613611885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2bc101760 msgr2=0x7fc2bc197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2bc101760 0x7fc2bc197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 -- 172.21.15.42:0/3613611885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc102950 msgr2=0x7fc2bc1980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc102950 0x7fc2bc1980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 -- 172.21.15.42:0/3613611885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc19f780 con 0x7fc2bc103310 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2b3fff640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc102950 0x7fc2bc1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2bad9d640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 0x7fc2bc19f110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400eb10 tx=0x7fc2b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4004b20 con 0x7fc2bc103310 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc19fa70 con 0x7fc2bc103310 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2b4004cc0 con 0x7fc2bc103310 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40107f0 con 0x7fc2bc103310 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.216+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc19ffe0 con 0x7fc2bc103310 2024-03-31T23:15:56.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.217+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2bc108a80 con 0x7fc2bc103310 2024-03-31T23:15:56.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.218+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fc2b4005020 con 0x7fc2bc103310 2024-03-31T23:15:56.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.219+0000 7fc2b37fe640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2a80a24a0 0x7fc2a80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.219+0000 7fc2ba59c640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2a80a24a0 0x7fc2a80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.219+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc2b40ceee0 con 0x7fc2bc103310 2024-03-31T23:15:56.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.220+0000 7fc2ba59c640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2a80a24a0 0x7fc2a80a4960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc1027b0 tx=0x7fc2ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:56.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.224+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc2b409be00 con 0x7fc2bc103310 2024-03-31T23:15:56.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.409+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2bc062350 con 0x7fc2bc103310 2024-03-31T23:15:56.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.411+0000 7fc2b37fe640 1 -- 172.21.15.42:0/3613611885 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7fc2b409b700 con 0x7fc2bc103310 2024-03-31T23:15:56.412 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:56.412 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2a80a24a0 msgr2=0x7fc2a80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2a80a24a0 0x7fc2a80a4960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc1027b0 tx=0x7fc2ac005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 msgr2=0x7fc2bc19f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 0x7fc2bc19f110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400eb10 tx=0x7fc2b400c2d0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 shutdown_connections 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc2a80a24a0 0x7fc2a80a4960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2bc103310 0x7fc2bc19f110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2bc102950 0x7fc2bc1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 --2- 172.21.15.42:0/3613611885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2bc101760 0x7fc2bc197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 >> 172.21.15.42:0/3613611885 conn(0x7fc2bc0fcd30 msgr2=0x7fc2bc105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 shutdown_connections 2024-03-31T23:15:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.413+0000 7fc2c0d65640 1 -- 172.21.15.42:0/3613611885 wait complete. 2024-03-31T23:15:56.424 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:56 smithi042 ceph-mon[32380]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:15:56.426 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:15:56.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:56 smithi188 ceph-mon[36068]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:15:56.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 -- 172.21.15.42:0/877564383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c102220 msgr2=0x7f088c108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 --2- 172.21.15.42:0/877564383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c102220 0x7f088c108ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0884009ca0 tx=0x7f088402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 -- 172.21.15.42:0/877564383 shutdown_connections 2024-03-31T23:15:56.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 --2- 172.21.15.42:0/877564383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c102220 0x7f088c108ab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 --2- 172.21.15.42:0/877564383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c101860 0x7f088c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 --2- 172.21.15.42:0/877564383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c100670 0x7f088c100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 -- 172.21.15.42:0/877564383 >> 172.21.15.42:0/877564383 conn(0x7f088c0fbbe0 msgr2=0x7f088c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 -- 172.21.15.42:0/877564383 shutdown_connections 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 -- 172.21.15.42:0/877564383 wait complete. 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.529+0000 7f0892de9640 1 Processor -- start 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 -- start start 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 0x7f088c104600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c101860 0x7f088c102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c102220 0x7f088c103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f088c10c420 con 0x7f088c100670 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f088c10c2a0 con 0x7f088c102220 2024-03-31T23:15:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f088c10c5a0 con 0x7f088c101860 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 0x7f088c104600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 0x7f088c104600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43032/0 (socket says 172.21.15.42:43032) 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 -- 172.21.15.42:0/207843295 learned_addr learned my addr 172.21.15.42:0/207843295 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0891386640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c102220 0x7f088c103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f088bfff640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c101860 0x7f088c102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 -- 172.21.15.42:0/207843295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c101860 msgr2=0x7f088c102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c101860 0x7f088c102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 -- 172.21.15.42:0/207843295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c102220 msgr2=0x7f088c103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c102220 0x7f088c103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 -- 172.21.15.42:0/207843295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c103a10 con 0x7f088c100670 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0891386640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c102220 0x7f088c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:15:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0890b85640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 0x7f088c104600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f088000c970 tx=0x7f088000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:56.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880007c10 con 0x7f088c100670 2024-03-31T23:15:56.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0880007db0 con 0x7f088c100670 2024-03-31T23:15:56.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088c1a1ba0 con 0x7f088c100670 2024-03-31T23:15:56.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.530+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088000fa40 con 0x7f088c100670 2024-03-31T23:15:56.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.531+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088c1a20f0 con 0x7f088c100670 2024-03-31T23:15:56.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.532+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088c1a2320 con 0x7f088c100670 2024-03-31T23:15:56.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.532+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f088000fbe0 con 0x7f088c100670 2024-03-31T23:15:56.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.533+0000 7f0889ffb640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f087c0a24a0 0x7f087c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.533+0000 7f088bfff640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f087c0a24a0 0x7f087c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.533+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f08800cee00 con 0x7f088c100670 2024-03-31T23:15:56.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.534+0000 7f088bfff640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f087c0a24a0 0x7f087c0a4960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08780095f0 tx=0x7f0878005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:56.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.538+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f088009be10 con 0x7f088c100670 2024-03-31T23:15:56.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:56 smithi094 ceph-mon[36167]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:15:56.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.722+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f088c1a2ad0 con 0x7f088c100670 2024-03-31T23:15:56.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.723+0000 7f0889ffb640 1 -- 172.21.15.42:0/207843295 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f088009b710 con 0x7f088c100670 2024-03-31T23:15:56.724 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:15:56.724 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:15:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f087c0a24a0 msgr2=0x7f087c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f087c0a24a0 0x7f087c0a4960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08780095f0 tx=0x7f0878005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 msgr2=0x7f088c104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 0x7f088c104600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f088000c970 tx=0x7f088000ce30 comp rx=0 tx=0).stop 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 shutdown_connections 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f088c102220 0x7f088c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c101860 0x7f088c102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f087c0a24a0 0x7f087c0a4960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 --2- 172.21.15.42:0/207843295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f088c100670 0x7f088c104600 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 >> 172.21.15.42:0/207843295 conn(0x7f088c0fbbe0 msgr2=0x7f088c0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 shutdown_connections 2024-03-31T23:15:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.725+0000 7f0892de9640 1 -- 172.21.15.42:0/207843295 wait complete. 2024-03-31T23:15:56.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 -- 172.21.15.42:0/420630551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48101760 msgr2=0x7f0b48101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 --2- 172.21.15.42:0/420630551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48101760 0x7f0b48101b80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009900 tx=0x7f0b4402bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 -- 172.21.15.42:0/420630551 shutdown_connections 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 --2- 172.21.15.42:0/420630551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b48103310 0x7f0b48109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 --2- 172.21.15.42:0/420630551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48102950 0x7f0b48102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 --2- 172.21.15.42:0/420630551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48101760 0x7f0b48101b80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 -- 172.21.15.42:0/420630551 >> 172.21.15.42:0/420630551 conn(0x7f0b480fccd0 msgr2=0x7f0b480ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 -- 172.21.15.42:0/420630551 shutdown_connections 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.844+0000 7f0b500ae640 1 -- 172.21.15.42:0/420630551 wait complete. 2024-03-31T23:15:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 Processor -- start 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 -- start start 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 0x7f0b48197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b48102950 0x7f0b481980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48103310 0x7f0b4819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4810d4c0 con 0x7f0b48103310 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4810d340 con 0x7f0b48101760 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b500ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4810d640 con 0x7f0b48102950 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4e64b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48103310 0x7f0b4819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 0x7f0b48197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 0x7f0b48197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:47112/0 (socket says 172.21.15.42:47112) 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 -- 172.21.15.42:0/3225990127 learned_addr learned my addr 172.21.15.42:0/3225990127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4d649640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b48102950 0x7f0b481980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 -- 172.21.15.42:0/3225990127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b48102950 msgr2=0x7f0b481980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b48102950 0x7f0b481980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 -- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48103310 msgr2=0x7f0b4819f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48103310 0x7f0b4819f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4de4a640 1 -- 172.21.15.42:0/3225990127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4819f7b0 con 0x7f0b48101760 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.845+0000 7f0b4e64b640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48103310 0x7f0b4819f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.846+0000 7f0b4de4a640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 0x7f0b48197b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b44000c00 tx=0x7f0b44004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.846+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44043020 con 0x7f0b48101760 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.846+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4819fa40 con 0x7f0b48101760 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.846+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b44004250 con 0x7f0b48101760 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.846+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44003b90 con 0x7f0b48101760 2024-03-31T23:15:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.846+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4819ff90 con 0x7f0b48101760 2024-03-31T23:15:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.847+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b48108ad0 con 0x7f0b48101760 2024-03-31T23:15:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.848+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f0b44046020 con 0x7f0b48101760 2024-03-31T23:15:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.848+0000 7f0b3effd640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b340a24a0 0x7f0b340a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.848+0000 7f0b4d649640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b340a24a0 0x7f0b340a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.848+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f0b440f0fd0 con 0x7f0b48101760 2024-03-31T23:15:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.849+0000 7f0b4d649640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b340a24a0 0x7f0b340a4960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b380095f0 tx=0x7f0b38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:56.852+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0b4404d020 con 0x7f0b48101760 2024-03-31T23:15:57.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.074+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0b4802d170 con 0x7f0b48101760 2024-03-31T23:15:57.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.206+0000 7f0b3effd640 1 -- 172.21.15.42:0/3225990127 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f0b440bdf50 con 0x7f0b48101760 2024-03-31T23:15:57.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b340a24a0 msgr2=0x7f0b340a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b340a24a0 0x7f0b340a4960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b380095f0 tx=0x7f0b38005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 msgr2=0x7f0b48197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 0x7f0b48197b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b44000c00 tx=0x7f0b44004a30 comp rx=0 tx=0).stop 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 shutdown_connections 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0b340a24a0 0x7f0b340a4960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b48103310 0x7f0b4819f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b48102950 0x7f0b481980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 --2- 172.21.15.42:0/3225990127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b48101760 0x7f0b48197b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 >> 172.21.15.42:0/3225990127 conn(0x7f0b480fccd0 msgr2=0x7f0b48105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 shutdown_connections 2024-03-31T23:15:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.209+0000 7f0b500ae640 1 -- 172.21.15.42:0/3225990127 wait complete. 2024-03-31T23:15:57.220 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-03-31T23:15:57.220 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-31T23:15:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 -- 172.21.15.42:0/2255734045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c41033d0 msgr2=0x7ff6c4109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/2255734045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c41033d0 0x7ff6c4109c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009cd0 tx=0x7ff6bc02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 -- 172.21.15.42:0/2255734045 shutdown_connections 2024-03-31T23:15:57.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/2255734045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c41033d0 0x7ff6c4109c60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/2255734045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6c4102a10 0x7ff6c4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/2255734045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6c40ffa40 0x7ff6c40ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 -- 172.21.15.42:0/2255734045 >> 172.21.15.42:0/2255734045 conn(0x7ff6c40fb350 msgr2=0x7ff6c40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 -- 172.21.15.42:0/2255734045 shutdown_connections 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.325+0000 7ff6c9b81640 1 -- 172.21.15.42:0/2255734045 wait complete. 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 Processor -- start 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 -- start start 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6c40ffa40 0x7ff6c4197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 0x7ff6c4198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6c41033d0 0x7ff6c419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c410d550 con 0x7ff6c4102a10 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c410d3d0 con 0x7ff6c41033d0 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c9b81640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c410d6d0 con 0x7ff6c40ffa40 2024-03-31T23:15:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 0x7ff6c4198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 0x7ff6c4198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43062/0 (socket says 172.21.15.42:43062) 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 -- 172.21.15.42:0/3273733054 learned_addr learned my addr 172.21.15.42:0/3273733054 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c3fff640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6c41033d0 0x7ff6c419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c37fe640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6c40ffa40 0x7ff6c4197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 -- 172.21.15.42:0/3273733054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6c40ffa40 msgr2=0x7ff6c4197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6c40ffa40 0x7ff6c4197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 -- 172.21.15.42:0/3273733054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6c41033d0 msgr2=0x7ff6c419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6c41033d0 0x7ff6c419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.326+0000 7ff6c2ffd640 1 -- 172.21.15.42:0/3273733054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c419f710 con 0x7ff6c4102a10 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.327+0000 7ff6c2ffd640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 0x7ff6c4198030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400e9f0 tx=0x7ff6b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.327+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400cd80 con 0x7ff6c4102a10 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.327+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c419fa00 con 0x7ff6c4102a10 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.327+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6b4010930 con 0x7ff6c4102a10 2024-03-31T23:15:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.327+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4018b00 con 0x7ff6c4102a10 2024-03-31T23:15:57.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.327+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c419ff50 con 0x7ff6c4102a10 2024-03-31T23:15:57.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.328+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c4108ae0 con 0x7ff6c4102a10 2024-03-31T23:15:57.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.329+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7ff6b4018ca0 con 0x7ff6c4102a10 2024-03-31T23:15:57.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.329+0000 7ff6c0ff9640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff6ac0a24a0 0x7ff6ac0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:57.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.330+0000 7ff6c37fe640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff6ac0a24a0 0x7ff6ac0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:57.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.330+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff6b40cf0e0 con 0x7ff6c4102a10 2024-03-31T23:15:57.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.330+0000 7ff6c37fe640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff6ac0a24a0 0x7ff6ac0a4960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8005fd0 tx=0x7ff6b8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:57.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.333+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff6b409c060 con 0x7ff6c4102a10 2024-03-31T23:15:57.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3613611885' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/207843295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3225990127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-31T23:15:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:57 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-31T23:15:57.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:57.554+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ff6c402d3e0 con 0x7ff6c4102a10 2024-03-31T23:15:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3613611885' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/207843295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3225990127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-31T23:15:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:57 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-31T23:15:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3613611885' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/207843295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:15:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3225990127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-31T23:15:57.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:57 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-31T23:15:58.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.212+0000 7ff6c0ff9640 1 -- 172.21.15.42:0/3273733054 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7ff6b409b960 con 0x7ff6c4102a10 2024-03-31T23:15:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff6ac0a24a0 msgr2=0x7ff6ac0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff6ac0a24a0 0x7ff6ac0a4960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8005fd0 tx=0x7ff6b8005850 comp rx=0 tx=0).stop 2024-03-31T23:15:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 msgr2=0x7ff6c4198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 0x7ff6c4198030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400e9f0 tx=0x7ff6b400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 shutdown_connections 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6c41033d0 0x7ff6c419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff6ac0a24a0 0x7ff6ac0a4960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a10 0x7ff6c4198030 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 --2- 172.21.15.42:0/3273733054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6c40ffa40 0x7ff6c4197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.215+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 >> 172.21.15.42:0/3273733054 conn(0x7ff6c40fb350 msgr2=0x7ff6c4105cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.216+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 shutdown_connections 2024-03-31T23:15:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.216+0000 7ff6c9b81640 1 -- 172.21.15.42:0/3273733054 wait complete. 2024-03-31T23:15:58.233 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-31T23:15:58.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 -- 172.21.15.42:0/1600534491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 msgr2=0x7fada0101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:58.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 --2- 172.21.15.42:0/1600534491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0101cd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fad88009900 tx=0x7fad8802bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:58.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 -- 172.21.15.42:0/1600534491 shutdown_connections 2024-03-31T23:15:58.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 --2- 172.21.15.42:0/1600534491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0102210 0x7fada0108aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 --2- 172.21.15.42:0/1600534491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0101cd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 --2- 172.21.15.42:0/1600534491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0100660 0x7fada0100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 -- 172.21.15.42:0/1600534491 >> 172.21.15.42:0/1600534491 conn(0x7fada00fbbf0 msgr2=0x7fada00fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 -- 172.21.15.42:0/1600534491 shutdown_connections 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 -- 172.21.15.42:0/1600534491 wait complete. 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 Processor -- start 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.344+0000 7fada6913640 1 -- start start 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada6913640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0100660 0x7fada01045f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada6913640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada6913640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0102210 0x7fada0103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada6913640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fada010c3c0 con 0x7fada0101850 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada6913640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fada010c240 con 0x7fada0102210 2024-03-31T23:15:58.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada6913640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fada010c540 con 0x7fada0100660 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43082/0 (socket says 172.21.15.42:43082) 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 -- 172.21.15.42:0/2634937399 learned_addr learned my addr 172.21.15.42:0/2634937399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada4eb0640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0102210 0x7fada0103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9ffff640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0100660 0x7fada01045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 -- 172.21.15.42:0/2634937399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0100660 msgr2=0x7fada01045f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0100660 0x7fada01045f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 -- 172.21.15.42:0/2634937399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0102210 msgr2=0x7fada0103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0102210 0x7fada0103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 -- 172.21.15.42:0/2634937399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada0103a00 con 0x7fada0101850 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fada4eb0640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0102210 0x7fada0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9f7fe640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0102c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fad88005ab0 tx=0x7fad88004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:58.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.345+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad88043020 con 0x7fada0101850 2024-03-31T23:15:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.346+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada01a1c40 con 0x7fada0101850 2024-03-31T23:15:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.346+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad88004250 con 0x7fada0101850 2024-03-31T23:15:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.346+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad88003b90 con 0x7fada0101850 2024-03-31T23:15:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.346+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada01a2190 con 0x7fada0101850 2024-03-31T23:15:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.346+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada01a2360 con 0x7fada0101850 2024-03-31T23:15:58.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.348+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fad88046020 con 0x7fada0101850 2024-03-31T23:15:58.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.348+0000 7fad9d7fa640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fad8c0a24a0 0x7fad8c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:58.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.348+0000 7fad9ffff640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fad8c0a24a0 0x7fad8c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:58.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.348+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fad880f0ac0 con 0x7fada0101850 2024-03-31T23:15:58.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.349+0000 7fad9ffff640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fad8c0a24a0 0x7fad8c0a4960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fada01016b0 tx=0x7fad90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:58.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.353+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fad8804d020 con 0x7fada0101850 2024-03-31T23:15:58.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:58 smithi188 ceph-mon[36068]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:15:58.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:58 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-31T23:15:58.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:58 smithi188 ceph-mon[36068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:58.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:58 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3273733054' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-31T23:15:58.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:58 smithi042 ceph-mon[32380]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:15:58.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:58 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-31T23:15:58.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:58 smithi042 ceph-mon[32380]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:58.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:58 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3273733054' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-31T23:15:58.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:58.577+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fada01a2530 con 0x7fada0101850 2024-03-31T23:15:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:58 smithi094 ceph-mon[36167]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:15:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:58 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-31T23:15:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:58 smithi094 ceph-mon[36167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:58.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:58 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3273733054' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-31T23:15:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.224+0000 7fad9d7fa640 1 -- 172.21.15.42:0/2634937399 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fad880bda40 con 0x7fada0101850 2024-03-31T23:15:59.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fad8c0a24a0 msgr2=0x7fad8c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:59.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fad8c0a24a0 0x7fad8c0a4960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fada01016b0 tx=0x7fad90005f90 comp rx=0 tx=0).stop 2024-03-31T23:15:59.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 msgr2=0x7fada0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:59.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0102c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fad88005ab0 tx=0x7fad88004ab0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 shutdown_connections 2024-03-31T23:15:59.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada0102210 0x7fada0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fad8c0a24a0 0x7fad8c0a4960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fada0101850 0x7fada0102c30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 --2- 172.21.15.42:0/2634937399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0100660 0x7fada01045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 >> 172.21.15.42:0/2634937399 conn(0x7fada00fbbf0 msgr2=0x7fada00fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 shutdown_connections 2024-03-31T23:15:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.227+0000 7fada6913640 1 -- 172.21.15.42:0/2634937399 wait complete. 2024-03-31T23:15:59.245 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-31T23:15:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 -- 172.21.15.42:0/226727113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 msgr2=0x7fc840101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 --2- 172.21.15.42:0/226727113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840101cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc828009900 tx=0x7fc82802bc30 comp rx=0 tx=0).stop 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 -- 172.21.15.42:0/226727113 shutdown_connections 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 --2- 172.21.15.42:0/226727113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840102200 0x7fc840108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 --2- 172.21.15.42:0/226727113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840101cc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 --2- 172.21.15.42:0/226727113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc840100650 0x7fc840100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 -- 172.21.15.42:0/226727113 >> 172.21.15.42:0/226727113 conn(0x7fc8400fbbe0 msgr2=0x7fc8400fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 -- 172.21.15.42:0/226727113 shutdown_connections 2024-03-31T23:15:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.356+0000 7fc844bd6640 1 -- 172.21.15.42:0/226727113 wait complete. 2024-03-31T23:15:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 Processor -- start 2024-03-31T23:15:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 -- start start 2024-03-31T23:15:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 0x7fc840197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc840102200 0x7fc84019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc84010c3b0 con 0x7fc840101840 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc84010c230 con 0x7fc840102200 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.357+0000 7fc844bd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc84010c530 con 0x7fc840100650 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 0x7fc840197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc837fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 0x7fc840197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:47396/0 (socket says 172.21.15.42:47396) 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc840102200 0x7fc84019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 -- 172.21.15.42:0/3201228316 learned_addr learned my addr 172.21.15.42:0/3201228316 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 -- 172.21.15.42:0/3201228316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc840102200 msgr2=0x7fc84019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc840102200 0x7fc84019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 -- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 msgr2=0x7fc840198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:15:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 -- 172.21.15.42:0/3201228316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84019f730 con 0x7fc840100650 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc837fff640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc83e59c640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 0x7fc840197b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc83000e9c0 tx=0x7fc83000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83000cd80 con 0x7fc840100650 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84019fa20 con 0x7fc840100650 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8300035f0 con 0x7fc840100650 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc830018630 con 0x7fc840100650 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.358+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84019ff90 con 0x7fc840100650 2024-03-31T23:15:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.359+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8401a0220 con 0x7fc840100650 2024-03-31T23:15:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.360+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fc8300037a0 con 0x7fc840100650 2024-03-31T23:15:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.361+0000 7fc8377fe640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc82c0a24a0 0x7fc82c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:15:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.361+0000 7fc837fff640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc82c0a24a0 0x7fc82c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:15:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.361+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc8300cef10 con 0x7fc840100650 2024-03-31T23:15:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.361+0000 7fc837fff640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc82c0a24a0 0x7fc82c0a4960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc82802c900 tx=0x7fc828005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:15:59.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.369+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc830053280 con 0x7fc840100650 2024-03-31T23:15:59.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-31T23:15:59.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3273733054' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-31T23:15:59.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-31T23:15:59.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:59.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-31T23:15:59.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-31T23:15:59.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:15:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2634937399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-31T23:15:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-31T23:15:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3273733054' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-31T23:15:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-31T23:15:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-31T23:15:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-31T23:15:59.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:15:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2634937399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-31T23:15:59.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:15:59.597+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc8401a03f0 con 0x7fc840100650 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:15:59.404+0000 7f0054975700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3273733054' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-31T23:15:59.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:15:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2634937399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-31T23:16:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.234+0000 7fc8377fe640 1 -- 172.21.15.42:0/3201228316 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fc83009be30 con 0x7fc840100650 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc82c0a24a0 msgr2=0x7fc82c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc82c0a24a0 0x7fc82c0a4960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc82802c900 tx=0x7fc828005fd0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 msgr2=0x7fc840197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 0x7fc840197b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc83000e9c0 tx=0x7fc83000ee80 comp rx=0 tx=0).stop 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 shutdown_connections 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc840102200 0x7fc84019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc82c0a24a0 0x7fc82c0a4960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc840101840 0x7fc840198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 --2- 172.21.15.42:0/3201228316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc840100650 0x7fc840197b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 >> 172.21.15.42:0/3201228316 conn(0x7fc8400fbbe0 msgr2=0x7fc8400fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 shutdown_connections 2024-03-31T23:16:00.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.238+0000 7fc844bd6640 1 -- 172.21.15.42:0/3201228316 wait complete. 2024-03-31T23:16:00.256 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-03-31T23:16:00.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-31T23:16:00.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 -- 172.21.15.42:0/2464299557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0101860 msgr2=0x7f22b0101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2464299557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0101860 0x7f22b0101ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009900 tx=0x7f22a002bc30 comp rx=0 tx=0).stop 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 -- 172.21.15.42:0/2464299557 shutdown_connections 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2464299557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b0102220 0x7f22b0108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2464299557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0101860 0x7f22b0101ce0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2464299557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0100670 0x7f22b0100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 -- 172.21.15.42:0/2464299557 >> 172.21.15.42:0/2464299557 conn(0x7f22b00fbc20 msgr2=0x7f22b00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 -- 172.21.15.42:0/2464299557 shutdown_connections 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.367+0000 7f22b7c40640 1 -- 172.21.15.42:0/2464299557 wait complete. 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 Processor -- start 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 -- start start 2024-03-31T23:16:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b0100670 0x7f22b006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0101860 0x7f22b019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 0x7f22b019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010c3d0 con 0x7f22b0102220 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010c250 con 0x7f22b0101860 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b7c40640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010c550 con 0x7f22b0100670 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b61dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 0x7f22b019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b61dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 0x7f22b019ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43132/0 (socket says 172.21.15.42:43132) 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b51db640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0101860 0x7f22b019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b61dd640 1 -- 172.21.15.42:0/2568410698 learned_addr learned my addr 172.21.15.42:0/2568410698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.368+0000 7f22b59dc640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b0100670 0x7f22b006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b61dd640 1 -- 172.21.15.42:0/2568410698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b0100670 msgr2=0x7f22b006a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b61dd640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b0100670 0x7f22b006a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b61dd640 1 -- 172.21.15.42:0/2568410698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0101860 msgr2=0x7f22b019c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b61dd640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0101860 0x7f22b019c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b61dd640 1 -- 172.21.15.42:0/2568410698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b019f700 con 0x7f22b0102220 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b51db640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0101860 0x7f22b019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b61dd640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 0x7f22b019ee40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f22a800eb10 tx=0x7f22a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8004b20 con 0x7f22b0102220 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b019f9f0 con 0x7f22b0102220 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22a8004cc0 con 0x7f22b0102220 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a80107f0 con 0x7f22b0102220 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.369+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b019ff60 con 0x7f22b0102220 2024-03-31T23:16:00.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.370+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b0107990 con 0x7f22b0102220 2024-03-31T23:16:00.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.371+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f22a8005020 con 0x7f22b0102220 2024-03-31T23:16:00.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.371+0000 7f22a6ffd640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f229c0a24a0 0x7f229c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:00.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.372+0000 7f22b59dc640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f229c0a24a0 0x7f229c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:00.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.372+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f22a80cee80 con 0x7f22b0102220 2024-03-31T23:16:00.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.372+0000 7f22b59dc640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f229c0a24a0 0x7f229c0a4960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22b01016c0 tx=0x7f22ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:00.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.376+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f22a809be00 con 0x7f22b0102220 2024-03-31T23:16:00.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:16:00.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2634937399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-31T23:16:00.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:active 2024-03-31T23:16:00.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-31T23:16:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-31T23:16:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-31T23:16:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-31T23:16:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3201228316' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-31T23:16:00.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-31T23:16:00.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:00.587+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f22b0061b90 con 0x7f229c0a24a0 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2634937399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:active 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3201228316' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-31T23:16:00.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:00 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-31T23:16:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-31T23:16:00.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2634937399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:active 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3201228316' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-31T23:16:00.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:00 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-31T23:16:01.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:16:00.591+0000 7fe65c53f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:16:01.076 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:16:00.591+0000 7fe65c53f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:16:01.076 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:16:00.591+0000 7fe65c53f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:16:01.076 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:16:00.591+0000 7fe65c53f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:16:01.076 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:16:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:16:00.591+0000 7fe65c53f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:16:01.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.267+0000 7f22a6ffd640 1 -- 172.21.15.42:0/2568410698 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f22b0061b90 con 0x7f229c0a24a0 2024-03-31T23:16:01.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.269+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f229c0a24a0 msgr2=0x7f229c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.269+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f229c0a24a0 0x7f229c0a4960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22b01016c0 tx=0x7f22ac005f90 comp rx=0 tx=0).stop 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.269+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 msgr2=0x7f22b019ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.269+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 0x7f22b019ee40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f22a800eb10 tx=0x7f22a800c2d0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 shutdown_connections 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f229c0a24a0 0x7f229c0a4960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22b0102220 0x7f22b019ee40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b0101860 0x7f22b019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 --2- 172.21.15.42:0/2568410698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b0100670 0x7f22b006a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 >> 172.21.15.42:0/2568410698 conn(0x7f22b00fbc20 msgr2=0x7f22b0104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 shutdown_connections 2024-03-31T23:16:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.270+0000 7f22b7c40640 1 -- 172.21.15.42:0/2568410698 wait complete. 2024-03-31T23:16:01.284 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-31T23:16:01.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 -- 172.21.15.42:0/228755575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098103330 msgr2=0x7fa098109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 --2- 172.21.15.42:0/228755575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098103330 0x7fa098109bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa090009ca0 tx=0x7fa09002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 -- 172.21.15.42:0/228755575 shutdown_connections 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 --2- 172.21.15.42:0/228755575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098103330 0x7fa098109bc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 --2- 172.21.15.42:0/228755575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 0x7fa098102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 --2- 172.21.15.42:0/228755575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa098101780 0x7fa098101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 -- 172.21.15.42:0/228755575 >> 172.21.15.42:0/228755575 conn(0x7fa0980fccf0 msgr2=0x7fa0980ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 -- 172.21.15.42:0/228755575 shutdown_connections 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 -- 172.21.15.42:0/228755575 wait complete. 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 Processor -- start 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.398+0000 7fa09eca4640 1 -- start start 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 0x7fa098197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 0x7fa098198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa098103330 0x7fa09819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa09810d530 con 0x7fa098101780 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa09810d3b0 con 0x7fa098102970 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa09810d6b0 con 0x7fa098103330 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 0x7fa098197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 0x7fa098197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43170/0 (socket says 172.21.15.42:43170) 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 -- 172.21.15.42:0/324994151 learned_addr learned my addr 172.21.15.42:0/324994151 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa097fff640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 0x7fa098198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09d241640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa098103330 0x7fa09819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 -- 172.21.15.42:0/324994151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa098103330 msgr2=0x7fa09819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa098103330 0x7fa09819f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 -- 172.21.15.42:0/324994151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 msgr2=0x7fa098198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 0x7fa098198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 -- 172.21.15.42:0/324994151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09819f740 con 0x7fa098101780 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa097fff640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 0x7fa098198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09ca40640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 0x7fa098197b20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9c0 tx=0x7fa08c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00cd80 con 0x7fa098101780 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09819fa30 con 0x7fa098101780 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa08c0035f0 con 0x7fa098101780 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.399+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c010670 con 0x7fa098101780 2024-03-31T23:16:01.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.400+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09819ff80 con 0x7fa098101780 2024-03-31T23:16:01.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.401+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa098108a40 con 0x7fa098101780 2024-03-31T23:16:01.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.401+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7fa08c0037a0 con 0x7fa098101780 2024-03-31T23:16:01.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.402+0000 7fa095ffb640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa0880a24a0 0x7fa0880a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.402+0000 7fa097fff640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa0880a24a0 0x7fa0880a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.402+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa08c0cece0 con 0x7fa098101780 2024-03-31T23:16:01.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.403+0000 7fa097fff640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa0880a24a0 0x7fa0880a4960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa098199030 tx=0x7fa084005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:01.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.407+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa08c09bc60 con 0x7fa098101780 2024-03-31T23:16:01.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-31T23:16:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:active 2024-03-31T23:16:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-31T23:16:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-31T23:16:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-03-31T23:16:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-03-31T23:16:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:01 smithi188 ceph-mon[36068]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-31T23:16:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:active 2024-03-31T23:16:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-31T23:16:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-31T23:16:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-03-31T23:16:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-03-31T23:16:01.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:01 smithi042 ceph-mon[32380]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:01.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.619+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa098061b90 con 0x7fa0880a24a0 2024-03-31T23:16:01.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.644+0000 7fa095ffb640 1 -- 172.21.15.42:0/324994151 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa098061b90 con 0x7fa0880a24a0 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa0880a24a0 msgr2=0x7fa0880a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa0880a24a0 0x7fa0880a4960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa098199030 tx=0x7fa084005f90 comp rx=0 tx=0).stop 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 msgr2=0x7fa098197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 0x7fa098197b20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9c0 tx=0x7fa08c00ee80 comp rx=0 tx=0).stop 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 shutdown_connections 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa098103330 0x7fa09819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa098102970 0x7fa098198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa0880a24a0 0x7fa0880a4960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 --2- 172.21.15.42:0/324994151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa098101780 0x7fa098197b20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 >> 172.21.15.42:0/324994151 conn(0x7fa0980fccf0 msgr2=0x7fa098105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:01.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 shutdown_connections 2024-03-31T23:16:01.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.647+0000 7fa09eca4640 1 -- 172.21.15.42:0/324994151 wait complete. 2024-03-31T23:16:01.658 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:active 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-03-31T23:16:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:01 smithi094 ceph-mon[36167]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:01.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 -- 172.21.15.42:0/3997876553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba4100ec0 msgr2=0x7ffba4101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 --2- 172.21.15.42:0/3997876553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba4100ec0 0x7ffba4101340 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009900 tx=0x7ffb9802bc30 comp rx=0 tx=0).stop 2024-03-31T23:16:01.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 -- 172.21.15.42:0/3997876553 shutdown_connections 2024-03-31T23:16:01.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 --2- 172.21.15.42:0/3997876553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffba4101880 0x7ffba4108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 --2- 172.21.15.42:0/3997876553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba4100ec0 0x7ffba4101340 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 --2- 172.21.15.42:0/3997876553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffba40ffcd0 0x7ffba41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 -- 172.21.15.42:0/3997876553 >> 172.21.15.42:0/3997876553 conn(0x7ffba40fb240 msgr2=0x7ffba40fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 -- 172.21.15.42:0/3997876553 shutdown_connections 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.766+0000 7ffba359e640 1 -- 172.21.15.42:0/3997876553 wait complete. 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 Processor -- start 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 -- start start 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 0x7ffba4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffba4100ec0 0x7ffba4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffba4101880 0x7ffba419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410d3b0 con 0x7ffba40ffcd0 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410d230 con 0x7ffba4101880 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410d530 con 0x7ffba4100ec0 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 0x7ffba4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 0x7ffba4197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43190/0 (socket says 172.21.15.42:43190) 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba259c640 1 -- 172.21.15.42:0/3942455020 learned_addr learned my addr 172.21.15.42:0/3942455020 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.767+0000 7ffba1d9b640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffba4100ec0 0x7ffba4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba2d9d640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffba4101880 0x7ffba419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba259c640 1 -- 172.21.15.42:0/3942455020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffba4100ec0 msgr2=0x7ffba4197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba259c640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffba4100ec0 0x7ffba4197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba259c640 1 -- 172.21.15.42:0/3942455020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffba4101880 msgr2=0x7ffba419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba259c640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffba4101880 0x7ffba419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba259c640 1 -- 172.21.15.42:0/3942455020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba419f650 con 0x7ffba40ffcd0 2024-03-31T23:16:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba259c640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 0x7ffba4197a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400e9c0 tx=0x7ffb9400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:01.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9400cd80 con 0x7ffba40ffcd0 2024-03-31T23:16:01.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb940035f0 con 0x7ffba40ffcd0 2024-03-31T23:16:01.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba419f940 con 0x7ffba40ffcd0 2024-03-31T23:16:01.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94010690 con 0x7ffba40ffcd0 2024-03-31T23:16:01.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.768+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba419fe60 con 0x7ffba40ffcd0 2024-03-31T23:16:01.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.769+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba40688b0 con 0x7ffba40ffcd0 2024-03-31T23:16:01.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.770+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7ffb940037a0 con 0x7ffba40ffcd0 2024-03-31T23:16:01.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.771+0000 7ffb937fe640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb8c0a24a0 0x7ffb8c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:01.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.771+0000 7ffba1d9b640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb8c0a24a0 0x7ffb8c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:01.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.771+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ffb940cedc0 con 0x7ffba40ffcd0 2024-03-31T23:16:01.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.771+0000 7ffba1d9b640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb8c0a24a0 0x7ffb8c0a4960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffb9802c900 tx=0x7ffb98005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:01.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.775+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ffb9409bce0 con 0x7ffba40ffcd0 2024-03-31T23:16:01.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.988+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ffba4061c20 con 0x7ffb8c0a24a0 2024-03-31T23:16:01.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.993+0000 7ffb937fe640 1 -- 172.21.15.42:0/3942455020 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffba4061c20 con 0x7ffb8c0a24a0 2024-03-31T23:16:01.994 INFO:teuthology.orchestra.run.smithi042.stdout:/volumes/qa/sv_0/c76c8922-c1d9-4f4f-a6c7-3ee8ec2108ae 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb8c0a24a0 msgr2=0x7ffb8c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb8c0a24a0 0x7ffb8c0a4960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffb9802c900 tx=0x7ffb98005fd0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 msgr2=0x7ffba4197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 0x7ffba4197a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400e9c0 tx=0x7ffb9400ee80 comp rx=0 tx=0).stop 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 shutdown_connections 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffba4101880 0x7ffba419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffba4100ec0 0x7ffba4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb8c0a24a0 0x7ffb8c0a4960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 --2- 172.21.15.42:0/3942455020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba40ffcd0 0x7ffba4197a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:01.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 >> 172.21.15.42:0/3942455020 conn(0x7ffba40fb240 msgr2=0x7ffba41041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:01.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 shutdown_connections 2024-03-31T23:16:01.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:01.995+0000 7ffba359e640 1 -- 172.21.15.42:0/3942455020 wait complete. 2024-03-31T23:16:02.007 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.115+0000 7f8ad57e9640 1 -- 172.21.15.42:0/174543223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad01021d0 msgr2=0x7f8ad01045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.115+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/174543223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad01021d0 0x7f8ad01045c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009900 tx=0x7f8ac402bc30 comp rx=0 tx=0).stop 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.115+0000 7f8ad57e9640 1 -- 172.21.15.42:0/174543223 shutdown_connections 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.115+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/174543223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad0107430 0x7f8ad0109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.115+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/174543223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 0x7f8ad0106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.115+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/174543223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad01021d0 0x7f8ad01045c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- 172.21.15.42:0/174543223 >> 172.21.15.42:0/174543223 conn(0x7f8ad00fbbe0 msgr2=0x7f8ad00fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- 172.21.15.42:0/174543223 shutdown_connections 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- 172.21.15.42:0/174543223 wait complete. 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 Processor -- start 2024-03-31T23:16:02.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- start start 2024-03-31T23:16:02.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 0x7f8ad0101b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 0x7f8ad0100180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0107430 0x7f8ad01006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad010d4d0 con 0x7f8ad0107430 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad010d350 con 0x7f8ad01021d0 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.116+0000 7f8ad57e9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad010d650 con 0x7f8ad0104b00 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8acf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0107430 0x7f8ad01006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ace7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 0x7f8ad0100180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 0x7f8ad0101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 0x7f8ad0101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:47242/0 (socket says 172.21.15.42:47242) 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ace7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 0x7f8ad0100180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:47470/0 (socket says 172.21.15.42:47470) 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 -- 172.21.15.42:0/921281970 learned_addr learned my addr 172.21.15.42:0/921281970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 -- 172.21.15.42:0/921281970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 msgr2=0x7f8ad0100180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 0x7f8ad0100180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 -- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0107430 msgr2=0x7f8ad01006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0107430 0x7f8ad01006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 -- 172.21.15.42:0/921281970 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad0100f50 con 0x7f8ad01021d0 2024-03-31T23:16:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8acf7fe640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0107430 0x7f8ad01006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8aceffd640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 0x7f8ad0101b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009230 tx=0x7f8ac4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4043020 con 0x7f8ad01021d0 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad01a1cf0 con 0x7f8ad01021d0 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ac4004250 con 0x7f8ad01021d0 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4003b50 con 0x7f8ad01021d0 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.117+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad01a2180 con 0x7f8ad01021d0 2024-03-31T23:16:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.118+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad00fd6d0 con 0x7f8ad01021d0 2024-03-31T23:16:02.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.119+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f8ac4046020 con 0x7f8ad01021d0 2024-03-31T23:16:02.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.120+0000 7f8ab7fff640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ab80a24a0 0x7f8ab80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.120+0000 7f8ace7fc640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ab80a24a0 0x7f8ab80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.120+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f8ac40f0ef0 con 0x7f8ad01021d0 2024-03-31T23:16:02.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.120+0000 7f8ace7fc640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ab80a24a0 0x7f8ab80a4960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ad01018b0 tx=0x7f8ac0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.123+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8ac404d020 con 0x7f8ad01021d0 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: pgmap v299: 129 pgs: 129 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:active 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: Cluster is now healthy 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-03-31T23:16:02.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:02 smithi042 ceph-mon[32380]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:02.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.347+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8ad0061c20 con 0x7f8ab80a24a0 2024-03-31T23:16:02.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.376+0000 7f8ab7fff640 1 -- 172.21.15.42:0/921281970 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8ad0061c20 con 0x7f8ab80a24a0 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ab80a24a0 msgr2=0x7f8ab80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ab80a24a0 0x7f8ab80a4960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ad01018b0 tx=0x7f8ac0005f90 comp rx=0 tx=0).stop 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 msgr2=0x7f8ad0101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 0x7f8ad0101b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009230 tx=0x7f8ac4004ab0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 shutdown_connections 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8ab80a24a0 0x7f8ab80a4960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0107430 0x7f8ad01006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ad0104b00 0x7f8ad0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 --2- 172.21.15.42:0/921281970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad01021d0 0x7f8ad0101b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 >> 172.21.15.42:0/921281970 conn(0x7f8ad00fbbe0 msgr2=0x7f8ad0102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 shutdown_connections 2024-03-31T23:16:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.379+0000 7f8ad57e9640 1 -- 172.21.15.42:0/921281970 wait complete. 2024-03-31T23:16:02.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-31T23:16:02.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.501+0000 7f9efdac9640 1 -- 172.21.15.42:0/1210995898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 msgr2=0x7f9ef8100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.501+0000 7f9efdac9640 1 --2- 172.21.15.42:0/1210995898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef8100a90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009900 tx=0x7f9ee002bc30 comp rx=0 tx=0).stop 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- 172.21.15.42:0/1210995898 shutdown_connections 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 --2- 172.21.15.42:0/1210995898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ef8102220 0x7f9ef8108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 --2- 172.21.15.42:0/1210995898 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ef8101860 0x7f9ef8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 --2- 172.21.15.42:0/1210995898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef8100a90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- 172.21.15.42:0/1210995898 >> 172.21.15.42:0/1210995898 conn(0x7f9ef80fbc00 msgr2=0x7f9ef80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- 172.21.15.42:0/1210995898 shutdown_connections 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- 172.21.15.42:0/1210995898 wait complete. 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 Processor -- start 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- start start 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef81045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ef8101860 0x7f9ef8102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ef8102220 0x7f9ef8103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810c3d0 con 0x7f9ef8100670 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810c250 con 0x7f9ef8101860 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.502+0000 7f9efdac9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810c550 con 0x7f9ef8102220 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef81045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef81045b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43234/0 (socket says 172.21.15.42:43234) 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 -- 172.21.15.42:0/898373216 learned_addr learned my addr 172.21.15.42:0/898373216 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef7fff640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ef8102220 0x7f9ef8103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef6ffd640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ef8101860 0x7f9ef8102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 -- 172.21.15.42:0/898373216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ef8102220 msgr2=0x7f9ef8103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ef8102220 0x7f9ef8103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 -- 172.21.15.42:0/898373216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ef8101860 msgr2=0x7f9ef8102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ef8101860 0x7f9ef8102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 -- 172.21.15.42:0/898373216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef8103a40 con 0x7f9ef8100670 2024-03-31T23:16:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef77fe640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef81045b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0000c00 tx=0x7f9ee0004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0043020 con 0x7f9ef8100670 2024-03-31T23:16:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef81a1c60 con 0x7f9ef8100670 2024-03-31T23:16:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ee0004250 con 0x7f9ef8100670 2024-03-31T23:16:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0003b90 con 0x7f9ef8100670 2024-03-31T23:16:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.503+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef81a2180 con 0x7f9ef8100670 2024-03-31T23:16:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.504+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef81a2350 con 0x7f9ef8100670 2024-03-31T23:16:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.505+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f9ee0046020 con 0x7f9ef8100670 2024-03-31T23:16:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.506+0000 7f9ef4ff9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9ee40a24a0 0x7f9ee40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.506+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f9ee00f0a00 con 0x7f9ef8100670 2024-03-31T23:16:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.506+0000 7f9ef6ffd640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9ee40a24a0 0x7f9ee40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.507+0000 7f9ef6ffd640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9ee40a24a0 0x7f9ee40a4960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8104320 tx=0x7f9ee8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.511+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9ee004d020 con 0x7f9ef8100670 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: pgmap v299: 129 pgs: 129 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:active 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: Cluster is now healthy 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-03-31T23:16:02.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-03-31T23:16:02.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:02 smithi094 ceph-mon[36167]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:02.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: pgmap v299: 129 pgs: 129 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:active 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: Cluster is now healthy 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-03-31T23:16:02.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:02 smithi188 ceph-mon[36068]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.721+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f9ef80fddd0 con 0x7f9ee40a24a0 2024-03-31T23:16:02.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.726+0000 7f9ef4ff9640 1 -- 172.21.15.42:0/898373216 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9ef80fddd0 con 0x7f9ee40a24a0 2024-03-31T23:16:02.727 INFO:teuthology.orchestra.run.smithi042.stdout:/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9ee40a24a0 msgr2=0x7f9ee40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9ee40a24a0 0x7f9ee40a4960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8104320 tx=0x7f9ee8005f90 comp rx=0 tx=0).stop 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 msgr2=0x7f9ef81045b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef81045b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0000c00 tx=0x7f9ee0004a30 comp rx=0 tx=0).stop 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 shutdown_connections 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ef8102220 0x7f9ef8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ef8101860 0x7f9ef8102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9ee40a24a0 0x7f9ee40a4960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 --2- 172.21.15.42:0/898373216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ef8100670 0x7f9ef81045b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 >> 172.21.15.42:0/898373216 conn(0x7f9ef80fbc00 msgr2=0x7f9ef80fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 shutdown_connections 2024-03-31T23:16:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.728+0000 7f9efdac9640 1 -- 172.21.15.42:0/898373216 wait complete. 2024-03-31T23:16:02.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:16:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 -- 172.21.15.42:0/1503229751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5524103350 msgr2=0x7f5524109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1503229751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5524103350 0x7f5524109be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f551c009ca0 tx=0x7f551c02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 -- 172.21.15.42:0/1503229751 shutdown_connections 2024-03-31T23:16:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1503229751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5524103350 0x7f5524109be0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1503229751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 0x7f5524102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1503229751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55241017a0 0x7f5524101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 -- 172.21.15.42:0/1503229751 >> 172.21.15.42:0/1503229751 conn(0x7f55240fccf0 msgr2=0x7f55240ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 -- 172.21.15.42:0/1503229751 shutdown_connections 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.843+0000 7f552ad6c640 1 -- 172.21.15.42:0/1503229751 wait complete. 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 Processor -- start 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 -- start start 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 0x7f5524075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 0x7f5524073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5524103350 0x7f5524074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f552410d550 con 0x7f55241017a0 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f552410d3d0 con 0x7f5524102990 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f552ad6c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f552410d6d0 con 0x7f5524103350 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 0x7f5524075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 0x7f5524075500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43252/0 (socket says 172.21.15.42:43252) 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 -- 172.21.15.42:0/1678175484 learned_addr learned my addr 172.21.15.42:0/1678175484 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5529309640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5524103350 0x7f5524074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5523fff640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 0x7f5524073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 -- 172.21.15.42:0/1678175484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5524103350 msgr2=0x7f5524074080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5524103350 0x7f5524074080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 -- 172.21.15.42:0/1678175484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 msgr2=0x7f5524073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:02.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 0x7f5524073b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5528b08640 1 -- 172.21.15.42:0/1678175484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55240745c0 con 0x7f55241017a0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.844+0000 7f5523fff640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 0x7f5524073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.845+0000 7f5528b08640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 0x7f5524075500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f551800e9c0 tx=0x7f551800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.845+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551800cd80 con 0x7f55241017a0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.845+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55180035f0 con 0x7f55241017a0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.845+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518010690 con 0x7f55241017a0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.845+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55240748b0 con 0x7f55241017a0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.845+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55241a65c0 con 0x7f55241017a0 2024-03-31T23:16:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.846+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5524068540 con 0x7f55241017a0 2024-03-31T23:16:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.847+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f55180037a0 con 0x7f55241017a0 2024-03-31T23:16:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.847+0000 7f5521ffb640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f55140a2520 0x7f55140a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.847+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f55180ced10 con 0x7f55241017a0 2024-03-31T23:16:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.847+0000 7f5523fff640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f55140a2520 0x7f55140a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.848+0000 7f5523fff640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f55140a2520 0x7f55140a49e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f55100095f0 tx=0x7f5510005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:02.852+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f551809bc90 con 0x7f55241017a0 2024-03-31T23:16:03.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.072+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5524108a60 con 0x7f55241017a0 2024-03-31T23:16:03.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.073+0000 7f5521ffb640 1 -- 172.21.15.42:0/1678175484 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f551809b590 con 0x7f55241017a0 2024-03-31T23:16:03.074 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:03.074 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:16:02.248954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24472,24497,24464,24454,24442]},"id":1}]} 2024-03-31T23:16:03.074 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:16:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f55140a2520 msgr2=0x7f55140a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f55140a2520 0x7f55140a49e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f55100095f0 tx=0x7f5510005f90 comp rx=0 tx=0).stop 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 msgr2=0x7f5524075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 0x7f5524075500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f551800e9c0 tx=0x7f551800ee80 comp rx=0 tx=0).stop 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 shutdown_connections 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5524103350 0x7f5524074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5524102990 0x7f5524073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f55140a2520 0x7f55140a49e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 --2- 172.21.15.42:0/1678175484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55241017a0 0x7f5524075500 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 >> 172.21.15.42:0/1678175484 conn(0x7f55240fccf0 msgr2=0x7f5524105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 shutdown_connections 2024-03-31T23:16:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.077+0000 7f552ad6c640 1 -- 172.21.15.42:0/1678175484 wait complete. 2024-03-31T23:16:03.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 -- 172.21.15.42:0/1714948427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238102220 msgr2=0x7f9238108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 --2- 172.21.15.42:0/1714948427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238102220 0x7f9238108ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9230009ca0 tx=0x7f923002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 -- 172.21.15.42:0/1714948427 shutdown_connections 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 --2- 172.21.15.42:0/1714948427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238102220 0x7f9238108ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 --2- 172.21.15.42:0/1714948427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9238101860 0x7f9238101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 --2- 172.21.15.42:0/1714948427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238100670 0x7f9238100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 -- 172.21.15.42:0/1714948427 >> 172.21.15.42:0/1714948427 conn(0x7f92380fbbe0 msgr2=0x7f92380fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:03.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 -- 172.21.15.42:0/1714948427 shutdown_connections 2024-03-31T23:16:03.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 -- 172.21.15.42:0/1714948427 wait complete. 2024-03-31T23:16:03.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 Processor -- start 2024-03-31T23:16:03.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.196+0000 7f923e7e5640 1 -- start start 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923e7e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 0x7f9238197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923e7e5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238101860 0x7f9238198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923e7e5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9238102220 0x7f923819f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923e7e5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f923810c420 con 0x7f9238100670 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923e7e5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f923810c2a0 con 0x7f9238102220 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923e7e5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f923810c5a0 con 0x7f9238101860 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 0x7f9238197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 0x7f9238197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43278/0 (socket says 172.21.15.42:43278) 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 -- 172.21.15.42:0/2619908099 learned_addr learned my addr 172.21.15.42:0/2619908099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f92377fe640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238101860 0x7f9238198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f923cd82640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9238102220 0x7f923819f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 -- 172.21.15.42:0/2619908099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238101860 msgr2=0x7f9238198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238101860 0x7f9238198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 -- 172.21.15.42:0/2619908099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9238102220 msgr2=0x7f923819f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9238102220 0x7f923819f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 -- 172.21.15.42:0/2619908099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923819f750 con 0x7f9238100670 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f92377fe640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238101860 0x7f9238198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.197+0000 7f9237fff640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 0x7f9238197b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f922800e9c0 tx=0x7f922800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.198+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922800cd80 con 0x7f9238100670 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.198+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923819fa40 con 0x7f9238100670 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.198+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92280035f0 con 0x7f9238100670 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.198+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9228010670 con 0x7f9238100670 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.198+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923819ff40 con 0x7f9238100670 2024-03-31T23:16:03.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.199+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92381a01d0 con 0x7f9238100670 2024-03-31T23:16:03.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.200+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137320+0+0 (secure 0 0 0) 0x7f92280037a0 con 0x7f9238100670 2024-03-31T23:16:03.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.201+0000 7f92357fa640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92240a24a0 0x7f92240a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.201+0000 7f92377fe640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92240a24a0 0x7f92240a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.201+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f92280ced40 con 0x7f9238100670 2024-03-31T23:16:03.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.202+0000 7f92377fe640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92240a24a0 0x7f92240a4960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9238199040 tx=0x7f9220005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:03.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.206+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f922809bc60 con 0x7f9238100670 2024-03-31T23:16:03.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.267+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f9228097bd0 con 0x7f9238100670 2024-03-31T23:16:03.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.397+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92381a03a0 con 0x7f9238100670 2024-03-31T23:16:03.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.399+0000 7f92357fa640 1 -- 172.21.15.42:0/2619908099 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f9228056710 con 0x7f9238100670 2024-03-31T23:16:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:03.400 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:16:03.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92240a24a0 msgr2=0x7f92240a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92240a24a0 0x7f92240a4960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9238199040 tx=0x7f9220005f90 comp rx=0 tx=0).stop 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 msgr2=0x7f9238197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 0x7f9238197b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f922800e9c0 tx=0x7f922800ee80 comp rx=0 tx=0).stop 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 shutdown_connections 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9238102220 0x7f923819f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9238101860 0x7f9238198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92240a24a0 0x7f92240a4960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 --2- 172.21.15.42:0/2619908099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9238100670 0x7f9238197b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 >> 172.21.15.42:0/2619908099 conn(0x7f92380fbbe0 msgr2=0x7f92380fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 shutdown_connections 2024-03-31T23:16:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.401+0000 7f923e7e5640 1 -- 172.21.15.42:0/2619908099 wait complete. 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:active 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: fsmap cephfs:5 7 up:standby 5 up:active 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:03 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1678175484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:16:03.413 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-31T23:16:03.414 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T23:16:03.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 -- 172.21.15.42:0/3454226667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 msgr2=0x7fe4d4106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/3454226667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d4106f10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009900 tx=0x7fe4bc02bc30 comp rx=0 tx=0).stop 2024-03-31T23:16:03.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 -- 172.21.15.42:0/3454226667 shutdown_connections 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/3454226667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4107450 0x7fe4d41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/3454226667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d4106f10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/3454226667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d41021f0 0x7fe4d41045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 -- 172.21.15.42:0/3454226667 >> 172.21.15.42:0/3454226667 conn(0x7fe4d40fbbe0 msgr2=0x7fe4d40fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 -- 172.21.15.42:0/3454226667 shutdown_connections 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.516+0000 7fe4d9f93640 1 -- 172.21.15.42:0/3454226667 wait complete. 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 Processor -- start 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 -- start start 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d41021f0 0x7fe4d4101b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d41001a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4107450 0x7fe4d41006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410d4d0 con 0x7fe4d4104b20 2024-03-31T23:16:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410d350 con 0x7fe4d41021f0 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d9f93640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410d650 con 0x7fe4d4107450 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d41001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d41001a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43298/0 (socket says 172.21.15.42:43298) 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d41021f0 0x7fe4d4101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.517+0000 7fe4d2ffd640 1 -- 172.21.15.42:0/2307978506 learned_addr learned my addr 172.21.15.42:0/2307978506 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d3fff640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4107450 0x7fe4d41006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d2ffd640 1 -- 172.21.15.42:0/2307978506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4107450 msgr2=0x7fe4d41006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d2ffd640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4107450 0x7fe4d41006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d2ffd640 1 -- 172.21.15.42:0/2307978506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d41021f0 msgr2=0x7fe4d4101b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d2ffd640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d41021f0 0x7fe4d4101b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d2ffd640 1 -- 172.21.15.42:0/2307978506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d4100f70 con 0x7fe4d4104b20 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d37fe640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d41021f0 0x7fe4d4101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d2ffd640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d41001a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000c00 tx=0x7fe4bc004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc043020 con 0x7fe4d4104b20 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d41a1d20 con 0x7fe4d4104b20 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4bc004250 con 0x7fe4d4104b20 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc003b90 con 0x7fe4d4104b20 2024-03-31T23:16:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.518+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d41a21c0 con 0x7fe4d4104b20 2024-03-31T23:16:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.519+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d40fd6d0 con 0x7fe4d4104b20 2024-03-31T23:16:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.520+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fe4bc046020 con 0x7fe4d4104b20 2024-03-31T23:16:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.521+0000 7fe4d0ff9640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4c00a2530 0x7fe4c00a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.521+0000 7fe4d37fe640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4c00a2530 0x7fe4c00a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.521+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fe4bc0f0a60 con 0x7fe4d4104b20 2024-03-31T23:16:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.521+0000 7fe4d37fe640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4c00a2530 0x7fe4c00a49f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005fd0 tx=0x7fe4c4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:03.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.525+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe4bc04d020 con 0x7fe4d4104b20 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:active 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: fsmap cephfs:5 7 up:standby 5 up:active 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:03 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1678175484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:16:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.705+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4d4061b90 con 0x7fe4c00a2530 2024-03-31T23:16:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.715+0000 7fe4d0ff9640 1 -- 172.21.15.42:0/2307978506 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340461 (secure 0 0 0) 0x7fe4d4061b90 con 0x7fe4c00a2530 2024-03-31T23:16:03.720 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:16:03.723 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.723 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:active 2024-03-31T23:16:03.723 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: fsmap cephfs:5 7 up:standby 5 up:active 2024-03-31T23:16:03.724 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:16:03.724 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.724 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:16:03.724 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:03 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1678175484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:16:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4c00a2530 msgr2=0x7fe4c00a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4c00a2530 0x7fe4c00a49f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005fd0 tx=0x7fe4c4009500 comp rx=0 tx=0).stop 2024-03-31T23:16:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 msgr2=0x7fe4d41001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d41001a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000c00 tx=0x7fe4bc004a30 comp rx=0 tx=0).stop 2024-03-31T23:16:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 shutdown_connections 2024-03-31T23:16:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4107450 0x7fe4d41006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4c00a2530 0x7fe4c00a49f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4104b20 0x7fe4d41001a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 --2- 172.21.15.42:0/2307978506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d41021f0 0x7fe4d4101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 >> 172.21.15.42:0/2307978506 conn(0x7fe4d40fbbe0 msgr2=0x7fe4d4102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 shutdown_connections 2024-03-31T23:16:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.718+0000 7fe4d9f93640 1 -- 172.21.15.42:0/2307978506 wait complete. 2024-03-31T23:16:03.730 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-03-31T23:16:02.767440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595680,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":250,"num_write_kb":2959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360772,"kb_used_data":11584,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581052,"statfs":{"total":1151940427776,"available":1151570997248,"internally_reserved":0,"allocated":11862016,"data_stored":7522734,"data_compressed":283389,"data_compressed_allocated":380928,"data_compressed_original":2260992,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":813,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003635"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639713+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:15:39.639713+0000","last_peered":"2024-03-31T23:15:39.639713+0000","last_clean":"2024-03-31T23:15:39.639713+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:15:39.639713+0000","last_undegraded":"2024-03-31T23:15:39.639713+0000","last_fullsized":"2024-03-31T23:15:39.639713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108451+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:15:40.108451+0000","last_peered":"2024-03-31T23:15:40.108451+0000","last_clean":"2024-03-31T23:15:40.108451+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:15:40.108451+0000","last_undegraded":"2024-03-31T23:15:40.108451+0000","last_fullsized":"2024-03-31T23:15:40.108451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108389+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:15:40.108389+0000","last_peered":"2024-03-31T23:15:40.108389+0000","last_clean":"2024-03-31T23:15:40.108389+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:15:40.108389+0000","last_undegraded":"2024-03-31T23:15:40.108389+0000","last_fullsized":"2024-03-31T23:15:40.108389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684218+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:15:39.684218+0000","last_peered":"2024-03-31T23:15:39.684218+0000","last_clean":"2024-03-31T23:15:39.684218+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:15:39.684218+0000","last_undegraded":"2024-03-31T23:15:39.684218+0000","last_fullsized":"2024-03-31T23:15:39.684218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465844+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:15:40.465844+0000","last_peered":"2024-03-31T23:15:40.465844+0000","last_clean":"2024-03-31T23:15:40.465844+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:15:40.465844+0000","last_undegraded":"2024-03-31T23:15:40.465844+0000","last_fullsized":"2024-03-31T23:15:40.465844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465665+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:15:40.465665+0000","last_peered":"2024-03-31T23:15:40.465665+0000","last_clean":"2024-03-31T23:15:40.465665+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:15:40.465665+0000","last_undegraded":"2024-03-31T23:15:40.465665+0000","last_fullsized":"2024-03-31T23:15:40.465665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166283+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:15:39.166283+0000","last_peered":"2024-03-31T23:15:39.166283+0000","last_clean":"2024-03-31T23:15:39.166283+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:15:39.166283+0000","last_undegraded":"2024-03-31T23:15:39.166283+0000","last_fullsized":"2024-03-31T23:15:39.166283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465979+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:15:40.465979+0000","last_peered":"2024-03-31T23:15:40.465979+0000","last_clean":"2024-03-31T23:15:40.465979+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:15:40.465979+0000","last_undegraded":"2024-03-31T23:15:40.465979+0000","last_fullsized":"2024-03-31T23:15:40.465979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466124+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:15:40.466124+0000","last_peered":"2024-03-31T23:15:40.466124+0000","last_clean":"2024-03-31T23:15:40.466124+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:15:40.466124+0000","last_undegraded":"2024-03-31T23:15:40.466124+0000","last_fullsized":"2024-03-31T23:15:40.466124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466037+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:15:40.466037+0000","last_peered":"2024-03-31T23:15:40.466037+0000","last_clean":"2024-03-31T23:15:40.466037+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:15:40.466037+0000","last_undegraded":"2024-03-31T23:15:40.466037+0000","last_fullsized":"2024-03-31T23:15:40.466037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166728+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:15:39.166728+0000","last_peered":"2024-03-31T23:15:39.166728+0000","last_clean":"2024-03-31T23:15:39.166728+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:15:39.166728+0000","last_undegraded":"2024-03-31T23:15:39.166728+0000","last_fullsized":"2024-03-31T23:15:39.166728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684068+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:15:39.684068+0000","last_peered":"2024-03-31T23:15:39.684068+0000","last_clean":"2024-03-31T23:15:39.684068+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:15:39.684068+0000","last_undegraded":"2024-03-31T23:15:39.684068+0000","last_fullsized":"2024-03-31T23:15:39.684068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465725+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:15:40.465725+0000","last_peered":"2024-03-31T23:15:40.465725+0000","last_clean":"2024-03-31T23:15:40.465725+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:15:40.465725+0000","last_undegraded":"2024-03-31T23:15:40.465725+0000","last_fullsized":"2024-03-31T23:15:40.465725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108090+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:15:40.108090+0000","last_peered":"2024-03-31T23:15:40.108090+0000","last_clean":"2024-03-31T23:15:40.108090+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:15:40.108090+0000","last_undegraded":"2024-03-31T23:15:40.108090+0000","last_fullsized":"2024-03-31T23:15:40.108090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108160+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:15:40.108160+0000","last_peered":"2024-03-31T23:15:40.108160+0000","last_clean":"2024-03-31T23:15:40.108160+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:15:40.108160+0000","last_undegraded":"2024-03-31T23:15:40.108160+0000","last_fullsized":"2024-03-31T23:15:40.108160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465377+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:15:40.465377+0000","last_peered":"2024-03-31T23:15:40.465377+0000","last_clean":"2024-03-31T23:15:40.465377+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:15:40.465377+0000","last_undegraded":"2024-03-31T23:15:40.465377+0000","last_fullsized":"2024-03-31T23:15:40.465377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639612+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:15:39.639612+0000","last_peered":"2024-03-31T23:15:39.639612+0000","last_clean":"2024-03-31T23:15:39.639612+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:15:39.639612+0000","last_undegraded":"2024-03-31T23:15:39.639612+0000","last_fullsized":"2024-03-31T23:15:39.639612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166785+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:15:39.166785+0000","last_peered":"2024-03-31T23:15:39.166785+0000","last_clean":"2024-03-31T23:15:39.166785+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:15:39.166785+0000","last_undegraded":"2024-03-31T23:15:39.166785+0000","last_fullsized":"2024-03-31T23:15:39.166785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167156+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:15:39.167156+0000","last_peered":"2024-03-31T23:15:39.167156+0000","last_clean":"2024-03-31T23:15:39.167156+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:15:39.167156+0000","last_undegraded":"2024-03-31T23:15:39.167156+0000","last_fullsized":"2024-03-31T23:15:39.167156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167293+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:15:39.167293+0000","last_peered":"2024-03-31T23:15:39.167293+0000","last_clean":"2024-03-31T23:15:39.167293+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:15:39.167293+0000","last_undegraded":"2024-03-31T23:15:39.167293+0000","last_fullsized":"2024-03-31T23:15:39.167293+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166783+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:15:39.166783+0000","last_peered":"2024-03-31T23:15:39.166783+0000","last_clean":"2024-03-31T23:15:39.166783+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:15:39.166783+0000","last_undegraded":"2024-03-31T23:15:39.166783+0000","last_fullsized":"2024-03-31T23:15:39.166783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466479+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:15:40.466479+0000","last_peered":"2024-03-31T23:15:40.466479+0000","last_clean":"2024-03-31T23:15:40.466479+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:15:40.466479+0000","last_undegraded":"2024-03-31T23:15:40.466479+0000","last_fullsized":"2024-03-31T23:15:40.466479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683778+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:15:39.683778+0000","last_peered":"2024-03-31T23:15:39.683778+0000","last_clean":"2024-03-31T23:15:39.683778+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:15:39.683778+0000","last_undegraded":"2024-03-31T23:15:39.683778+0000","last_fullsized":"2024-03-31T23:15:39.683778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466591+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:15:40.466591+0000","last_peered":"2024-03-31T23:15:40.466591+0000","last_clean":"2024-03-31T23:15:40.466591+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:15:40.466591+0000","last_undegraded":"2024-03-31T23:15:40.466591+0000","last_fullsized":"2024-03-31T23:15:40.466591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108460+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:15:40.108460+0000","last_peered":"2024-03-31T23:15:40.108460+0000","last_clean":"2024-03-31T23:15:40.108460+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:15:40.108460+0000","last_undegraded":"2024-03-31T23:15:40.108460+0000","last_fullsized":"2024-03-31T23:15:40.108460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683935+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:15:39.683935+0000","last_peered":"2024-03-31T23:15:39.683935+0000","last_clean":"2024-03-31T23:15:39.683935+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:15:39.683935+0000","last_undegraded":"2024-03-31T23:15:39.683935+0000","last_fullsized":"2024-03-31T23:15:39.683935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466351+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:15:40.466351+0000","last_peered":"2024-03-31T23:15:40.466351+0000","last_clean":"2024-03-31T23:15:40.466351+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:15:40.466351+0000","last_undegraded":"2024-03-31T23:15:40.466351+0000","last_fullsized":"2024-03-31T23:15:40.466351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465898+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:15:40.465898+0000","last_peered":"2024-03-31T23:15:40.465898+0000","last_clean":"2024-03-31T23:15:40.465898+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:15:40.465898+0000","last_undegraded":"2024-03-31T23:15:40.465898+0000","last_fullsized":"2024-03-31T23:15:40.465898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683920+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:15:39.683920+0000","last_peered":"2024-03-31T23:15:39.683920+0000","last_clean":"2024-03-31T23:15:39.683920+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:15:39.683920+0000","last_undegraded":"2024-03-31T23:15:39.683920+0000","last_fullsized":"2024-03-31T23:15:39.683920+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466189+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:15:40.466189+0000","last_peered":"2024-03-31T23:15:40.466189+0000","last_clean":"2024-03-31T23:15:40.466189+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:15:40.466189+0000","last_undegraded":"2024-03-31T23:15:40.466189+0000","last_fullsized":"2024-03-31T23:15:40.466189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338569+0000","last_change":"2024-03-31T23:15:33.842873+0000","last_active":"2024-03-31T23:15:40.338569+0000","last_peered":"2024-03-31T23:15:40.338569+0000","last_clean":"2024-03-31T23:15:40.338569+0000","last_became_active":"2024-03-31T23:15:33.842575+0000","last_became_peered":"2024-03-31T23:15:33.842575+0000","last_unstale":"2024-03-31T23:15:40.338569+0000","last_undegraded":"2024-03-31T23:15:40.338569+0000","last_fullsized":"2024-03-31T23:15:40.338569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:23:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167341+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:15:39.167341+0000","last_peered":"2024-03-31T23:15:39.167341+0000","last_clean":"2024-03-31T23:15:39.167341+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:15:39.167341+0000","last_undegraded":"2024-03-31T23:15:39.167341+0000","last_fullsized":"2024-03-31T23:15:39.167341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338234+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:15:40.338234+0000","last_peered":"2024-03-31T23:15:40.338234+0000","last_clean":"2024-03-31T23:15:40.338234+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:15:40.338234+0000","last_undegraded":"2024-03-31T23:15:40.338234+0000","last_fullsized":"2024-03-31T23:15:40.338234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466007+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:15:40.466007+0000","last_peered":"2024-03-31T23:15:40.466007+0000","last_clean":"2024-03-31T23:15:40.466007+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:15:40.466007+0000","last_undegraded":"2024-03-31T23:15:40.466007+0000","last_fullsized":"2024-03-31T23:15:40.466007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167211+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:15:39.167211+0000","last_peered":"2024-03-31T23:15:39.167211+0000","last_clean":"2024-03-31T23:15:39.167211+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:15:39.167211+0000","last_undegraded":"2024-03-31T23:15:39.167211+0000","last_fullsized":"2024-03-31T23:15:39.167211+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465564+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:15:40.465564+0000","last_peered":"2024-03-31T23:15:40.465564+0000","last_clean":"2024-03-31T23:15:40.465564+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:15:40.465564+0000","last_undegraded":"2024-03-31T23:15:40.465564+0000","last_fullsized":"2024-03-31T23:15:40.465564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338405+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:15:40.338405+0000","last_peered":"2024-03-31T23:15:40.338405+0000","last_clean":"2024-03-31T23:15:40.338405+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:15:40.338405+0000","last_undegraded":"2024-03-31T23:15:40.338405+0000","last_fullsized":"2024-03-31T23:15:40.338405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639781+0000","last_change":"2024-03-31T23:15:38.170646+0000","last_active":"2024-03-31T23:15:39.639781+0000","last_peered":"2024-03-31T23:15:39.639781+0000","last_clean":"2024-03-31T23:15:39.639781+0000","last_became_active":"2024-03-31T23:15:38.170178+0000","last_became_peered":"2024-03-31T23:15:38.170178+0000","last_unstale":"2024-03-31T23:15:39.639781+0000","last_undegraded":"2024-03-31T23:15:39.639781+0000","last_fullsized":"2024-03-31T23:15:39.639781+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:43.944817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465482+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:15:40.465482+0000","last_peered":"2024-03-31T23:15:40.465482+0000","last_clean":"2024-03-31T23:15:40.465482+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:15:40.465482+0000","last_undegraded":"2024-03-31T23:15:40.465482+0000","last_fullsized":"2024-03-31T23:15:40.465482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465404+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:15:40.465404+0000","last_peered":"2024-03-31T23:15:40.465404+0000","last_clean":"2024-03-31T23:15:40.465404+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:15:40.465404+0000","last_undegraded":"2024-03-31T23:15:40.465404+0000","last_fullsized":"2024-03-31T23:15:40.465404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108239+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:15:40.108239+0000","last_peered":"2024-03-31T23:15:40.108239+0000","last_clean":"2024-03-31T23:15:40.108239+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:15:40.108239+0000","last_undegraded":"2024-03-31T23:15:40.108239+0000","last_fullsized":"2024-03-31T23:15:40.108239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338142+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:15:40.338142+0000","last_peered":"2024-03-31T23:15:40.338142+0000","last_clean":"2024-03-31T23:15:40.338142+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:15:40.338142+0000","last_undegraded":"2024-03-31T23:15:40.338142+0000","last_fullsized":"2024-03-31T23:15:40.338142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166287+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:15:39.166287+0000","last_peered":"2024-03-31T23:15:39.166287+0000","last_clean":"2024-03-31T23:15:39.166287+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:15:39.166287+0000","last_undegraded":"2024-03-31T23:15:39.166287+0000","last_fullsized":"2024-03-31T23:15:39.166287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466319+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:15:40.466319+0000","last_peered":"2024-03-31T23:15:40.466319+0000","last_clean":"2024-03-31T23:15:40.466319+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:15:40.466319+0000","last_undegraded":"2024-03-31T23:15:40.466319+0000","last_fullsized":"2024-03-31T23:15:40.466319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:58.231814+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:15:58.231814+0000","last_peered":"2024-03-31T23:15:58.231814+0000","last_clean":"2024-03-31T23:15:58.231814+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:15:58.231814+0000","last_undegraded":"2024-03-31T23:15:58.231814+0000","last_fullsized":"2024-03-31T23:15:58.231814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466174+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:15:40.466174+0000","last_peered":"2024-03-31T23:15:40.466174+0000","last_clean":"2024-03-31T23:15:40.466174+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:15:40.466174+0000","last_undegraded":"2024-03-31T23:15:40.466174+0000","last_fullsized":"2024-03-31T23:15:40.466174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166207+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:15:39.166207+0000","last_peered":"2024-03-31T23:15:39.166207+0000","last_clean":"2024-03-31T23:15:39.166207+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:15:39.166207+0000","last_undegraded":"2024-03-31T23:15:39.166207+0000","last_fullsized":"2024-03-31T23:15:39.166207+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166603+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:15:39.166603+0000","last_peered":"2024-03-31T23:15:39.166603+0000","last_clean":"2024-03-31T23:15:39.166603+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:15:39.166603+0000","last_undegraded":"2024-03-31T23:15:39.166603+0000","last_fullsized":"2024-03-31T23:15:39.166603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108550+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:15:40.108550+0000","last_peered":"2024-03-31T23:15:40.108550+0000","last_clean":"2024-03-31T23:15:40.108550+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:15:40.108550+0000","last_undegraded":"2024-03-31T23:15:40.108550+0000","last_fullsized":"2024-03-31T23:15:40.108550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684031+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:15:39.684031+0000","last_peered":"2024-03-31T23:15:39.684031+0000","last_clean":"2024-03-31T23:15:39.684031+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:15:39.684031+0000","last_undegraded":"2024-03-31T23:15:39.684031+0000","last_fullsized":"2024-03-31T23:15:39.684031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338549+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:15:40.338549+0000","last_peered":"2024-03-31T23:15:40.338549+0000","last_clean":"2024-03-31T23:15:40.338549+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:15:40.338549+0000","last_undegraded":"2024-03-31T23:15:40.338549+0000","last_fullsized":"2024-03-31T23:15:40.338549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466089+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:15:40.466089+0000","last_peered":"2024-03-31T23:15:40.466089+0000","last_clean":"2024-03-31T23:15:40.466089+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:15:40.466089+0000","last_undegraded":"2024-03-31T23:15:40.466089+0000","last_fullsized":"2024-03-31T23:15:40.466089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166225+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:15:39.166225+0000","last_peered":"2024-03-31T23:15:39.166225+0000","last_clean":"2024-03-31T23:15:39.166225+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:15:39.166225+0000","last_undegraded":"2024-03-31T23:15:39.166225+0000","last_fullsized":"2024-03-31T23:15:39.166225+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:58.230559+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:15:58.230559+0000","last_peered":"2024-03-31T23:15:58.230559+0000","last_clean":"2024-03-31T23:15:58.230559+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:15:58.230559+0000","last_undegraded":"2024-03-31T23:15:58.230559+0000","last_fullsized":"2024-03-31T23:15:58.230559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466195+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:15:40.466195+0000","last_peered":"2024-03-31T23:15:40.466195+0000","last_clean":"2024-03-31T23:15:40.466195+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:15:40.466195+0000","last_undegraded":"2024-03-31T23:15:40.466195+0000","last_fullsized":"2024-03-31T23:15:40.466195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338863+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:15:40.338863+0000","last_peered":"2024-03-31T23:15:40.338863+0000","last_clean":"2024-03-31T23:15:40.338863+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:15:40.338863+0000","last_undegraded":"2024-03-31T23:15:40.338863+0000","last_fullsized":"2024-03-31T23:15:40.338863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:59.243558+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:15:59.243558+0000","last_peered":"2024-03-31T23:15:59.243558+0000","last_clean":"2024-03-31T23:15:59.243558+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:15:59.243558+0000","last_undegraded":"2024-03-31T23:15:59.243558+0000","last_fullsized":"2024-03-31T23:15:59.243558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465713+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:15:40.465713+0000","last_peered":"2024-03-31T23:15:40.465713+0000","last_clean":"2024-03-31T23:15:40.465713+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:15:40.465713+0000","last_undegraded":"2024-03-31T23:15:40.465713+0000","last_fullsized":"2024-03-31T23:15:40.465713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639456+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:15:39.639456+0000","last_peered":"2024-03-31T23:15:39.639456+0000","last_clean":"2024-03-31T23:15:39.639456+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:15:39.639456+0000","last_undegraded":"2024-03-31T23:15:39.639456+0000","last_fullsized":"2024-03-31T23:15:39.639456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338349+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:15:40.338349+0000","last_peered":"2024-03-31T23:15:40.338349+0000","last_clean":"2024-03-31T23:15:40.338349+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:15:40.338349+0000","last_undegraded":"2024-03-31T23:15:40.338349+0000","last_fullsized":"2024-03-31T23:15:40.338349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166553+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:15:39.166553+0000","last_peered":"2024-03-31T23:15:39.166553+0000","last_clean":"2024-03-31T23:15:39.166553+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:15:39.166553+0000","last_undegraded":"2024-03-31T23:15:39.166553+0000","last_fullsized":"2024-03-31T23:15:39.166553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166632+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:15:39.166632+0000","last_peered":"2024-03-31T23:15:39.166632+0000","last_clean":"2024-03-31T23:15:39.166632+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:15:39.166632+0000","last_undegraded":"2024-03-31T23:15:39.166632+0000","last_fullsized":"2024-03-31T23:15:39.166632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683795+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:15:39.683795+0000","last_peered":"2024-03-31T23:15:39.683795+0000","last_clean":"2024-03-31T23:15:39.683795+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:15:39.683795+0000","last_undegraded":"2024-03-31T23:15:39.683795+0000","last_fullsized":"2024-03-31T23:15:39.683795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166347+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:15:39.166347+0000","last_peered":"2024-03-31T23:15:39.166347+0000","last_clean":"2024-03-31T23:15:39.166347+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:15:39.166347+0000","last_undegraded":"2024-03-31T23:15:39.166347+0000","last_fullsized":"2024-03-31T23:15:39.166347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465762+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:15:40.465762+0000","last_peered":"2024-03-31T23:15:40.465762+0000","last_clean":"2024-03-31T23:15:40.465762+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:15:40.465762+0000","last_undegraded":"2024-03-31T23:15:40.465762+0000","last_fullsized":"2024-03-31T23:15:40.465762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465717+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:15:40.465717+0000","last_peered":"2024-03-31T23:15:40.465717+0000","last_clean":"2024-03-31T23:15:40.465717+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:15:40.465717+0000","last_undegraded":"2024-03-31T23:15:40.465717+0000","last_fullsized":"2024-03-31T23:15:40.465717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338123+0000","last_change":"2024-03-31T23:15:33.842558+0000","last_active":"2024-03-31T23:15:40.338123+0000","last_peered":"2024-03-31T23:15:40.338123+0000","last_clean":"2024-03-31T23:15:40.338123+0000","last_became_active":"2024-03-31T23:15:33.841668+0000","last_became_peered":"2024-03-31T23:15:33.841668+0000","last_unstale":"2024-03-31T23:15:40.338123+0000","last_undegraded":"2024-03-31T23:15:40.338123+0000","last_fullsized":"2024-03-31T23:15:40.338123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:25:43.053101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338168+0000","last_change":"2024-03-31T23:15:38.173177+0000","last_active":"2024-03-31T23:15:40.338168+0000","last_peered":"2024-03-31T23:15:40.338168+0000","last_clean":"2024-03-31T23:15:40.338168+0000","last_became_active":"2024-03-31T23:15:38.172731+0000","last_became_peered":"2024-03-31T23:15:38.172731+0000","last_unstale":"2024-03-31T23:15:40.338168+0000","last_undegraded":"2024-03-31T23:15:40.338168+0000","last_fullsized":"2024-03-31T23:15:40.338168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:26:17.367137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466281+0000","last_change":"2024-03-31T23:15:32.845556+0000","last_active":"2024-03-31T23:15:40.466281+0000","last_peered":"2024-03-31T23:15:40.466281+0000","last_clean":"2024-03-31T23:15:40.466281+0000","last_became_active":"2024-03-31T23:15:32.844930+0000","last_became_peered":"2024-03-31T23:15:32.844930+0000","last_unstale":"2024-03-31T23:15:40.466281+0000","last_undegraded":"2024-03-31T23:15:40.466281+0000","last_fullsized":"2024-03-31T23:15:40.466281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:05:55.177072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639537+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:15:39.639537+0000","last_peered":"2024-03-31T23:15:39.639537+0000","last_clean":"2024-03-31T23:15:39.639537+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:15:39.639537+0000","last_undegraded":"2024-03-31T23:15:39.639537+0000","last_fullsized":"2024-03-31T23:15:39.639537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466119+0000","last_change":"2024-03-31T23:15:38.164729+0000","last_active":"2024-03-31T23:15:40.466119+0000","last_peered":"2024-03-31T23:15:40.466119+0000","last_clean":"2024-03-31T23:15:40.466119+0000","last_became_active":"2024-03-31T23:15:38.164300+0000","last_became_peered":"2024-03-31T23:15:38.164300+0000","last_unstale":"2024-03-31T23:15:40.466119+0000","last_undegraded":"2024-03-31T23:15:40.466119+0000","last_fullsized":"2024-03-31T23:15:40.466119+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:26:55.011374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166488+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:15:39.166488+0000","last_peered":"2024-03-31T23:15:39.166488+0000","last_clean":"2024-03-31T23:15:39.166488+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:15:39.166488+0000","last_undegraded":"2024-03-31T23:15:39.166488+0000","last_fullsized":"2024-03-31T23:15:39.166488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465664+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:15:40.465664+0000","last_peered":"2024-03-31T23:15:40.465664+0000","last_clean":"2024-03-31T23:15:40.465664+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:15:40.465664+0000","last_undegraded":"2024-03-31T23:15:40.465664+0000","last_fullsized":"2024-03-31T23:15:40.465664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465944+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:15:40.465944+0000","last_peered":"2024-03-31T23:15:40.465944+0000","last_clean":"2024-03-31T23:15:40.465944+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:15:40.465944+0000","last_undegraded":"2024-03-31T23:15:40.465944+0000","last_fullsized":"2024-03-31T23:15:40.465944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166385+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:15:39.166385+0000","last_peered":"2024-03-31T23:15:39.166385+0000","last_clean":"2024-03-31T23:15:39.166385+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:15:39.166385+0000","last_undegraded":"2024-03-31T23:15:39.166385+0000","last_fullsized":"2024-03-31T23:15:39.166385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465518+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:15:40.465518+0000","last_peered":"2024-03-31T23:15:40.465518+0000","last_clean":"2024-03-31T23:15:40.465518+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:15:40.465518+0000","last_undegraded":"2024-03-31T23:15:40.465518+0000","last_fullsized":"2024-03-31T23:15:40.465518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465556+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:15:40.465556+0000","last_peered":"2024-03-31T23:15:40.465556+0000","last_clean":"2024-03-31T23:15:40.465556+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:15:40.465556+0000","last_undegraded":"2024-03-31T23:15:40.465556+0000","last_fullsized":"2024-03-31T23:15:40.465556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338303+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:15:40.338303+0000","last_peered":"2024-03-31T23:15:40.338303+0000","last_clean":"2024-03-31T23:15:40.338303+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:15:40.338303+0000","last_undegraded":"2024-03-31T23:15:40.338303+0000","last_fullsized":"2024-03-31T23:15:40.338303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465437+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:15:40.465437+0000","last_peered":"2024-03-31T23:15:40.465437+0000","last_clean":"2024-03-31T23:15:40.465437+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:15:40.465437+0000","last_undegraded":"2024-03-31T23:15:40.465437+0000","last_fullsized":"2024-03-31T23:15:40.465437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166782+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:15:39.166782+0000","last_peered":"2024-03-31T23:15:39.166782+0000","last_clean":"2024-03-31T23:15:39.166782+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:15:39.166782+0000","last_undegraded":"2024-03-31T23:15:39.166782+0000","last_fullsized":"2024-03-31T23:15:39.166782+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466499+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:15:40.466499+0000","last_peered":"2024-03-31T23:15:40.466499+0000","last_clean":"2024-03-31T23:15:40.466499+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:15:40.466499+0000","last_undegraded":"2024-03-31T23:15:40.466499+0000","last_fullsized":"2024-03-31T23:15:40.466499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683836+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:15:39.683836+0000","last_peered":"2024-03-31T23:15:39.683836+0000","last_clean":"2024-03-31T23:15:39.683836+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:15:39.683836+0000","last_undegraded":"2024-03-31T23:15:39.683836+0000","last_fullsized":"2024-03-31T23:15:39.683836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":358,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166237+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:15:39.166237+0000","last_peered":"2024-03-31T23:15:39.166237+0000","last_clean":"2024-03-31T23:15:39.166237+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:15:39.166237+0000","last_undegraded":"2024-03-31T23:15:39.166237+0000","last_fullsized":"2024-03-31T23:15:39.166237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338706+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:15:40.338706+0000","last_peered":"2024-03-31T23:15:40.338706+0000","last_clean":"2024-03-31T23:15:40.338706+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:15:40.338706+0000","last_undegraded":"2024-03-31T23:15:40.338706+0000","last_fullsized":"2024-03-31T23:15:40.338706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465312+0000","last_change":"2024-03-31T23:15:33.845702+0000","last_active":"2024-03-31T23:15:40.465312+0000","last_peered":"2024-03-31T23:15:40.465312+0000","last_clean":"2024-03-31T23:15:40.465312+0000","last_became_active":"2024-03-31T23:15:33.844321+0000","last_became_peered":"2024-03-31T23:15:33.844321+0000","last_unstale":"2024-03-31T23:15:40.465312+0000","last_undegraded":"2024-03-31T23:15:40.465312+0000","last_fullsized":"2024-03-31T23:15:40.465312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:55:08.546684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166295+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:15:39.166295+0000","last_peered":"2024-03-31T23:15:39.166295+0000","last_clean":"2024-03-31T23:15:39.166295+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:15:39.166295+0000","last_undegraded":"2024-03-31T23:15:39.166295+0000","last_fullsized":"2024-03-31T23:15:39.166295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639391+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:15:39.639391+0000","last_peered":"2024-03-31T23:15:39.639391+0000","last_clean":"2024-03-31T23:15:39.639391+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:15:39.639391+0000","last_undegraded":"2024-03-31T23:15:39.639391+0000","last_fullsized":"2024-03-31T23:15:39.639391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466216+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:15:40.466216+0000","last_peered":"2024-03-31T23:15:40.466216+0000","last_clean":"2024-03-31T23:15:40.466216+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:15:40.466216+0000","last_undegraded":"2024-03-31T23:15:40.466216+0000","last_fullsized":"2024-03-31T23:15:40.466216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466057+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:15:40.466057+0000","last_peered":"2024-03-31T23:15:40.466057+0000","last_clean":"2024-03-31T23:15:40.466057+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:15:40.466057+0000","last_undegraded":"2024-03-31T23:15:40.466057+0000","last_fullsized":"2024-03-31T23:15:40.466057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465450+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:15:40.465450+0000","last_peered":"2024-03-31T23:15:40.465450+0000","last_clean":"2024-03-31T23:15:40.465450+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:15:40.465450+0000","last_undegraded":"2024-03-31T23:15:40.465450+0000","last_fullsized":"2024-03-31T23:15:40.465450+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166861+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:15:39.166861+0000","last_peered":"2024-03-31T23:15:39.166861+0000","last_clean":"2024-03-31T23:15:39.166861+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:15:39.166861+0000","last_undegraded":"2024-03-31T23:15:39.166861+0000","last_fullsized":"2024-03-31T23:15:39.166861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466422+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:15:40.466422+0000","last_peered":"2024-03-31T23:15:40.466422+0000","last_clean":"2024-03-31T23:15:40.466422+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:15:40.466422+0000","last_undegraded":"2024-03-31T23:15:40.466422+0000","last_fullsized":"2024-03-31T23:15:40.466422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166706+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:15:39.166706+0000","last_peered":"2024-03-31T23:15:39.166706+0000","last_clean":"2024-03-31T23:15:39.166706+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:15:39.166706+0000","last_undegraded":"2024-03-31T23:15:39.166706+0000","last_fullsized":"2024-03-31T23:15:39.166706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684268+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:15:39.684268+0000","last_peered":"2024-03-31T23:15:39.684268+0000","last_clean":"2024-03-31T23:15:39.684268+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:15:39.684268+0000","last_undegraded":"2024-03-31T23:15:39.684268+0000","last_fullsized":"2024-03-31T23:15:39.684268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108543+0000","last_change":"2024-03-31T23:15:33.842622+0000","last_active":"2024-03-31T23:15:40.108543+0000","last_peered":"2024-03-31T23:15:40.108543+0000","last_clean":"2024-03-31T23:15:40.108543+0000","last_became_active":"2024-03-31T23:15:33.842269+0000","last_became_peered":"2024-03-31T23:15:33.842269+0000","last_unstale":"2024-03-31T23:15:40.108543+0000","last_undegraded":"2024-03-31T23:15:40.108543+0000","last_fullsized":"2024-03-31T23:15:40.108543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:16.334999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684157+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:15:39.684157+0000","last_peered":"2024-03-31T23:15:39.684157+0000","last_clean":"2024-03-31T23:15:39.684157+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:15:39.684157+0000","last_undegraded":"2024-03-31T23:15:39.684157+0000","last_fullsized":"2024-03-31T23:15:39.684157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:58.230539+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:15:58.230539+0000","last_peered":"2024-03-31T23:15:58.230539+0000","last_clean":"2024-03-31T23:15:58.230539+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:15:58.230539+0000","last_undegraded":"2024-03-31T23:15:58.230539+0000","last_fullsized":"2024-03-31T23:15:58.230539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465692+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:15:40.465692+0000","last_peered":"2024-03-31T23:15:40.465692+0000","last_clean":"2024-03-31T23:15:40.465692+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:15:40.465692+0000","last_undegraded":"2024-03-31T23:15:40.465692+0000","last_fullsized":"2024-03-31T23:15:40.465692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166826+0000","last_change":"2024-03-31T23:15:38.174594+0000","last_active":"2024-03-31T23:15:39.166826+0000","last_peered":"2024-03-31T23:15:39.166826+0000","last_clean":"2024-03-31T23:15:39.166826+0000","last_became_active":"2024-03-31T23:15:38.174047+0000","last_became_peered":"2024-03-31T23:15:38.174047+0000","last_unstale":"2024-03-31T23:15:39.166826+0000","last_undegraded":"2024-03-31T23:15:39.166826+0000","last_fullsized":"2024-03-31T23:15:39.166826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:17:56.015910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466125+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:15:40.466125+0000","last_peered":"2024-03-31T23:15:40.466125+0000","last_clean":"2024-03-31T23:15:40.466125+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:15:40.466125+0000","last_undegraded":"2024-03-31T23:15:40.466125+0000","last_fullsized":"2024-03-31T23:15:40.466125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639182+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:15:39.639182+0000","last_peered":"2024-03-31T23:15:39.639182+0000","last_clean":"2024-03-31T23:15:39.639182+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:15:39.639182+0000","last_undegraded":"2024-03-31T23:15:39.639182+0000","last_fullsized":"2024-03-31T23:15:39.639182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684041+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:15:39.684041+0000","last_peered":"2024-03-31T23:15:39.684041+0000","last_clean":"2024-03-31T23:15:39.684041+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:15:39.684041+0000","last_undegraded":"2024-03-31T23:15:39.684041+0000","last_fullsized":"2024-03-31T23:15:39.684041+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166728+0000","last_change":"2024-03-31T23:15:32.837573+0000","last_active":"2024-03-31T23:15:39.166728+0000","last_peered":"2024-03-31T23:15:39.166728+0000","last_clean":"2024-03-31T23:15:39.166728+0000","last_became_active":"2024-03-31T23:15:32.837257+0000","last_became_peered":"2024-03-31T23:15:32.837257+0000","last_unstale":"2024-03-31T23:15:39.166728+0000","last_undegraded":"2024-03-31T23:15:39.166728+0000","last_fullsized":"2024-03-31T23:15:39.166728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:03:47.140969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466353+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:15:40.466353+0000","last_peered":"2024-03-31T23:15:40.466353+0000","last_clean":"2024-03-31T23:15:40.466353+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:15:40.466353+0000","last_undegraded":"2024-03-31T23:15:40.466353+0000","last_fullsized":"2024-03-31T23:15:40.466353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684115+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:15:39.684115+0000","last_peered":"2024-03-31T23:15:39.684115+0000","last_clean":"2024-03-31T23:15:39.684115+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:15:39.684115+0000","last_undegraded":"2024-03-31T23:15:39.684115+0000","last_fullsized":"2024-03-31T23:15:39.684115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465856+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:15:40.465856+0000","last_peered":"2024-03-31T23:15:40.465856+0000","last_clean":"2024-03-31T23:15:40.465856+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:15:40.465856+0000","last_undegraded":"2024-03-31T23:15:40.465856+0000","last_fullsized":"2024-03-31T23:15:40.465856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166493+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:15:39.166493+0000","last_peered":"2024-03-31T23:15:39.166493+0000","last_clean":"2024-03-31T23:15:39.166493+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:15:39.166493+0000","last_undegraded":"2024-03-31T23:15:39.166493+0000","last_fullsized":"2024-03-31T23:15:39.166493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465834+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:15:40.465834+0000","last_peered":"2024-03-31T23:15:40.465834+0000","last_clean":"2024-03-31T23:15:40.465834+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:15:40.465834+0000","last_undegraded":"2024-03-31T23:15:40.465834+0000","last_fullsized":"2024-03-31T23:15:40.465834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:59.243311+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:15:59.243311+0000","last_peered":"2024-03-31T23:15:59.243311+0000","last_clean":"2024-03-31T23:15:59.243311+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:15:59.243311+0000","last_undegraded":"2024-03-31T23:15:59.243311+0000","last_fullsized":"2024-03-31T23:15:59.243311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166819+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:15:39.166819+0000","last_peered":"2024-03-31T23:15:39.166819+0000","last_clean":"2024-03-31T23:15:39.166819+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:15:39.166819+0000","last_undegraded":"2024-03-31T23:15:39.166819+0000","last_fullsized":"2024-03-31T23:15:39.166819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108122+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:15:40.108122+0000","last_peered":"2024-03-31T23:15:40.108122+0000","last_clean":"2024-03-31T23:15:40.108122+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:15:40.108122+0000","last_undegraded":"2024-03-31T23:15:40.108122+0000","last_fullsized":"2024-03-31T23:15:40.108122+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338677+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:15:40.338677+0000","last_peered":"2024-03-31T23:15:40.338677+0000","last_clean":"2024-03-31T23:15:40.338677+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:15:40.338677+0000","last_undegraded":"2024-03-31T23:15:40.338677+0000","last_fullsized":"2024-03-31T23:15:40.338677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166475+0000","last_change":"2024-03-31T23:15:33.851537+0000","last_active":"2024-03-31T23:15:39.166475+0000","last_peered":"2024-03-31T23:15:39.166475+0000","last_clean":"2024-03-31T23:15:39.166475+0000","last_became_active":"2024-03-31T23:15:33.851146+0000","last_became_peered":"2024-03-31T23:15:33.851146+0000","last_unstale":"2024-03-31T23:15:39.166475+0000","last_undegraded":"2024-03-31T23:15:39.166475+0000","last_fullsized":"2024-03-31T23:15:39.166475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:36:36.549600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.337974+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:15:40.337974+0000","last_peered":"2024-03-31T23:15:40.337974+0000","last_clean":"2024-03-31T23:15:40.337974+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:15:40.337974+0000","last_undegraded":"2024-03-31T23:15:40.337974+0000","last_fullsized":"2024-03-31T23:15:40.337974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465658+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:15:40.465658+0000","last_peered":"2024-03-31T23:15:40.465658+0000","last_clean":"2024-03-31T23:15:40.465658+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:15:40.465658+0000","last_undegraded":"2024-03-31T23:15:40.465658+0000","last_fullsized":"2024-03-31T23:15:40.465658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166700+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:15:39.166700+0000","last_peered":"2024-03-31T23:15:39.166700+0000","last_clean":"2024-03-31T23:15:39.166700+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:15:39.166700+0000","last_undegraded":"2024-03-31T23:15:39.166700+0000","last_fullsized":"2024-03-31T23:15:39.166700+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639264+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:15:39.639264+0000","last_peered":"2024-03-31T23:15:39.639264+0000","last_clean":"2024-03-31T23:15:39.639264+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:15:39.639264+0000","last_undegraded":"2024-03-31T23:15:39.639264+0000","last_fullsized":"2024-03-31T23:15:39.639264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167074+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:15:39.167074+0000","last_peered":"2024-03-31T23:15:39.167074+0000","last_clean":"2024-03-31T23:15:39.167074+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:15:39.167074+0000","last_undegraded":"2024-03-31T23:15:39.167074+0000","last_fullsized":"2024-03-31T23:15:39.167074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166583+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:15:39.166583+0000","last_peered":"2024-03-31T23:15:39.166583+0000","last_clean":"2024-03-31T23:15:39.166583+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:15:39.166583+0000","last_undegraded":"2024-03-31T23:15:39.166583+0000","last_fullsized":"2024-03-31T23:15:39.166583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108304+0000","last_change":"2024-03-31T23:15:33.841880+0000","last_active":"2024-03-31T23:15:40.108304+0000","last_peered":"2024-03-31T23:15:40.108304+0000","last_clean":"2024-03-31T23:15:40.108304+0000","last_became_active":"2024-03-31T23:15:33.841315+0000","last_became_peered":"2024-03-31T23:15:33.841315+0000","last_unstale":"2024-03-31T23:15:40.108304+0000","last_undegraded":"2024-03-31T23:15:40.108304+0000","last_fullsized":"2024-03-31T23:15:40.108304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:29:04.120169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465989+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:15:40.465989+0000","last_peered":"2024-03-31T23:15:40.465989+0000","last_clean":"2024-03-31T23:15:40.465989+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:15:40.465989+0000","last_undegraded":"2024-03-31T23:15:40.465989+0000","last_fullsized":"2024-03-31T23:15:40.465989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639597+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:15:39.639597+0000","last_peered":"2024-03-31T23:15:39.639597+0000","last_clean":"2024-03-31T23:15:39.639597+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:15:39.639597+0000","last_undegraded":"2024-03-31T23:15:39.639597+0000","last_fullsized":"2024-03-31T23:15:39.639597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167204+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:15:39.167204+0000","last_peered":"2024-03-31T23:15:39.167204+0000","last_clean":"2024-03-31T23:15:39.167204+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:15:39.167204+0000","last_undegraded":"2024-03-31T23:15:39.167204+0000","last_fullsized":"2024-03-31T23:15:39.167204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466530+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:15:40.466530+0000","last_peered":"2024-03-31T23:15:40.466530+0000","last_clean":"2024-03-31T23:15:40.466530+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:15:40.466530+0000","last_undegraded":"2024-03-31T23:15:40.466530+0000","last_fullsized":"2024-03-31T23:15:40.466530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338139+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:15:40.338139+0000","last_peered":"2024-03-31T23:15:40.338139+0000","last_clean":"2024-03-31T23:15:40.338139+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:15:40.338139+0000","last_undegraded":"2024-03-31T23:15:40.338139+0000","last_fullsized":"2024-03-31T23:15:40.338139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466141+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:15:40.466141+0000","last_peered":"2024-03-31T23:15:40.466141+0000","last_clean":"2024-03-31T23:15:40.466141+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:15:40.466141+0000","last_undegraded":"2024-03-31T23:15:40.466141+0000","last_fullsized":"2024-03-31T23:15:40.466141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466012+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:15:40.466012+0000","last_peered":"2024-03-31T23:15:40.466012+0000","last_clean":"2024-03-31T23:15:40.466012+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:15:40.466012+0000","last_undegraded":"2024-03-31T23:15:40.466012+0000","last_fullsized":"2024-03-31T23:15:40.466012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465808+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:15:40.465808+0000","last_peered":"2024-03-31T23:15:40.465808+0000","last_clean":"2024-03-31T23:15:40.465808+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:15:40.465808+0000","last_undegraded":"2024-03-31T23:15:40.465808+0000","last_fullsized":"2024-03-31T23:15:40.465808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639378+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:15:39.639378+0000","last_peered":"2024-03-31T23:15:39.639378+0000","last_clean":"2024-03-31T23:15:39.639378+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:15:39.639378+0000","last_undegraded":"2024-03-31T23:15:39.639378+0000","last_fullsized":"2024-03-31T23:15:39.639378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5312,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":25744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":478407,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":1072381,"data_compressed":50513,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":477999,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":477819,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1015808,"data_stored":1068165,"data_compressed":50513,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":477215,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":489409,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":966656,"data_stored":477305,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":481713,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":477319,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477237,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":1067765,"data_compressed":50513,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:16:03.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/1813338696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981018e0 msgr2=0x7f9e98101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/1813338696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981018e0 0x7f9e98101d60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009860 tx=0x7f9e8c02bb70 comp rx=0 tx=0).stop 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/1813338696 shutdown_connections 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/1813338696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981022a0 0x7f9e98108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/1813338696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981018e0 0x7f9e98101d60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/1813338696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981006f0 0x7f9e98100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/1813338696 >> 172.21.15.42:0/1813338696 conn(0x7f9e980fbc60 msgr2=0x7f9e980fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/1813338696 shutdown_connections 2024-03-31T23:16:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.873+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/1813338696 wait complete. 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 Processor -- start 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 -- start start 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 0x7f9e98197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981018e0 0x7f9e981980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981022a0 0x7f9e9819f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9810d530 con 0x7f9e981006f0 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9810d3b0 con 0x7f9e981018e0 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e9d7dd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9810d6b0 con 0x7f9e981022a0 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 0x7f9e98197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 0x7f9e98197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46738/0 (socket says 172.21.15.42:46738) 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 -- 172.21.15.42:0/3949981600 learned_addr learned my addr 172.21.15.42:0/3949981600 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e967fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981018e0 0x7f9e981980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e977fe640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981022a0 0x7f9e9819f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 -- 172.21.15.42:0/3949981600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981022a0 msgr2=0x7f9e9819f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981022a0 0x7f9e9819f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 -- 172.21.15.42:0/3949981600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981018e0 msgr2=0x7f9e981980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981018e0 0x7f9e981980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e96ffd640 1 -- 172.21.15.42:0/3949981600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9819f7c0 con 0x7f9e981006f0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.874+0000 7f9e967fc640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981018e0 0x7f9e981980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.875+0000 7f9e96ffd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 0x7f9e98197ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800e9c0 tx=0x7f9e8800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.875+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800cd80 con 0x7f9e981006f0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.875+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9819fab0 con 0x7f9e981006f0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.875+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e880035f0 con 0x7f9e981006f0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.875+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88010670 con 0x7f9e981006f0 2024-03-31T23:16:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.875+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9819ff80 con 0x7f9e981006f0 2024-03-31T23:16:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.876+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e98107a10 con 0x7f9e981006f0 2024-03-31T23:16:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.877+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f9e880037a0 con 0x7f9e981006f0 2024-03-31T23:16:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.877+0000 7f9e7ffff640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9e800a2530 0x7f9e800a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.878+0000 7f9e967fc640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9e800a2530 0x7f9e800a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.878+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f9e880cee70 con 0x7f9e981006f0 2024-03-31T23:16:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.878+0000 7f9e967fc640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9e800a2530 0x7f9e800a49f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c02c180 tx=0x7f9e8c034b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:03.882+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9e8809bc90 con 0x7f9e981006f0 2024-03-31T23:16:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.060+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e98061b90 con 0x7f9e800a2530 2024-03-31T23:16:04.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.070+0000 7f9e7ffff640 1 -- 172.21.15.42:0/3949981600 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340461 (secure 0 0 0) 0x7f9e98061b90 con 0x7f9e800a2530 2024-03-31T23:16:04.074 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:04.076 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:16:04.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9e800a2530 msgr2=0x7f9e800a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9e800a2530 0x7f9e800a49f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c02c180 tx=0x7f9e8c034b70 comp rx=0 tx=0).stop 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 msgr2=0x7f9e98197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 0x7f9e98197ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800e9c0 tx=0x7f9e8800ee80 comp rx=0 tx=0).stop 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 shutdown_connections 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e981022a0 0x7f9e9819f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e981018e0 0x7f9e981980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9e800a2530 0x7f9e800a49f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 --2- 172.21.15.42:0/3949981600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e981006f0 0x7f9e98197ba0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.073+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 >> 172.21.15.42:0/3949981600 conn(0x7f9e980fbc60 msgr2=0x7f9e98104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.074+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 shutdown_connections 2024-03-31T23:16:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:04.074+0000 7f9e9d7dd640 1 -- 172.21.15.42:0/3949981600 wait complete. 2024-03-31T23:16:04.085 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-03-31T23:16:02.767440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595680,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":250,"num_write_kb":2959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360772,"kb_used_data":11584,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581052,"statfs":{"total":1151940427776,"available":1151570997248,"internally_reserved":0,"allocated":11862016,"data_stored":7522734,"data_compressed":283389,"data_compressed_allocated":380928,"data_compressed_original":2260992,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":813,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003635"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639713+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:15:39.639713+0000","last_peered":"2024-03-31T23:15:39.639713+0000","last_clean":"2024-03-31T23:15:39.639713+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:15:39.639713+0000","last_undegraded":"2024-03-31T23:15:39.639713+0000","last_fullsized":"2024-03-31T23:15:39.639713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108451+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:15:40.108451+0000","last_peered":"2024-03-31T23:15:40.108451+0000","last_clean":"2024-03-31T23:15:40.108451+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:15:40.108451+0000","last_undegraded":"2024-03-31T23:15:40.108451+0000","last_fullsized":"2024-03-31T23:15:40.108451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108389+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:15:40.108389+0000","last_peered":"2024-03-31T23:15:40.108389+0000","last_clean":"2024-03-31T23:15:40.108389+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:15:40.108389+0000","last_undegraded":"2024-03-31T23:15:40.108389+0000","last_fullsized":"2024-03-31T23:15:40.108389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684218+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:15:39.684218+0000","last_peered":"2024-03-31T23:15:39.684218+0000","last_clean":"2024-03-31T23:15:39.684218+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:15:39.684218+0000","last_undegraded":"2024-03-31T23:15:39.684218+0000","last_fullsized":"2024-03-31T23:15:39.684218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465844+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:15:40.465844+0000","last_peered":"2024-03-31T23:15:40.465844+0000","last_clean":"2024-03-31T23:15:40.465844+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:15:40.465844+0000","last_undegraded":"2024-03-31T23:15:40.465844+0000","last_fullsized":"2024-03-31T23:15:40.465844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465665+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:15:40.465665+0000","last_peered":"2024-03-31T23:15:40.465665+0000","last_clean":"2024-03-31T23:15:40.465665+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:15:40.465665+0000","last_undegraded":"2024-03-31T23:15:40.465665+0000","last_fullsized":"2024-03-31T23:15:40.465665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166283+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:15:39.166283+0000","last_peered":"2024-03-31T23:15:39.166283+0000","last_clean":"2024-03-31T23:15:39.166283+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:15:39.166283+0000","last_undegraded":"2024-03-31T23:15:39.166283+0000","last_fullsized":"2024-03-31T23:15:39.166283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465979+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:15:40.465979+0000","last_peered":"2024-03-31T23:15:40.465979+0000","last_clean":"2024-03-31T23:15:40.465979+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:15:40.465979+0000","last_undegraded":"2024-03-31T23:15:40.465979+0000","last_fullsized":"2024-03-31T23:15:40.465979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466124+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:15:40.466124+0000","last_peered":"2024-03-31T23:15:40.466124+0000","last_clean":"2024-03-31T23:15:40.466124+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:15:40.466124+0000","last_undegraded":"2024-03-31T23:15:40.466124+0000","last_fullsized":"2024-03-31T23:15:40.466124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466037+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:15:40.466037+0000","last_peered":"2024-03-31T23:15:40.466037+0000","last_clean":"2024-03-31T23:15:40.466037+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:15:40.466037+0000","last_undegraded":"2024-03-31T23:15:40.466037+0000","last_fullsized":"2024-03-31T23:15:40.466037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166728+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:15:39.166728+0000","last_peered":"2024-03-31T23:15:39.166728+0000","last_clean":"2024-03-31T23:15:39.166728+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:15:39.166728+0000","last_undegraded":"2024-03-31T23:15:39.166728+0000","last_fullsized":"2024-03-31T23:15:39.166728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684068+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:15:39.684068+0000","last_peered":"2024-03-31T23:15:39.684068+0000","last_clean":"2024-03-31T23:15:39.684068+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:15:39.684068+0000","last_undegraded":"2024-03-31T23:15:39.684068+0000","last_fullsized":"2024-03-31T23:15:39.684068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465725+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:15:40.465725+0000","last_peered":"2024-03-31T23:15:40.465725+0000","last_clean":"2024-03-31T23:15:40.465725+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:15:40.465725+0000","last_undegraded":"2024-03-31T23:15:40.465725+0000","last_fullsized":"2024-03-31T23:15:40.465725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108090+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:15:40.108090+0000","last_peered":"2024-03-31T23:15:40.108090+0000","last_clean":"2024-03-31T23:15:40.108090+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:15:40.108090+0000","last_undegraded":"2024-03-31T23:15:40.108090+0000","last_fullsized":"2024-03-31T23:15:40.108090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108160+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:15:40.108160+0000","last_peered":"2024-03-31T23:15:40.108160+0000","last_clean":"2024-03-31T23:15:40.108160+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:15:40.108160+0000","last_undegraded":"2024-03-31T23:15:40.108160+0000","last_fullsized":"2024-03-31T23:15:40.108160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465377+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:15:40.465377+0000","last_peered":"2024-03-31T23:15:40.465377+0000","last_clean":"2024-03-31T23:15:40.465377+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:15:40.465377+0000","last_undegraded":"2024-03-31T23:15:40.465377+0000","last_fullsized":"2024-03-31T23:15:40.465377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639612+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:15:39.639612+0000","last_peered":"2024-03-31T23:15:39.639612+0000","last_clean":"2024-03-31T23:15:39.639612+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:15:39.639612+0000","last_undegraded":"2024-03-31T23:15:39.639612+0000","last_fullsized":"2024-03-31T23:15:39.639612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166785+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:15:39.166785+0000","last_peered":"2024-03-31T23:15:39.166785+0000","last_clean":"2024-03-31T23:15:39.166785+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:15:39.166785+0000","last_undegraded":"2024-03-31T23:15:39.166785+0000","last_fullsized":"2024-03-31T23:15:39.166785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167156+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:15:39.167156+0000","last_peered":"2024-03-31T23:15:39.167156+0000","last_clean":"2024-03-31T23:15:39.167156+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:15:39.167156+0000","last_undegraded":"2024-03-31T23:15:39.167156+0000","last_fullsized":"2024-03-31T23:15:39.167156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167293+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:15:39.167293+0000","last_peered":"2024-03-31T23:15:39.167293+0000","last_clean":"2024-03-31T23:15:39.167293+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:15:39.167293+0000","last_undegraded":"2024-03-31T23:15:39.167293+0000","last_fullsized":"2024-03-31T23:15:39.167293+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166783+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:15:39.166783+0000","last_peered":"2024-03-31T23:15:39.166783+0000","last_clean":"2024-03-31T23:15:39.166783+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:15:39.166783+0000","last_undegraded":"2024-03-31T23:15:39.166783+0000","last_fullsized":"2024-03-31T23:15:39.166783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466479+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:15:40.466479+0000","last_peered":"2024-03-31T23:15:40.466479+0000","last_clean":"2024-03-31T23:15:40.466479+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:15:40.466479+0000","last_undegraded":"2024-03-31T23:15:40.466479+0000","last_fullsized":"2024-03-31T23:15:40.466479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683778+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:15:39.683778+0000","last_peered":"2024-03-31T23:15:39.683778+0000","last_clean":"2024-03-31T23:15:39.683778+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:15:39.683778+0000","last_undegraded":"2024-03-31T23:15:39.683778+0000","last_fullsized":"2024-03-31T23:15:39.683778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466591+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:15:40.466591+0000","last_peered":"2024-03-31T23:15:40.466591+0000","last_clean":"2024-03-31T23:15:40.466591+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:15:40.466591+0000","last_undegraded":"2024-03-31T23:15:40.466591+0000","last_fullsized":"2024-03-31T23:15:40.466591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108460+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:15:40.108460+0000","last_peered":"2024-03-31T23:15:40.108460+0000","last_clean":"2024-03-31T23:15:40.108460+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:15:40.108460+0000","last_undegraded":"2024-03-31T23:15:40.108460+0000","last_fullsized":"2024-03-31T23:15:40.108460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683935+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:15:39.683935+0000","last_peered":"2024-03-31T23:15:39.683935+0000","last_clean":"2024-03-31T23:15:39.683935+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:15:39.683935+0000","last_undegraded":"2024-03-31T23:15:39.683935+0000","last_fullsized":"2024-03-31T23:15:39.683935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466351+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:15:40.466351+0000","last_peered":"2024-03-31T23:15:40.466351+0000","last_clean":"2024-03-31T23:15:40.466351+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:15:40.466351+0000","last_undegraded":"2024-03-31T23:15:40.466351+0000","last_fullsized":"2024-03-31T23:15:40.466351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465898+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:15:40.465898+0000","last_peered":"2024-03-31T23:15:40.465898+0000","last_clean":"2024-03-31T23:15:40.465898+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:15:40.465898+0000","last_undegraded":"2024-03-31T23:15:40.465898+0000","last_fullsized":"2024-03-31T23:15:40.465898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683920+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:15:39.683920+0000","last_peered":"2024-03-31T23:15:39.683920+0000","last_clean":"2024-03-31T23:15:39.683920+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:15:39.683920+0000","last_undegraded":"2024-03-31T23:15:39.683920+0000","last_fullsized":"2024-03-31T23:15:39.683920+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466189+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:15:40.466189+0000","last_peered":"2024-03-31T23:15:40.466189+0000","last_clean":"2024-03-31T23:15:40.466189+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:15:40.466189+0000","last_undegraded":"2024-03-31T23:15:40.466189+0000","last_fullsized":"2024-03-31T23:15:40.466189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338569+0000","last_change":"2024-03-31T23:15:33.842873+0000","last_active":"2024-03-31T23:15:40.338569+0000","last_peered":"2024-03-31T23:15:40.338569+0000","last_clean":"2024-03-31T23:15:40.338569+0000","last_became_active":"2024-03-31T23:15:33.842575+0000","last_became_peered":"2024-03-31T23:15:33.842575+0000","last_unstale":"2024-03-31T23:15:40.338569+0000","last_undegraded":"2024-03-31T23:15:40.338569+0000","last_fullsized":"2024-03-31T23:15:40.338569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:23:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167341+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:15:39.167341+0000","last_peered":"2024-03-31T23:15:39.167341+0000","last_clean":"2024-03-31T23:15:39.167341+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:15:39.167341+0000","last_undegraded":"2024-03-31T23:15:39.167341+0000","last_fullsized":"2024-03-31T23:15:39.167341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338234+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:15:40.338234+0000","last_peered":"2024-03-31T23:15:40.338234+0000","last_clean":"2024-03-31T23:15:40.338234+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:15:40.338234+0000","last_undegraded":"2024-03-31T23:15:40.338234+0000","last_fullsized":"2024-03-31T23:15:40.338234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466007+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:15:40.466007+0000","last_peered":"2024-03-31T23:15:40.466007+0000","last_clean":"2024-03-31T23:15:40.466007+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:15:40.466007+0000","last_undegraded":"2024-03-31T23:15:40.466007+0000","last_fullsized":"2024-03-31T23:15:40.466007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167211+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:15:39.167211+0000","last_peered":"2024-03-31T23:15:39.167211+0000","last_clean":"2024-03-31T23:15:39.167211+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:15:39.167211+0000","last_undegraded":"2024-03-31T23:15:39.167211+0000","last_fullsized":"2024-03-31T23:15:39.167211+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465564+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:15:40.465564+0000","last_peered":"2024-03-31T23:15:40.465564+0000","last_clean":"2024-03-31T23:15:40.465564+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:15:40.465564+0000","last_undegraded":"2024-03-31T23:15:40.465564+0000","last_fullsized":"2024-03-31T23:15:40.465564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338405+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:15:40.338405+0000","last_peered":"2024-03-31T23:15:40.338405+0000","last_clean":"2024-03-31T23:15:40.338405+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:15:40.338405+0000","last_undegraded":"2024-03-31T23:15:40.338405+0000","last_fullsized":"2024-03-31T23:15:40.338405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639781+0000","last_change":"2024-03-31T23:15:38.170646+0000","last_active":"2024-03-31T23:15:39.639781+0000","last_peered":"2024-03-31T23:15:39.639781+0000","last_clean":"2024-03-31T23:15:39.639781+0000","last_became_active":"2024-03-31T23:15:38.170178+0000","last_became_peered":"2024-03-31T23:15:38.170178+0000","last_unstale":"2024-03-31T23:15:39.639781+0000","last_undegraded":"2024-03-31T23:15:39.639781+0000","last_fullsized":"2024-03-31T23:15:39.639781+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:43.944817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465482+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:15:40.465482+0000","last_peered":"2024-03-31T23:15:40.465482+0000","last_clean":"2024-03-31T23:15:40.465482+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:15:40.465482+0000","last_undegraded":"2024-03-31T23:15:40.465482+0000","last_fullsized":"2024-03-31T23:15:40.465482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465404+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:15:40.465404+0000","last_peered":"2024-03-31T23:15:40.465404+0000","last_clean":"2024-03-31T23:15:40.465404+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:15:40.465404+0000","last_undegraded":"2024-03-31T23:15:40.465404+0000","last_fullsized":"2024-03-31T23:15:40.465404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108239+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:15:40.108239+0000","last_peered":"2024-03-31T23:15:40.108239+0000","last_clean":"2024-03-31T23:15:40.108239+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:15:40.108239+0000","last_undegraded":"2024-03-31T23:15:40.108239+0000","last_fullsized":"2024-03-31T23:15:40.108239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338142+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:15:40.338142+0000","last_peered":"2024-03-31T23:15:40.338142+0000","last_clean":"2024-03-31T23:15:40.338142+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:15:40.338142+0000","last_undegraded":"2024-03-31T23:15:40.338142+0000","last_fullsized":"2024-03-31T23:15:40.338142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166287+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:15:39.166287+0000","last_peered":"2024-03-31T23:15:39.166287+0000","last_clean":"2024-03-31T23:15:39.166287+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:15:39.166287+0000","last_undegraded":"2024-03-31T23:15:39.166287+0000","last_fullsized":"2024-03-31T23:15:39.166287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466319+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:15:40.466319+0000","last_peered":"2024-03-31T23:15:40.466319+0000","last_clean":"2024-03-31T23:15:40.466319+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:15:40.466319+0000","last_undegraded":"2024-03-31T23:15:40.466319+0000","last_fullsized":"2024-03-31T23:15:40.466319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:58.231814+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:15:58.231814+0000","last_peered":"2024-03-31T23:15:58.231814+0000","last_clean":"2024-03-31T23:15:58.231814+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:15:58.231814+0000","last_undegraded":"2024-03-31T23:15:58.231814+0000","last_fullsized":"2024-03-31T23:15:58.231814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466174+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:15:40.466174+0000","last_peered":"2024-03-31T23:15:40.466174+0000","last_clean":"2024-03-31T23:15:40.466174+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:15:40.466174+0000","last_undegraded":"2024-03-31T23:15:40.466174+0000","last_fullsized":"2024-03-31T23:15:40.466174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166207+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:15:39.166207+0000","last_peered":"2024-03-31T23:15:39.166207+0000","last_clean":"2024-03-31T23:15:39.166207+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:15:39.166207+0000","last_undegraded":"2024-03-31T23:15:39.166207+0000","last_fullsized":"2024-03-31T23:15:39.166207+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166603+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:15:39.166603+0000","last_peered":"2024-03-31T23:15:39.166603+0000","last_clean":"2024-03-31T23:15:39.166603+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:15:39.166603+0000","last_undegraded":"2024-03-31T23:15:39.166603+0000","last_fullsized":"2024-03-31T23:15:39.166603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108550+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:15:40.108550+0000","last_peered":"2024-03-31T23:15:40.108550+0000","last_clean":"2024-03-31T23:15:40.108550+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:15:40.108550+0000","last_undegraded":"2024-03-31T23:15:40.108550+0000","last_fullsized":"2024-03-31T23:15:40.108550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684031+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:15:39.684031+0000","last_peered":"2024-03-31T23:15:39.684031+0000","last_clean":"2024-03-31T23:15:39.684031+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:15:39.684031+0000","last_undegraded":"2024-03-31T23:15:39.684031+0000","last_fullsized":"2024-03-31T23:15:39.684031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338549+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:15:40.338549+0000","last_peered":"2024-03-31T23:15:40.338549+0000","last_clean":"2024-03-31T23:15:40.338549+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:15:40.338549+0000","last_undegraded":"2024-03-31T23:15:40.338549+0000","last_fullsized":"2024-03-31T23:15:40.338549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466089+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:15:40.466089+0000","last_peered":"2024-03-31T23:15:40.466089+0000","last_clean":"2024-03-31T23:15:40.466089+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:15:40.466089+0000","last_undegraded":"2024-03-31T23:15:40.466089+0000","last_fullsized":"2024-03-31T23:15:40.466089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166225+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:15:39.166225+0000","last_peered":"2024-03-31T23:15:39.166225+0000","last_clean":"2024-03-31T23:15:39.166225+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:15:39.166225+0000","last_undegraded":"2024-03-31T23:15:39.166225+0000","last_fullsized":"2024-03-31T23:15:39.166225+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:58.230559+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:15:58.230559+0000","last_peered":"2024-03-31T23:15:58.230559+0000","last_clean":"2024-03-31T23:15:58.230559+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:15:58.230559+0000","last_undegraded":"2024-03-31T23:15:58.230559+0000","last_fullsized":"2024-03-31T23:15:58.230559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466195+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:15:40.466195+0000","last_peered":"2024-03-31T23:15:40.466195+0000","last_clean":"2024-03-31T23:15:40.466195+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:15:40.466195+0000","last_undegraded":"2024-03-31T23:15:40.466195+0000","last_fullsized":"2024-03-31T23:15:40.466195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338863+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:15:40.338863+0000","last_peered":"2024-03-31T23:15:40.338863+0000","last_clean":"2024-03-31T23:15:40.338863+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:15:40.338863+0000","last_undegraded":"2024-03-31T23:15:40.338863+0000","last_fullsized":"2024-03-31T23:15:40.338863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:59.243558+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:15:59.243558+0000","last_peered":"2024-03-31T23:15:59.243558+0000","last_clean":"2024-03-31T23:15:59.243558+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:15:59.243558+0000","last_undegraded":"2024-03-31T23:15:59.243558+0000","last_fullsized":"2024-03-31T23:15:59.243558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465713+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:15:40.465713+0000","last_peered":"2024-03-31T23:15:40.465713+0000","last_clean":"2024-03-31T23:15:40.465713+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:15:40.465713+0000","last_undegraded":"2024-03-31T23:15:40.465713+0000","last_fullsized":"2024-03-31T23:15:40.465713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639456+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:15:39.639456+0000","last_peered":"2024-03-31T23:15:39.639456+0000","last_clean":"2024-03-31T23:15:39.639456+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:15:39.639456+0000","last_undegraded":"2024-03-31T23:15:39.639456+0000","last_fullsized":"2024-03-31T23:15:39.639456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338349+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:15:40.338349+0000","last_peered":"2024-03-31T23:15:40.338349+0000","last_clean":"2024-03-31T23:15:40.338349+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:15:40.338349+0000","last_undegraded":"2024-03-31T23:15:40.338349+0000","last_fullsized":"2024-03-31T23:15:40.338349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166553+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:15:39.166553+0000","last_peered":"2024-03-31T23:15:39.166553+0000","last_clean":"2024-03-31T23:15:39.166553+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:15:39.166553+0000","last_undegraded":"2024-03-31T23:15:39.166553+0000","last_fullsized":"2024-03-31T23:15:39.166553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166632+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:15:39.166632+0000","last_peered":"2024-03-31T23:15:39.166632+0000","last_clean":"2024-03-31T23:15:39.166632+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:15:39.166632+0000","last_undegraded":"2024-03-31T23:15:39.166632+0000","last_fullsized":"2024-03-31T23:15:39.166632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683795+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:15:39.683795+0000","last_peered":"2024-03-31T23:15:39.683795+0000","last_clean":"2024-03-31T23:15:39.683795+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:15:39.683795+0000","last_undegraded":"2024-03-31T23:15:39.683795+0000","last_fullsized":"2024-03-31T23:15:39.683795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166347+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:15:39.166347+0000","last_peered":"2024-03-31T23:15:39.166347+0000","last_clean":"2024-03-31T23:15:39.166347+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:15:39.166347+0000","last_undegraded":"2024-03-31T23:15:39.166347+0000","last_fullsized":"2024-03-31T23:15:39.166347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465762+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:15:40.465762+0000","last_peered":"2024-03-31T23:15:40.465762+0000","last_clean":"2024-03-31T23:15:40.465762+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:15:40.465762+0000","last_undegraded":"2024-03-31T23:15:40.465762+0000","last_fullsized":"2024-03-31T23:15:40.465762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465717+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:15:40.465717+0000","last_peered":"2024-03-31T23:15:40.465717+0000","last_clean":"2024-03-31T23:15:40.465717+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:15:40.465717+0000","last_undegraded":"2024-03-31T23:15:40.465717+0000","last_fullsized":"2024-03-31T23:15:40.465717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338123+0000","last_change":"2024-03-31T23:15:33.842558+0000","last_active":"2024-03-31T23:15:40.338123+0000","last_peered":"2024-03-31T23:15:40.338123+0000","last_clean":"2024-03-31T23:15:40.338123+0000","last_became_active":"2024-03-31T23:15:33.841668+0000","last_became_peered":"2024-03-31T23:15:33.841668+0000","last_unstale":"2024-03-31T23:15:40.338123+0000","last_undegraded":"2024-03-31T23:15:40.338123+0000","last_fullsized":"2024-03-31T23:15:40.338123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:25:43.053101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338168+0000","last_change":"2024-03-31T23:15:38.173177+0000","last_active":"2024-03-31T23:15:40.338168+0000","last_peered":"2024-03-31T23:15:40.338168+0000","last_clean":"2024-03-31T23:15:40.338168+0000","last_became_active":"2024-03-31T23:15:38.172731+0000","last_became_peered":"2024-03-31T23:15:38.172731+0000","last_unstale":"2024-03-31T23:15:40.338168+0000","last_undegraded":"2024-03-31T23:15:40.338168+0000","last_fullsized":"2024-03-31T23:15:40.338168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:26:17.367137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466281+0000","last_change":"2024-03-31T23:15:32.845556+0000","last_active":"2024-03-31T23:15:40.466281+0000","last_peered":"2024-03-31T23:15:40.466281+0000","last_clean":"2024-03-31T23:15:40.466281+0000","last_became_active":"2024-03-31T23:15:32.844930+0000","last_became_peered":"2024-03-31T23:15:32.844930+0000","last_unstale":"2024-03-31T23:15:40.466281+0000","last_undegraded":"2024-03-31T23:15:40.466281+0000","last_fullsized":"2024-03-31T23:15:40.466281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:05:55.177072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639537+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:15:39.639537+0000","last_peered":"2024-03-31T23:15:39.639537+0000","last_clean":"2024-03-31T23:15:39.639537+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:15:39.639537+0000","last_undegraded":"2024-03-31T23:15:39.639537+0000","last_fullsized":"2024-03-31T23:15:39.639537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466119+0000","last_change":"2024-03-31T23:15:38.164729+0000","last_active":"2024-03-31T23:15:40.466119+0000","last_peered":"2024-03-31T23:15:40.466119+0000","last_clean":"2024-03-31T23:15:40.466119+0000","last_became_active":"2024-03-31T23:15:38.164300+0000","last_became_peered":"2024-03-31T23:15:38.164300+0000","last_unstale":"2024-03-31T23:15:40.466119+0000","last_undegraded":"2024-03-31T23:15:40.466119+0000","last_fullsized":"2024-03-31T23:15:40.466119+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:26:55.011374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166488+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:15:39.166488+0000","last_peered":"2024-03-31T23:15:39.166488+0000","last_clean":"2024-03-31T23:15:39.166488+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:15:39.166488+0000","last_undegraded":"2024-03-31T23:15:39.166488+0000","last_fullsized":"2024-03-31T23:15:39.166488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465664+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:15:40.465664+0000","last_peered":"2024-03-31T23:15:40.465664+0000","last_clean":"2024-03-31T23:15:40.465664+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:15:40.465664+0000","last_undegraded":"2024-03-31T23:15:40.465664+0000","last_fullsized":"2024-03-31T23:15:40.465664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465944+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:15:40.465944+0000","last_peered":"2024-03-31T23:15:40.465944+0000","last_clean":"2024-03-31T23:15:40.465944+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:15:40.465944+0000","last_undegraded":"2024-03-31T23:15:40.465944+0000","last_fullsized":"2024-03-31T23:15:40.465944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166385+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:15:39.166385+0000","last_peered":"2024-03-31T23:15:39.166385+0000","last_clean":"2024-03-31T23:15:39.166385+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:15:39.166385+0000","last_undegraded":"2024-03-31T23:15:39.166385+0000","last_fullsized":"2024-03-31T23:15:39.166385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465518+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:15:40.465518+0000","last_peered":"2024-03-31T23:15:40.465518+0000","last_clean":"2024-03-31T23:15:40.465518+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:15:40.465518+0000","last_undegraded":"2024-03-31T23:15:40.465518+0000","last_fullsized":"2024-03-31T23:15:40.465518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465556+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:15:40.465556+0000","last_peered":"2024-03-31T23:15:40.465556+0000","last_clean":"2024-03-31T23:15:40.465556+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:15:40.465556+0000","last_undegraded":"2024-03-31T23:15:40.465556+0000","last_fullsized":"2024-03-31T23:15:40.465556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338303+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:15:40.338303+0000","last_peered":"2024-03-31T23:15:40.338303+0000","last_clean":"2024-03-31T23:15:40.338303+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:15:40.338303+0000","last_undegraded":"2024-03-31T23:15:40.338303+0000","last_fullsized":"2024-03-31T23:15:40.338303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465437+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:15:40.465437+0000","last_peered":"2024-03-31T23:15:40.465437+0000","last_clean":"2024-03-31T23:15:40.465437+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:15:40.465437+0000","last_undegraded":"2024-03-31T23:15:40.465437+0000","last_fullsized":"2024-03-31T23:15:40.465437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166782+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:15:39.166782+0000","last_peered":"2024-03-31T23:15:39.166782+0000","last_clean":"2024-03-31T23:15:39.166782+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:15:39.166782+0000","last_undegraded":"2024-03-31T23:15:39.166782+0000","last_fullsized":"2024-03-31T23:15:39.166782+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466499+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:15:40.466499+0000","last_peered":"2024-03-31T23:15:40.466499+0000","last_clean":"2024-03-31T23:15:40.466499+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:15:40.466499+0000","last_undegraded":"2024-03-31T23:15:40.466499+0000","last_fullsized":"2024-03-31T23:15:40.466499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.683836+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:15:39.683836+0000","last_peered":"2024-03-31T23:15:39.683836+0000","last_clean":"2024-03-31T23:15:39.683836+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:15:39.683836+0000","last_undegraded":"2024-03-31T23:15:39.683836+0000","last_fullsized":"2024-03-31T23:15:39.683836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":358,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166237+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:15:39.166237+0000","last_peered":"2024-03-31T23:15:39.166237+0000","last_clean":"2024-03-31T23:15:39.166237+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:15:39.166237+0000","last_undegraded":"2024-03-31T23:15:39.166237+0000","last_fullsized":"2024-03-31T23:15:39.166237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338706+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:15:40.338706+0000","last_peered":"2024-03-31T23:15:40.338706+0000","last_clean":"2024-03-31T23:15:40.338706+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:15:40.338706+0000","last_undegraded":"2024-03-31T23:15:40.338706+0000","last_fullsized":"2024-03-31T23:15:40.338706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465312+0000","last_change":"2024-03-31T23:15:33.845702+0000","last_active":"2024-03-31T23:15:40.465312+0000","last_peered":"2024-03-31T23:15:40.465312+0000","last_clean":"2024-03-31T23:15:40.465312+0000","last_became_active":"2024-03-31T23:15:33.844321+0000","last_became_peered":"2024-03-31T23:15:33.844321+0000","last_unstale":"2024-03-31T23:15:40.465312+0000","last_undegraded":"2024-03-31T23:15:40.465312+0000","last_fullsized":"2024-03-31T23:15:40.465312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:55:08.546684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166295+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:15:39.166295+0000","last_peered":"2024-03-31T23:15:39.166295+0000","last_clean":"2024-03-31T23:15:39.166295+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:15:39.166295+0000","last_undegraded":"2024-03-31T23:15:39.166295+0000","last_fullsized":"2024-03-31T23:15:39.166295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639391+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:15:39.639391+0000","last_peered":"2024-03-31T23:15:39.639391+0000","last_clean":"2024-03-31T23:15:39.639391+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:15:39.639391+0000","last_undegraded":"2024-03-31T23:15:39.639391+0000","last_fullsized":"2024-03-31T23:15:39.639391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466216+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:15:40.466216+0000","last_peered":"2024-03-31T23:15:40.466216+0000","last_clean":"2024-03-31T23:15:40.466216+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:15:40.466216+0000","last_undegraded":"2024-03-31T23:15:40.466216+0000","last_fullsized":"2024-03-31T23:15:40.466216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466057+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:15:40.466057+0000","last_peered":"2024-03-31T23:15:40.466057+0000","last_clean":"2024-03-31T23:15:40.466057+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:15:40.466057+0000","last_undegraded":"2024-03-31T23:15:40.466057+0000","last_fullsized":"2024-03-31T23:15:40.466057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465450+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:15:40.465450+0000","last_peered":"2024-03-31T23:15:40.465450+0000","last_clean":"2024-03-31T23:15:40.465450+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:15:40.465450+0000","last_undegraded":"2024-03-31T23:15:40.465450+0000","last_fullsized":"2024-03-31T23:15:40.465450+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166861+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:15:39.166861+0000","last_peered":"2024-03-31T23:15:39.166861+0000","last_clean":"2024-03-31T23:15:39.166861+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:15:39.166861+0000","last_undegraded":"2024-03-31T23:15:39.166861+0000","last_fullsized":"2024-03-31T23:15:39.166861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466422+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:15:40.466422+0000","last_peered":"2024-03-31T23:15:40.466422+0000","last_clean":"2024-03-31T23:15:40.466422+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:15:40.466422+0000","last_undegraded":"2024-03-31T23:15:40.466422+0000","last_fullsized":"2024-03-31T23:15:40.466422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166706+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:15:39.166706+0000","last_peered":"2024-03-31T23:15:39.166706+0000","last_clean":"2024-03-31T23:15:39.166706+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:15:39.166706+0000","last_undegraded":"2024-03-31T23:15:39.166706+0000","last_fullsized":"2024-03-31T23:15:39.166706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684268+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:15:39.684268+0000","last_peered":"2024-03-31T23:15:39.684268+0000","last_clean":"2024-03-31T23:15:39.684268+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:15:39.684268+0000","last_undegraded":"2024-03-31T23:15:39.684268+0000","last_fullsized":"2024-03-31T23:15:39.684268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108543+0000","last_change":"2024-03-31T23:15:33.842622+0000","last_active":"2024-03-31T23:15:40.108543+0000","last_peered":"2024-03-31T23:15:40.108543+0000","last_clean":"2024-03-31T23:15:40.108543+0000","last_became_active":"2024-03-31T23:15:33.842269+0000","last_became_peered":"2024-03-31T23:15:33.842269+0000","last_unstale":"2024-03-31T23:15:40.108543+0000","last_undegraded":"2024-03-31T23:15:40.108543+0000","last_fullsized":"2024-03-31T23:15:40.108543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:16.334999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684157+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:15:39.684157+0000","last_peered":"2024-03-31T23:15:39.684157+0000","last_clean":"2024-03-31T23:15:39.684157+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:15:39.684157+0000","last_undegraded":"2024-03-31T23:15:39.684157+0000","last_fullsized":"2024-03-31T23:15:39.684157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:58.230539+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:15:58.230539+0000","last_peered":"2024-03-31T23:15:58.230539+0000","last_clean":"2024-03-31T23:15:58.230539+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:15:58.230539+0000","last_undegraded":"2024-03-31T23:15:58.230539+0000","last_fullsized":"2024-03-31T23:15:58.230539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465692+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:15:40.465692+0000","last_peered":"2024-03-31T23:15:40.465692+0000","last_clean":"2024-03-31T23:15:40.465692+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:15:40.465692+0000","last_undegraded":"2024-03-31T23:15:40.465692+0000","last_fullsized":"2024-03-31T23:15:40.465692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166826+0000","last_change":"2024-03-31T23:15:38.174594+0000","last_active":"2024-03-31T23:15:39.166826+0000","last_peered":"2024-03-31T23:15:39.166826+0000","last_clean":"2024-03-31T23:15:39.166826+0000","last_became_active":"2024-03-31T23:15:38.174047+0000","last_became_peered":"2024-03-31T23:15:38.174047+0000","last_unstale":"2024-03-31T23:15:39.166826+0000","last_undegraded":"2024-03-31T23:15:39.166826+0000","last_fullsized":"2024-03-31T23:15:39.166826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:17:56.015910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466125+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:15:40.466125+0000","last_peered":"2024-03-31T23:15:40.466125+0000","last_clean":"2024-03-31T23:15:40.466125+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:15:40.466125+0000","last_undegraded":"2024-03-31T23:15:40.466125+0000","last_fullsized":"2024-03-31T23:15:40.466125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639182+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:15:39.639182+0000","last_peered":"2024-03-31T23:15:39.639182+0000","last_clean":"2024-03-31T23:15:39.639182+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:15:39.639182+0000","last_undegraded":"2024-03-31T23:15:39.639182+0000","last_fullsized":"2024-03-31T23:15:39.639182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684041+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:15:39.684041+0000","last_peered":"2024-03-31T23:15:39.684041+0000","last_clean":"2024-03-31T23:15:39.684041+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:15:39.684041+0000","last_undegraded":"2024-03-31T23:15:39.684041+0000","last_fullsized":"2024-03-31T23:15:39.684041+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166728+0000","last_change":"2024-03-31T23:15:32.837573+0000","last_active":"2024-03-31T23:15:39.166728+0000","last_peered":"2024-03-31T23:15:39.166728+0000","last_clean":"2024-03-31T23:15:39.166728+0000","last_became_active":"2024-03-31T23:15:32.837257+0000","last_became_peered":"2024-03-31T23:15:32.837257+0000","last_unstale":"2024-03-31T23:15:39.166728+0000","last_undegraded":"2024-03-31T23:15:39.166728+0000","last_fullsized":"2024-03-31T23:15:39.166728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:03:47.140969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466353+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:15:40.466353+0000","last_peered":"2024-03-31T23:15:40.466353+0000","last_clean":"2024-03-31T23:15:40.466353+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:15:40.466353+0000","last_undegraded":"2024-03-31T23:15:40.466353+0000","last_fullsized":"2024-03-31T23:15:40.466353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.684115+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:15:39.684115+0000","last_peered":"2024-03-31T23:15:39.684115+0000","last_clean":"2024-03-31T23:15:39.684115+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:15:39.684115+0000","last_undegraded":"2024-03-31T23:15:39.684115+0000","last_fullsized":"2024-03-31T23:15:39.684115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465856+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:15:40.465856+0000","last_peered":"2024-03-31T23:15:40.465856+0000","last_clean":"2024-03-31T23:15:40.465856+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:15:40.465856+0000","last_undegraded":"2024-03-31T23:15:40.465856+0000","last_fullsized":"2024-03-31T23:15:40.465856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166493+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:15:39.166493+0000","last_peered":"2024-03-31T23:15:39.166493+0000","last_clean":"2024-03-31T23:15:39.166493+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:15:39.166493+0000","last_undegraded":"2024-03-31T23:15:39.166493+0000","last_fullsized":"2024-03-31T23:15:39.166493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465834+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:15:40.465834+0000","last_peered":"2024-03-31T23:15:40.465834+0000","last_clean":"2024-03-31T23:15:40.465834+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:15:40.465834+0000","last_undegraded":"2024-03-31T23:15:40.465834+0000","last_fullsized":"2024-03-31T23:15:40.465834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:59.243311+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:15:59.243311+0000","last_peered":"2024-03-31T23:15:59.243311+0000","last_clean":"2024-03-31T23:15:59.243311+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:15:59.243311+0000","last_undegraded":"2024-03-31T23:15:59.243311+0000","last_fullsized":"2024-03-31T23:15:59.243311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166819+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:15:39.166819+0000","last_peered":"2024-03-31T23:15:39.166819+0000","last_clean":"2024-03-31T23:15:39.166819+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:15:39.166819+0000","last_undegraded":"2024-03-31T23:15:39.166819+0000","last_fullsized":"2024-03-31T23:15:39.166819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108122+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:15:40.108122+0000","last_peered":"2024-03-31T23:15:40.108122+0000","last_clean":"2024-03-31T23:15:40.108122+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:15:40.108122+0000","last_undegraded":"2024-03-31T23:15:40.108122+0000","last_fullsized":"2024-03-31T23:15:40.108122+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338677+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:15:40.338677+0000","last_peered":"2024-03-31T23:15:40.338677+0000","last_clean":"2024-03-31T23:15:40.338677+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:15:40.338677+0000","last_undegraded":"2024-03-31T23:15:40.338677+0000","last_fullsized":"2024-03-31T23:15:40.338677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166475+0000","last_change":"2024-03-31T23:15:33.851537+0000","last_active":"2024-03-31T23:15:39.166475+0000","last_peered":"2024-03-31T23:15:39.166475+0000","last_clean":"2024-03-31T23:15:39.166475+0000","last_became_active":"2024-03-31T23:15:33.851146+0000","last_became_peered":"2024-03-31T23:15:33.851146+0000","last_unstale":"2024-03-31T23:15:39.166475+0000","last_undegraded":"2024-03-31T23:15:39.166475+0000","last_fullsized":"2024-03-31T23:15:39.166475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:36:36.549600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.337974+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:15:40.337974+0000","last_peered":"2024-03-31T23:15:40.337974+0000","last_clean":"2024-03-31T23:15:40.337974+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:15:40.337974+0000","last_undegraded":"2024-03-31T23:15:40.337974+0000","last_fullsized":"2024-03-31T23:15:40.337974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465658+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:15:40.465658+0000","last_peered":"2024-03-31T23:15:40.465658+0000","last_clean":"2024-03-31T23:15:40.465658+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:15:40.465658+0000","last_undegraded":"2024-03-31T23:15:40.465658+0000","last_fullsized":"2024-03-31T23:15:40.465658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166700+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:15:39.166700+0000","last_peered":"2024-03-31T23:15:39.166700+0000","last_clean":"2024-03-31T23:15:39.166700+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:15:39.166700+0000","last_undegraded":"2024-03-31T23:15:39.166700+0000","last_fullsized":"2024-03-31T23:15:39.166700+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639264+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:15:39.639264+0000","last_peered":"2024-03-31T23:15:39.639264+0000","last_clean":"2024-03-31T23:15:39.639264+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:15:39.639264+0000","last_undegraded":"2024-03-31T23:15:39.639264+0000","last_fullsized":"2024-03-31T23:15:39.639264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167074+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:15:39.167074+0000","last_peered":"2024-03-31T23:15:39.167074+0000","last_clean":"2024-03-31T23:15:39.167074+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:15:39.167074+0000","last_undegraded":"2024-03-31T23:15:39.167074+0000","last_fullsized":"2024-03-31T23:15:39.167074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.166583+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:15:39.166583+0000","last_peered":"2024-03-31T23:15:39.166583+0000","last_clean":"2024-03-31T23:15:39.166583+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:15:39.166583+0000","last_undegraded":"2024-03-31T23:15:39.166583+0000","last_fullsized":"2024-03-31T23:15:39.166583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.108304+0000","last_change":"2024-03-31T23:15:33.841880+0000","last_active":"2024-03-31T23:15:40.108304+0000","last_peered":"2024-03-31T23:15:40.108304+0000","last_clean":"2024-03-31T23:15:40.108304+0000","last_became_active":"2024-03-31T23:15:33.841315+0000","last_became_peered":"2024-03-31T23:15:33.841315+0000","last_unstale":"2024-03-31T23:15:40.108304+0000","last_undegraded":"2024-03-31T23:15:40.108304+0000","last_fullsized":"2024-03-31T23:15:40.108304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:29:04.120169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465989+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:15:40.465989+0000","last_peered":"2024-03-31T23:15:40.465989+0000","last_clean":"2024-03-31T23:15:40.465989+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:15:40.465989+0000","last_undegraded":"2024-03-31T23:15:40.465989+0000","last_fullsized":"2024-03-31T23:15:40.465989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639597+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:15:39.639597+0000","last_peered":"2024-03-31T23:15:39.639597+0000","last_clean":"2024-03-31T23:15:39.639597+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:15:39.639597+0000","last_undegraded":"2024-03-31T23:15:39.639597+0000","last_fullsized":"2024-03-31T23:15:39.639597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.167204+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:15:39.167204+0000","last_peered":"2024-03-31T23:15:39.167204+0000","last_clean":"2024-03-31T23:15:39.167204+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:15:39.167204+0000","last_undegraded":"2024-03-31T23:15:39.167204+0000","last_fullsized":"2024-03-31T23:15:39.167204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466530+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:15:40.466530+0000","last_peered":"2024-03-31T23:15:40.466530+0000","last_clean":"2024-03-31T23:15:40.466530+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:15:40.466530+0000","last_undegraded":"2024-03-31T23:15:40.466530+0000","last_fullsized":"2024-03-31T23:15:40.466530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.338139+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:15:40.338139+0000","last_peered":"2024-03-31T23:15:40.338139+0000","last_clean":"2024-03-31T23:15:40.338139+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:15:40.338139+0000","last_undegraded":"2024-03-31T23:15:40.338139+0000","last_fullsized":"2024-03-31T23:15:40.338139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466141+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:15:40.466141+0000","last_peered":"2024-03-31T23:15:40.466141+0000","last_clean":"2024-03-31T23:15:40.466141+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:15:40.466141+0000","last_undegraded":"2024-03-31T23:15:40.466141+0000","last_fullsized":"2024-03-31T23:15:40.466141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.466012+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:15:40.466012+0000","last_peered":"2024-03-31T23:15:40.466012+0000","last_clean":"2024-03-31T23:15:40.466012+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:15:40.466012+0000","last_undegraded":"2024-03-31T23:15:40.466012+0000","last_fullsized":"2024-03-31T23:15:40.466012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:40.465808+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:15:40.465808+0000","last_peered":"2024-03-31T23:15:40.465808+0000","last_clean":"2024-03-31T23:15:40.465808+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:15:40.465808+0000","last_undegraded":"2024-03-31T23:15:40.465808+0000","last_fullsized":"2024-03-31T23:15:40.465808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-31T23:15:39.639378+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:15:39.639378+0000","last_peered":"2024-03-31T23:15:39.639378+0000","last_clean":"2024-03-31T23:15:39.639378+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:15:39.639378+0000","last_undegraded":"2024-03-31T23:15:39.639378+0000","last_fullsized":"2024-03-31T23:15:39.639378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5312,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":25744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":478407,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":1072381,"data_compressed":50513,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":477999,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":477819,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1015808,"data_stored":1068165,"data_compressed":50513,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":477215,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":489409,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":966656,"data_stored":477305,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":481713,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":477319,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477237,"data_compressed":14650,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":1067765,"data_compressed":50513,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:16:04.090 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-31T23:16:04.091 INFO:tasks.cephadm:Setting up client nodes... 2024-03-31T23:16:04.091 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-31T23:16:04.370 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:04.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:04 smithi042 ceph-mon[32380]: pgmap v300: 129 pgs: 129 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-03-31T23:16:04.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:04 smithi042 ceph-mon[32380]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-31T23:16:04.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:04 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2619908099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:04.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:04 smithi042 ceph-mon[32380]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-mon[36167]: pgmap v300: 129 pgs: 129 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-mon[36167]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2619908099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-mon[36167]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:16:04.404+0000 7f0054975700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:16:04.404+0000 7f0054975700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-31T23:16:04.672 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:16:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:16:04.404+0000 7f0054975700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-31T23:16:04.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:04 smithi188 ceph-mon[36068]: pgmap v300: 129 pgs: 129 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-03-31T23:16:04.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:04 smithi188 ceph-mon[36068]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-31T23:16:04.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:04 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2619908099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:04.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:04 smithi188 ceph-mon[36068]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:16:05.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:05 smithi042 ceph-mon[32380]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:16:05.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:05 smithi094 ceph-mon[36167]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:16:05.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:05 smithi188 ceph-mon[36068]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:16:06.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 -- 172.21.15.42:0/2893864710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76981023a0 msgr2=0x7f7698102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 --2- 172.21.15.42:0/2893864710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76981023a0 0x7f7698102800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f768c009920 tx=0x7f768c009c30 comp rx=0 tx=0).stop 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 -- 172.21.15.42:0/2893864710 shutdown_connections 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 --2- 172.21.15.42:0/2893864710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7698102d40 0x7f76981095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 --2- 172.21.15.42:0/2893864710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981011a0 0x7f76981015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 --2- 172.21.15.42:0/2893864710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76981023a0 0x7f7698102800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 -- 172.21.15.42:0/2893864710 >> 172.21.15.42:0/2893864710 conn(0x7f76980fc760 msgr2=0x7f76980feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 -- 172.21.15.42:0/2893864710 shutdown_connections 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.002+0000 7f769e8d3700 1 -- 172.21.15.42:0/2893864710 wait complete. 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.003+0000 7f769e8d3700 1 Processor -- start 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.003+0000 7f769e8d3700 1 -- start start 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76981011a0 0x7f7698197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:06.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981023a0 0x7f7698197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 0x7f769819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f769810cee0 con 0x7f7698102d40 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f769810cd60 con 0x7f76981023a0 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f769810d060 con 0x7f76981011a0 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 0x7f769819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f76977fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981023a0 0x7f7698197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 0x7f769819e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46760/0 (socket says 172.21.15.42:46760) 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 -- 172.21.15.42:0/69434970 learned_addr learned my addr 172.21.15.42:0/69434970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f7697fff700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76981011a0 0x7f7698197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 -- 172.21.15.42:0/69434970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76981011a0 msgr2=0x7f7698197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76981011a0 0x7f7698197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 -- 172.21.15.42:0/69434970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981023a0 msgr2=0x7f7698197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981023a0 0x7f7698197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 -- 172.21.15.42:0/69434970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769819f070 con 0x7f7698102d40 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f76977fe700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981023a0 0x7f7698197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769ce70700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 0x7f769819e9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f769000c140 tx=0x7f769000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900092e0 con 0x7f7698102d40 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769819f300 con 0x7f7698102d40 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7690004bb0 con 0x7f7698102d40 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.004+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690007df0 con 0x7f7698102d40 2024-03-31T23:16:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.005+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769819f890 con 0x7f7698102d40 2024-03-31T23:16:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.005+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7698050750 con 0x7f7698102d40 2024-03-31T23:16:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.007+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f769001a020 con 0x7f7698102d40 2024-03-31T23:16:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.007+0000 7f76957fa700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76800a2670 0x7f76800a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.007+0000 7f7697fff700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76800a2670 0x7f76800a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.007+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f76900cefb0 con 0x7f7698102d40 2024-03-31T23:16:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.008+0000 7f7697fff700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76800a2670 0x7f76800a4b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7698102200 tx=0x7f7688009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:06.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.011+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7690010040 con 0x7f7698102d40 2024-03-31T23:16:06.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.298+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f769802db30 con 0x7f7698102d40 2024-03-31T23:16:06.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.300+0000 7f76957fa700 1 -- 172.21.15.42:0/69434970 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f769009bdd0 con 0x7f7698102d40 2024-03-31T23:16:06.300 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-03-31T23:16:06.301 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC27glmLWfcERAANR6jNQZSXD1FafAP/GYeZg== 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76800a2670 msgr2=0x7f76800a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76800a2670 0x7f76800a4b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7698102200 tx=0x7f7688009260 comp rx=0 tx=0).stop 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 msgr2=0x7f769819e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 0x7f769819e9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f769000c140 tx=0x7f769000c450 comp rx=0 tx=0).stop 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 shutdown_connections 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f76800a2670 0x7f76800a4b30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76981011a0 0x7f7698197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7698102d40 0x7f769819e9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 --2- 172.21.15.42:0/69434970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76981023a0 0x7f7698197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 >> 172.21.15.42:0/69434970 conn(0x7f76980fc760 msgr2=0x7f7698105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 shutdown_connections 2024-03-31T23:16:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:06.302+0000 7f769e8d3700 1 -- 172.21.15.42:0/69434970 wait complete. 2024-03-31T23:16:06.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:06 smithi042 ceph-mon[32380]: pgmap v301: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.6 KiB/s wr, 19 op/s 2024-03-31T23:16:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:06 smithi094 ceph-mon[36167]: pgmap v301: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.6 KiB/s wr, 19 op/s 2024-03-31T23:16:06.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:06 smithi188 ceph-mon[36068]: pgmap v301: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.6 KiB/s wr, 19 op/s 2024-03-31T23:16:06.952 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:16:06.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-31T23:16:06.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-31T23:16:06.997 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-31T23:16:06.997 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-31T23:16:06.997 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph mgr dump --format=json 2024-03-31T23:16:07.281 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:07.514 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:07 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/69434970' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-31T23:16:07.514 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:07 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/69434970' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-31T23:16:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:07 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/69434970' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-31T23:16:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:07 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/69434970' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-31T23:16:07.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:07 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/69434970' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-31T23:16:07.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:07 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/69434970' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-31T23:16:08.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:08 smithi042 ceph-mon[32380]: pgmap v302: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2024-03-31T23:16:08.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:08 smithi094 ceph-mon[36167]: pgmap v302: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2024-03-31T23:16:08.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:08 smithi188 ceph-mon[36068]: pgmap v302: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 -- 172.21.15.42:0/470358377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101140 msgr2=0x7fc0841015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/470358377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101140 0x7fc0841015a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc080009990 tx=0x7fc080009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 -- 172.21.15.42:0/470358377 shutdown_connections 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/470358377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084107180 0x7fc084107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/470358377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084101ae0 0x7fc08410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/470358377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101140 0x7fc0841015a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 -- 172.21.15.42:0/470358377 >> 172.21.15.42:0/470358377 conn(0x7fc084078070 msgr2=0x7fc084078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 -- 172.21.15.42:0/470358377 shutdown_connections 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.197+0000 7fc08b2b7700 1 -- 172.21.15.42:0/470358377 wait complete. 2024-03-31T23:16:09.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 Processor -- start 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 -- start start 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084101140 0x7fc084199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 0x7fc084199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084107180 0x7fc0841a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc084111520 con 0x7fc084101ae0 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841113a0 con 0x7fc084107180 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc08b2b7700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841116a0 con 0x7fc084101140 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc088852700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 0x7fc084199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc088852700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 0x7fc084199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46774/0 (socket says 172.21.15.42:46774) 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc088852700 1 -- 172.21.15.42:0/477152182 learned_addr learned my addr 172.21.15.42:0/477152182 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc089854700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084107180 0x7fc0841a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc089053700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084101140 0x7fc084199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc088852700 1 -- 172.21.15.42:0/477152182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084101140 msgr2=0x7fc084199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc088852700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084101140 0x7fc084199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.198+0000 7fc088852700 1 -- 172.21.15.42:0/477152182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084107180 msgr2=0x7fc0841a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc088852700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084107180 0x7fc0841a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc088852700 1 -- 172.21.15.42:0/477152182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841a4ec0 con 0x7fc084101ae0 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc089854700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084107180 0x7fc0841a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc088852700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 0x7fc084199e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc08000b2e0 tx=0x7fc08000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080026070 con 0x7fc084101ae0 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc08000fb10 con 0x7fc084101ae0 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0841a5090 con 0x7fc084101ae0 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080017650 con 0x7fc084101ae0 2024-03-31T23:16:09.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.199+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841a5540 con 0x7fc084101ae0 2024-03-31T23:16:09.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.200+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc084068f00 con 0x7fc084101ae0 2024-03-31T23:16:09.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.201+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fc080029070 con 0x7fc084101ae0 2024-03-31T23:16:09.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.202+0000 7fc0767fc700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0700a2640 0x7fc0700a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:09.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.202+0000 7fc089053700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0700a2640 0x7fc0700a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:09.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.202+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc0800cff40 con 0x7fc084101ae0 2024-03-31T23:16:09.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.202+0000 7fc089053700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0700a2640 0x7fc0700a4b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc078009be0 tx=0x7fc078009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:09.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.205+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc080030070 con 0x7fc084101ae0 2024-03-31T23:16:09.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.469+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc08402db30 con 0x7fc084101ae0 2024-03-31T23:16:09.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.474+0000 7fc0767fc700 1 -- 172.21.15.42:0/477152182 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+262361 (secure 0 0 0) 0x7fc080013070 con 0x7fc084101ae0 2024-03-31T23:16:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:09.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0700a2640 msgr2=0x7fc0700a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:09.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0700a2640 0x7fc0700a4b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc078009be0 tx=0x7fc078009260 comp rx=0 tx=0).stop 2024-03-31T23:16:09.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 msgr2=0x7fc084199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:09.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 0x7fc084199e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc08000b2e0 tx=0x7fc08000b840 comp rx=0 tx=0).stop 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 shutdown_connections 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0700a2640 0x7fc0700a4b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084101140 0x7fc084199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc084107180 0x7fc0841a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 --2- 172.21.15.42:0/477152182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084101ae0 0x7fc084199e40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.477+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 >> 172.21.15.42:0/477152182 conn(0x7fc084078070 msgr2=0x7fc0840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.478+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 shutdown_connections 2024-03-31T23:16:09.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:09.478+0000 7fc08b2b7700 1 -- 172.21.15.42:0/477152182 wait complete. 2024-03-31T23:16:10.220 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":2637331812},{"type":"v1","addr":"172.21.15.42:6801","nonce":2637331812}]},"active_addr":"172.21.15.42:6801/2637331812","active_change":"2024-03-31T23:08:40.681056+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.42:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1673984370}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2338905125}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3564928943}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1986563449}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3905684130}]}]} 2024-03-31T23:16:10.225 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-31T23:16:10.225 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-31T23:16:10.225 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-31T23:16:10.471 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:10.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:10 smithi042 ceph-mon[32380]: pgmap v303: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.5 KiB/s wr, 21 op/s 2024-03-31T23:16:10.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:10 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/477152182' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-31T23:16:10.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:10 smithi094 ceph-mon[36167]: pgmap v303: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.5 KiB/s wr, 21 op/s 2024-03-31T23:16:10.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:10 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/477152182' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-31T23:16:10.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:10 smithi188 ceph-mon[36068]: pgmap v303: 129 pgs: 129 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.5 KiB/s wr, 21 op/s 2024-03-31T23:16:10.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:10 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/477152182' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-31T23:16:12.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1768772826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 msgr2=0x7f5fe4102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1768772826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 0x7f5fe4102710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80099c0 tx=0x7f5fd8009cd0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1768772826 shutdown_connections 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1768772826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fe4102c50 0x7f5fe410f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1768772826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4108650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1768772826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 0x7f5fe4102710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.233+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1768772826 >> 172.21.15.42:0/1768772826 conn(0x7f5fe4079370 msgr2=0x7f5fe4079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.234+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1768772826 shutdown_connections 2024-03-31T23:16:12.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.234+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1768772826 wait complete. 2024-03-31T23:16:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.234+0000 7f5fe88cc700 1 Processor -- start 2024-03-31T23:16:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.234+0000 7f5fe88cc700 1 -- start start 2024-03-31T23:16:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.234+0000 7f5fe88cc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 0x7f5fe4074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.234+0000 7f5fe88cc700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fe4102c50 0x7f5fe4074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe88cc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe88cc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4112610 con 0x7f5fe4102290 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe88cc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4112490 con 0x7f5fe4108270 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe88cc700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4112790 con 0x7f5fe4102c50 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 0x7f5fe4074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe1d9b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fe4102c50 0x7f5fe4074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4074fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:50234/0 (socket says 172.21.15.42:50234) 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 -- 172.21.15.42:0/1350011728 learned_addr learned my addr 172.21.15.42:0/1350011728 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 -- 172.21.15.42:0/1350011728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fe4102c50 msgr2=0x7f5fe4074a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fe4102c50 0x7f5fe4074a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 -- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 msgr2=0x7f5fe4074540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 0x7f5fe4074540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 -- 172.21.15.42:0/1350011728 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe41a6f30 con 0x7f5fe4108270 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe2d9d700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4074fc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00ef30 tx=0x7f5fdc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0092e0 con 0x7f5fe4108270 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe41a71c0 con 0x7f5fe4108270 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fdc004bb0 con 0x7f5fe4108270 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.235+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc004280 con 0x7f5fe4108270 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.236+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe41a7720 con 0x7f5fe4108270 2024-03-31T23:16:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.236+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe4068f00 con 0x7f5fe4108270 2024-03-31T23:16:12.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.238+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f5fdc01b030 con 0x7f5fe4108270 2024-03-31T23:16:12.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.238+0000 7f5fd37fe700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fcc0a25c0 0x7f5fcc0a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:12.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.238+0000 7f5fe259c700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fcc0a25c0 0x7f5fcc0a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:12.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.238+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f5fdc0ce720 con 0x7f5fe4108270 2024-03-31T23:16:12.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.239+0000 7f5fe259c700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fcc0a25c0 0x7f5fcc0a4a80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009be0 tx=0x7f5fd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:12.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.241+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5fdc022020 con 0x7f5fe4108270 2024-03-31T23:16:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.447+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fe402db30 con 0x7f5fe4108270 2024-03-31T23:16:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.449+0000 7f5fd37fe700 1 -- 172.21.15.42:0/1350011728 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7f5fdc0a1070 con 0x7f5fe4108270 2024-03-31T23:16:12.451 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:12.451 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:16:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fcc0a25c0 msgr2=0x7f5fcc0a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fcc0a25c0 0x7f5fcc0a4a80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009be0 tx=0x7f5fd4009260 comp rx=0 tx=0).stop 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 msgr2=0x7f5fe4074fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4074fc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00ef30 tx=0x7f5fdc00c3a0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 shutdown_connections 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fcc0a25c0 0x7f5fcc0a4a80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fe4108270 0x7f5fe4074fc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fe4102290 0x7f5fe4074540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 --2- 172.21.15.42:0/1350011728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fe4102c50 0x7f5fe4074a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 >> 172.21.15.42:0/1350011728 conn(0x7f5fe4079370 msgr2=0x7f5fe4100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 shutdown_connections 2024-03-31T23:16:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:12.451+0000 7f5fe88cc700 1 -- 172.21.15.42:0/1350011728 wait complete. 2024-03-31T23:16:12.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:12 smithi042 ceph-mon[32380]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.8 KiB/s wr, 24 op/s 2024-03-31T23:16:12.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:12 smithi094 ceph-mon[36167]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.8 KiB/s wr, 24 op/s 2024-03-31T23:16:12.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:12 smithi188 ceph-mon[36068]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.8 KiB/s wr, 24 op/s 2024-03-31T23:16:13.108 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-31T23:16:13.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-31T23:16:13.353 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:13 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1350011728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:13 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1350011728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:13.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:13 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1350011728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:14.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:14 smithi042 ceph-mon[32380]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2024-03-31T23:16:14.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:14 smithi094 ceph-mon[36167]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2024-03-31T23:16:14.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:14 smithi188 ceph-mon[36068]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 -- 172.21.15.42:0/124022224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 msgr2=0x7fc188102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 --2- 172.21.15.42:0/124022224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc188102710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc170009920 tx=0x7fc170009c30 comp rx=0 tx=0).stop 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 -- 172.21.15.42:0/124022224 shutdown_connections 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 --2- 172.21.15.42:0/124022224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc188102c50 0x7fc18810f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 --2- 172.21.15.42:0/124022224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188108270 0x7fc188108650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 --2- 172.21.15.42:0/124022224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc188102710 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 -- 172.21.15.42:0/124022224 >> 172.21.15.42:0/124022224 conn(0x7fc188079370 msgr2=0x7fc188079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:15.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 -- 172.21.15.42:0/124022224 shutdown_connections 2024-03-31T23:16:15.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.036+0000 7fc18dd99700 1 -- 172.21.15.42:0/124022224 wait complete. 2024-03-31T23:16:15.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 Processor -- start 2024-03-31T23:16:15.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 -- start start 2024-03-31T23:16:15.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc18819e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:15.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188102c50 0x7fc18819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc188108270 0x7fc188198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc188112630 con 0x7fc188102290 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc1881124b0 con 0x7fc188102c50 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc18dd99700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc1881127b0 con 0x7fc188108270 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc1877fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc18819e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc1877fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc18819e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38428/0 (socket says 172.21.15.42:38428) 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc1877fe700 1 -- 172.21.15.42:0/3655007287 learned_addr learned my addr 172.21.15.42:0/3655007287 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc186ffd700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188102c50 0x7fc18819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.037+0000 7fc187fff700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc188108270 0x7fc188198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc1877fe700 1 -- 172.21.15.42:0/3655007287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc188108270 msgr2=0x7fc188198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc1877fe700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc188108270 0x7fc188198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc1877fe700 1 -- 172.21.15.42:0/3655007287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188102c50 msgr2=0x7fc18819ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc1877fe700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188102c50 0x7fc18819ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc1877fe700 1 -- 172.21.15.42:0/3655007287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc188199090 con 0x7fc188102290 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc186ffd700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188102c50 0x7fc18819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc1877fe700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc18819e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc17800e3c0 tx=0x7fc17800e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17800ee40 con 0x7fc188102290 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc188199320 con 0x7fc188102290 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc178003a00 con 0x7fc188102290 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc178004800 con 0x7fc188102290 2024-03-31T23:16:15.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.038+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1881a5640 con 0x7fc188102290 2024-03-31T23:16:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.039+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc188068f00 con 0x7fc188102290 2024-03-31T23:16:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.040+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fc17801b030 con 0x7fc188102290 2024-03-31T23:16:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.041+0000 7fc184ff9700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1740a25c0 0x7fc1740a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.041+0000 7fc186ffd700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1740a25c0 0x7fc1740a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.041+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc1780ce8f0 con 0x7fc188102290 2024-03-31T23:16:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.042+0000 7fc186ffd700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1740a25c0 0x7fc1740a4a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc170005e90 tx=0x7fc170019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:15.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.045+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc178022060 con 0x7fc188102290 2024-03-31T23:16:15.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.250+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc18802db30 con 0x7fc188102290 2024-03-31T23:16:15.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.252+0000 7fc184ff9700 1 -- 172.21.15.42:0/3655007287 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24066 (secure 0 0 0) 0x7fc178010040 con 0x7fc188102290 2024-03-31T23:16:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:16:15.254 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:15:38.520823+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1740a25c0 msgr2=0x7fc1740a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1740a25c0 0x7fc1740a4a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc170005e90 tx=0x7fc170019040 comp rx=0 tx=0).stop 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 msgr2=0x7fc18819e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc18819e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc17800e3c0 tx=0x7fc17800e6d0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 shutdown_connections 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc1740a25c0 0x7fc1740a4a80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc188108270 0x7fc188198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc188102290 0x7fc18819e770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 --2- 172.21.15.42:0/3655007287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc188102c50 0x7fc18819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 >> 172.21.15.42:0/3655007287 conn(0x7fc188079370 msgr2=0x7fc188100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 shutdown_connections 2024-03-31T23:16:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:15.254+0000 7fc18dd99700 1 -- 172.21.15.42:0/3655007287 wait complete. 2024-03-31T23:16:15.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:15 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3655007287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:15 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3655007287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:15.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:15 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3655007287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:16:16.083 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-03-31T23:16:16.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-03-31T23:16:16.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-03-31T23:16:16.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-03-31T23:16:16.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-03-31T23:16:16.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-03-31T23:16:16.086 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-03-31T23:16:16.086 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-03-31T23:16:16.086 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.8 flush_pg_stats 2024-03-31T23:16:16.087 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.9 flush_pg_stats 2024-03-31T23:16:16.087 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.10 flush_pg_stats 2024-03-31T23:16:16.087 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph tell osd.11 flush_pg_stats 2024-03-31T23:16:16.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:16 smithi042 ceph-mon[32380]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 26 op/s 2024-03-31T23:16:16.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:16 smithi094 ceph-mon[36167]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 26 op/s 2024-03-31T23:16:16.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:16 smithi188 ceph-mon[36068]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 26 op/s 2024-03-31T23:16:16.779 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.929 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.930 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:18.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:18 smithi042 ceph-mon[32380]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-03-31T23:16:18.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:18 smithi094 ceph-mon[36167]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-03-31T23:16:18.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:18 smithi188 ceph-mon[36068]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-03-31T23:16:20.516 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:20 smithi042 ceph-mon[32380]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-03-31T23:16:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:20 smithi094 ceph-mon[36167]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-03-31T23:16:20.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:20 smithi188 ceph-mon[36068]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-03-31T23:16:22.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:22 smithi042 ceph-mon[32380]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-31T23:16:22.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:22 smithi094 ceph-mon[36167]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-31T23:16:22.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:22 smithi188 ceph-mon[36068]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-31T23:16:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:24 smithi094 ceph-mon[36167]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-03-31T23:16:24.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:24 smithi042 ceph-mon[32380]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-03-31T23:16:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:24 smithi188 ceph-mon[36068]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-03-31T23:16:26.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:26 smithi042 ceph-mon[32380]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 341 B/s wr, 12 op/s 2024-03-31T23:16:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:26 smithi094 ceph-mon[36167]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 341 B/s wr, 12 op/s 2024-03-31T23:16:26.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:26 smithi188 ceph-mon[36068]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 341 B/s wr, 12 op/s 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 -- 172.21.15.42:0/1634292054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6734103e70 msgr2=0x7f673410c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 --2- 172.21.15.42:0/1634292054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6734103e70 0x7f673410c360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6728009990 tx=0x7f6728009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 -- 172.21.15.42:0/1634292054 shutdown_connections 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 --2- 172.21.15.42:0/1634292054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6734103550 0x7f6734103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 --2- 172.21.15.42:0/1634292054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f673410c930 0x7f673410ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 --2- 172.21.15.42:0/1634292054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6734103e70 0x7f673410c360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 -- 172.21.15.42:0/1634292054 >> 172.21.15.42:0/1634292054 conn(0x7f6734078270 msgr2=0x7f6734078680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:27.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 -- 172.21.15.42:0/1634292054 shutdown_connections 2024-03-31T23:16:27.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.226+0000 7f673b0ed700 1 -- 172.21.15.42:0/1634292054 wait complete. 2024-03-31T23:16:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 Processor -- start 2024-03-31T23:16:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 -- start start 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6734103550 0x7f673419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6734103e70 0x7f673419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f673410c930 0x7f6734198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6734112730 con 0x7f6734103e70 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f67341125b0 con 0x7f673410c930 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673b0ed700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f67341128b0 con 0x7f6734103550 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6733fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6734103e70 0x7f673419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6738e89700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6734103550 0x7f673419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6733fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6734103e70 0x7f673419ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44402/0 (socket says 172.21.15.42:44402) 2024-03-31T23:16:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6733fff700 1 -- 172.21.15.42:0/3302048730 learned_addr learned my addr 172.21.15.42:0/3302048730 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f673968a700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f673410c930 0x7f6734198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6738e89700 1 -- 172.21.15.42:0/3302048730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f673410c930 msgr2=0x7f6734198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6738e89700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f673410c930 0x7f6734198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6738e89700 1 -- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6734103e70 msgr2=0x7f673419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6738e89700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6734103e70 0x7f673419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6738e89700 1 -- 172.21.15.42:0/3302048730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67341990f0 con 0x7f6734103550 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.227+0000 7f6733fff700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6734103e70 0x7f673419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.228+0000 7f6738e89700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6734103550 0x7f673419e7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f672400ef10 tx=0x7f672400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.228+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672400c9c0 con 0x7f6734103550 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.228+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6734199380 con 0x7f6734103550 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.228+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6724019070 con 0x7f6734103550 2024-03-31T23:16:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.228+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240146e0 con 0x7f6734103550 2024-03-31T23:16:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.228+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67341010e0 con 0x7f6734103550 2024-03-31T23:16:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.229+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6734062950 con 0x7f6734103550 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.230+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f6724012050 con 0x7f6734103550 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.230+0000 7f6731ffb700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f671c0a25c0 0x7f671c0a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f6733fff700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f671c0a25c0 0x7f671c0a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f67240cec70 con 0x7f6734103550 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f6731ffb700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] conn(0x7f671c0ad280 0x7f671c0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 --> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f671c0afd90 con 0x7f671c0ad280 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f67240cf020 con 0x7f6734103550 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f673968a700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] conn(0x7f671c0ad280 0x7f671c0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f6733fff700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f671c0a25c0 0x7f671c0a4a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f673410e4e0 tx=0x7f6728005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.231+0000 7f673968a700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] conn(0x7f671c0ad280 0x7f671c0af6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.232+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== osd.9 v2:172.21.15.42:6826/892645704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f671c0afd90 con 0x7f671c0ad280 2024-03-31T23:16:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.248+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 --> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6734062dd0 con 0x7f671c0ad280 2024-03-31T23:16:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f6731ffb700 1 -- 172.21.15.42:0/3302048730 <== osd.9 v2:172.21.15.42:6826/892645704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6734062dd0 con 0x7f671c0ad280 2024-03-31T23:16:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] conn(0x7f671c0ad280 msgr2=0x7f671c0af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] conn(0x7f671c0ad280 0x7f671c0af6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f671c0a25c0 msgr2=0x7f671c0a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f671c0a25c0 0x7f671c0a4a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f673410e4e0 tx=0x7f6728005960 comp rx=0 tx=0).stop 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6734103550 msgr2=0x7f673419e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 --2- 172.21.15.42:0/3302048730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6734103550 0x7f673419e7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f672400ef10 tx=0x7f672400c3a0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673968a700 1 -- 172.21.15.42:0/3302048730 reap_dead start 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 shutdown_connections 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 >> 172.21.15.42:0/3302048730 conn(0x7f6734078270 msgr2=0x7f67340fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 shutdown_connections 2024-03-31T23:16:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.249+0000 7f673b0ed700 1 -- 172.21.15.42:0/3302048730 wait complete. 2024-03-31T23:16:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 -- 172.21.15.42:0/3255141605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e50107610 msgr2=0x7f6e5010f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3255141605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e50107610 0x7f6e5010f220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f90 tx=0x7f6e4800b330 comp rx=0 tx=0).stop 2024-03-31T23:16:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 -- 172.21.15.42:0/3255141605 shutdown_connections 2024-03-31T23:16:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3255141605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e50100e40 0x7f6e50101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3255141605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e50107610 0x7f6e5010f220 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3255141605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e501017f0 0x7f6e50106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 -- 172.21.15.42:0/3255141605 >> 172.21.15.42:0/3255141605 conn(0x7f6e500764c0 msgr2=0x7f6e500768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 -- 172.21.15.42:0/3255141605 shutdown_connections 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.436+0000 7f6e55b61700 1 -- 172.21.15.42:0/3255141605 wait complete. 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 Processor -- start 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 -- start start 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e50100e40 0x7f6e5019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e501017f0 0x7f6e5019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e50107610 0x7f6e50198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50112770 con 0x7f6e50107610 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6e501125f0 con 0x7f6e501017f0 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.437+0000 7f6e55b61700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6e501128f0 con 0x7f6e50100e40 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e50107610 0x7f6e50198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e501017f0 0x7f6e5019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e501017f0 0x7f6e5019ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:38870/0 (socket says 172.21.15.42:38870) 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e50107610 0x7f6e50198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44416/0 (socket says 172.21.15.42:44416) 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4f7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e50100e40 0x7f6e5019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 -- 172.21.15.42:0/3656843929 learned_addr learned my addr 172.21.15.42:0/3656843929 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 -- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e50100e40 msgr2=0x7f6e5019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e50100e40 0x7f6e5019e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 -- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e50107610 msgr2=0x7f6e50198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e50107610 0x7f6e50198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 -- 172.21.15.42:0/3656843929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e501990f0 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4ffff700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e50107610 0x7f6e50198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4effd700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e501017f0 0x7f6e5019ecc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400ec70 tx=0x7f6e4400ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400cc90 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e501993e0 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e44004520 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44010690 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.438+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e501a5650 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.439+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e50062950 con 0x7f6e501017f0 2024-03-31T23:16:27.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.440+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f6e44003eb0 con 0x7f6e501017f0 2024-03-31T23:16:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4cff9700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e380a25c0 0x7f6e380a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4f7fe700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e380a25c0 0x7f6e380a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f6e440cf030 con 0x7f6e501017f0 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4cff9700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] conn(0x7f6e380ad280 0x7f6e380af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 --> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e4400be50 con 0x7f6e380ad280 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f6e440cf470 con 0x7f6e501017f0 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4ffff700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] conn(0x7f6e380ad280 0x7f6e380af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.441+0000 7f6e4f7fe700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e380a25c0 0x7f6e380a4a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e50107440 tx=0x7f6e40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.442+0000 7f6e4ffff700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] conn(0x7f6e380ad280 0x7f6e380af6c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.442+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== osd.2 v2:172.21.15.188:6800/3086405523 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e4400be50 con 0x7f6e380ad280 2024-03-31T23:16:27.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 --> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e50062d50 con 0x7f6e380ad280 2024-03-31T23:16:27.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e4cff9700 1 -- 172.21.15.42:0/3656843929 <== osd.2 v2:172.21.15.188:6800/3086405523 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e50062d50 con 0x7f6e380ad280 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] conn(0x7f6e380ad280 msgr2=0x7f6e380af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] conn(0x7f6e380ad280 0x7f6e380af6c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e380a25c0 msgr2=0x7f6e380a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e380a25c0 0x7f6e380a4a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e50107440 tx=0x7f6e40009260 comp rx=0 tx=0).stop 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e501017f0 msgr2=0x7f6e5019ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 --2- 172.21.15.42:0/3656843929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e501017f0 0x7f6e5019ecc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400ec70 tx=0x7f6e4400ef80 comp rx=0 tx=0).stop 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e4ffff700 1 -- 172.21.15.42:0/3656843929 reap_dead start 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.459+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 shutdown_connections 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.460+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 >> 172.21.15.42:0/3656843929 conn(0x7f6e500764c0 msgr2=0x7f6e500feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.460+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 shutdown_connections 2024-03-31T23:16:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.460+0000 7f6e55b61700 1 -- 172.21.15.42:0/3656843929 wait complete. 2024-03-31T23:16:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 -- 172.21.15.42:0/795291009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8107180 msgr2=0x7fd9d8107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 --2- 172.21.15.42:0/795291009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8107180 0x7fd9d8107560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009990 tx=0x7fd9c8009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 -- 172.21.15.42:0/795291009 shutdown_connections 2024-03-31T23:16:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 --2- 172.21.15.42:0/795291009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9d8101ae0 0x7fd9d810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 --2- 172.21.15.42:0/795291009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8107180 0x7fd9d8107560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 --2- 172.21.15.42:0/795291009 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 0x7fd9d81015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.693+0000 7fd9dec49700 1 -- 172.21.15.42:0/795291009 >> 172.21.15.42:0/795291009 conn(0x7fd9d8078070 msgr2=0x7fd9d8078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 -- 172.21.15.42:0/795291009 shutdown_connections 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 -- 172.21.15.42:0/795291009 wait complete. 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 Processor -- start 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 -- start start 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 0x7fd9d81a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8101ae0 0x7fd9d81a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9d8107180 0x7fd9d819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d8111520 con 0x7fd9d8101ae0 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d81113a0 con 0x7fd9d8101140 2024-03-31T23:16:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dec49700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d81116a0 con 0x7fd9d8107180 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.694+0000 7fd9dc9e5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 0x7fd9d81a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8101ae0 0x7fd9d81a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 0x7fd9d81a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:38898/0 (socket says 172.21.15.42:38898) 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 -- 172.21.15.42:0/3255120409 learned_addr learned my addr 172.21.15.42:0/3255120409 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dd1e6700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9d8107180 0x7fd9d819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 -- 172.21.15.42:0/3255120409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9d8107180 msgr2=0x7fd9d819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9d8107180 0x7fd9d819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 -- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8101ae0 msgr2=0x7fd9d81a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d8101ae0 0x7fd9d81a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 -- 172.21.15.42:0/3255120409 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d819b200 con 0x7fd9d8101140 2024-03-31T23:16:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dc9e5700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 0x7fd9d81a08e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8000c00 tx=0x7fd9c800b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8027070 con 0x7fd9d8101140 2024-03-31T23:16:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9c8022470 con 0x7fd9d8101140 2024-03-31T23:16:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d819b490 con 0x7fd9d8101140 2024-03-31T23:16:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8017630 con 0x7fd9d8101140 2024-03-31T23:16:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.695+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d81a77b0 con 0x7fd9d8101140 2024-03-31T23:16:27.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.696+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9d806a950 con 0x7fd9d8101140 2024-03-31T23:16:27.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.697+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fd9c802a070 con 0x7fd9d8101140 2024-03-31T23:16:27.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9d5ffb700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c00a25c0 0x7fd9c00a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9d7fff700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c00a25c0 0x7fd9c00a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fd9c80d00f0 con 0x7fd9d8101140 2024-03-31T23:16:27.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9d5ffb700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] conn(0x7fd9c00ad280 0x7fd9c00af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:27.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 --> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9c800eea0 con 0x7fd9c00ad280 2024-03-31T23:16:27.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fd9c80d04a0 con 0x7fd9d8101140 2024-03-31T23:16:27.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.698+0000 7fd9dd1e6700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] conn(0x7fd9c00ad280 0x7fd9c00af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:27.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.699+0000 7fd9d7fff700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c00a25c0 0x7fd9c00a4a80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009680 tx=0x7fd9cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.699+0000 7fd9dd1e6700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] conn(0x7fd9c00ad280 0x7fd9c00af6c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:27.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.700+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== osd.3 v2:172.21.15.42:6810/3411304012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9c800eea0 con 0x7fd9c00ad280 2024-03-31T23:16:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.716+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 --> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9d8102830 con 0x7fd9c00ad280 2024-03-31T23:16:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.716+0000 7fd9d5ffb700 1 -- 172.21.15.42:0/3255120409 <== osd.3 v2:172.21.15.42:6810/3411304012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd9d8102830 con 0x7fd9c00ad280 2024-03-31T23:16:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] conn(0x7fd9c00ad280 msgr2=0x7fd9c00af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] conn(0x7fd9c00ad280 0x7fd9c00af6c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c00a25c0 msgr2=0x7fd9c00a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd9c00a25c0 0x7fd9c00a4a80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009680 tx=0x7fd9cc009260 comp rx=0 tx=0).stop 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 msgr2=0x7fd9d81a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 --2- 172.21.15.42:0/3255120409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9d8101140 0x7fd9d81a08e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8000c00 tx=0x7fd9c800b610 comp rx=0 tx=0).stop 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dd1e6700 1 -- 172.21.15.42:0/3255120409 reap_dead start 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 shutdown_connections 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 >> 172.21.15.42:0/3255120409 conn(0x7fd9d8078070 msgr2=0x7fd9d8069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 shutdown_connections 2024-03-31T23:16:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:27.717+0000 7fd9dec49700 1 -- 172.21.15.42:0/3255120409 wait complete. 2024-03-31T23:16:28.310 INFO:teuthology.orchestra.run.smithi042.stdout:77309411397 2024-03-31T23:16:28.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-03-31T23:16:28.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:28 smithi042 ceph-mon[32380]: pgmap v312: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-03-31T23:16:28.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:28 smithi094 ceph-mon[36167]: pgmap v312: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-03-31T23:16:28.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:28 smithi188 ceph-mon[36068]: pgmap v312: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-03-31T23:16:28.923 INFO:teuthology.orchestra.run.smithi042.stdout:287762808865 2024-03-31T23:16:28.923 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.9 2024-03-31T23:16:30.660 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:30 smithi042 ceph-mon[32380]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-03-31T23:16:30.671 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:30 smithi094 ceph-mon[36167]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-03-31T23:16:30.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:30 smithi188 ceph-mon[36068]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-03-31T23:16:32.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 -- 172.21.15.42:0/194925917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 msgr2=0x7ffb3010df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:32.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 --2- 172.21.15.42:0/194925917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 0x7ffb3010df80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800b0a0 tx=0x7ffb2800b3b0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 -- 172.21.15.42:0/194925917 shutdown_connections 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 --2- 172.21.15.42:0/194925917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 0x7ffb3010df80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 --2- 172.21.15.42:0/194925917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb301071d0 0x7ffb301075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 --2- 172.21.15.42:0/194925917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 0x7ffb301015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 -- 172.21.15.42:0/194925917 >> 172.21.15.42:0/194925917 conn(0x7ffb30078150 msgr2=0x7ffb30078560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 -- 172.21.15.42:0/194925917 shutdown_connections 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.765+0000 7ffb35456700 1 -- 172.21.15.42:0/194925917 wait complete. 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 Processor -- start 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 -- start start 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 0x7ffb30199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 0x7ffb30199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb301071d0 0x7ffb301a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30111550 con 0x7ffb30101ae0 2024-03-31T23:16:32.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffb301113d0 con 0x7ffb301071d0 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb35456700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffb301116d0 con 0x7ffb30101120 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2effd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 0x7ffb30199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2e7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 0x7ffb30199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2effd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 0x7ffb30199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:37284/0 (socket says 172.21.15.42:37284) 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2effd700 1 -- 172.21.15.42:0/1734601283 learned_addr learned my addr 172.21.15.42:0/1734601283 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2f7fe700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb301071d0 0x7ffb301a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2e7fc700 1 -- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 msgr2=0x7ffb30199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2e7fc700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 0x7ffb30199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2e7fc700 1 -- 172.21.15.42:0/1734601283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb301071d0 msgr2=0x7ffb301a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2e7fc700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb301071d0 0x7ffb301a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2e7fc700 1 -- 172.21.15.42:0/1734601283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb301a4d50 con 0x7ffb30101ae0 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2effd700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb30101120 0x7ffb30199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:32.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.766+0000 7ffb2f7fe700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb301071d0 0x7ffb301a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.767+0000 7ffb2e7fc700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 0x7ffb30199cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e9f0 tx=0x7ffb2400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.767+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004220 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.767+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb24004d30 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.767+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb301a4fe0 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.767+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24005080 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.767+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb301a5440 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.768+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb30062950 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.769+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7ffb24004750 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.769+0000 7ffb17fff700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb180a25c0 0x7ffb180a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb2effd700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb180a25c0 0x7ffb180a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ffb240cecd0 con 0x7ffb30101ae0 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb17fff700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] conn(0x7ffb180ad280 0x7ffb180af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:32.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 --> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb24023ea0 con 0x7ffb180ad280 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ffb240cf120 con 0x7ffb30101ae0 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb2f7fe700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] conn(0x7ffb180ad280 0x7ffb180af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb2effd700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb180a25c0 0x7ffb180a4a80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb20011550 tx=0x7ffb20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.770+0000 7ffb2f7fe700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] conn(0x7ffb180ad280 0x7ffb180af6c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.772+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== osd.11 v2:172.21.15.188:6824/3794628957 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb24023ea0 con 0x7ffb180ad280 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.788+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 --> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb30062e00 con 0x7ffb180ad280 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb17fff700 1 -- 172.21.15.42:0/1734601283 <== osd.11 v2:172.21.15.188:6824/3794628957 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffb30062e00 con 0x7ffb180ad280 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] conn(0x7ffb180ad280 msgr2=0x7ffb180af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] conn(0x7ffb180ad280 0x7ffb180af6c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb180a25c0 msgr2=0x7ffb180a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffb180a25c0 0x7ffb180a4a80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb20011550 tx=0x7ffb20009260 comp rx=0 tx=0).stop 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 msgr2=0x7ffb30199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 --2- 172.21.15.42:0/1734601283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb30101ae0 0x7ffb30199cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e9f0 tx=0x7ffb2400ed00 comp rx=0 tx=0).stop 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb2f7fe700 1 -- 172.21.15.42:0/1734601283 reap_dead start 2024-03-31T23:16:32.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 shutdown_connections 2024-03-31T23:16:32.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.789+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 >> 172.21.15.42:0/1734601283 conn(0x7ffb30078150 msgr2=0x7ffb300ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:32.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.790+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 shutdown_connections 2024-03-31T23:16:32.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:30.790+0000 7ffb35456700 1 -- 172.21.15.42:0/1734601283 wait complete. 2024-03-31T23:16:32.469 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:32 smithi042 ceph-mon[32380]: pgmap v314: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-31T23:16:32.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:32 smithi094 ceph-mon[36167]: pgmap v314: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-31T23:16:32.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:32 smithi188 ceph-mon[36068]: pgmap v314: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-31T23:16:33.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.144+0000 7fc923fbb700 1 -- 172.21.15.42:0/1177761241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c1013d0 msgr2=0x7fc91c1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.144+0000 7fc923fbb700 1 --2- 172.21.15.42:0/1177761241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c1013d0 0x7fc91c1017b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9180099c0 tx=0x7fc918009cd0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 -- 172.21.15.42:0/1177761241 shutdown_connections 2024-03-31T23:16:33.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 --2- 172.21.15.42:0/1177761241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c106420 0x7fc91c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 --2- 172.21.15.42:0/1177761241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c1013d0 0x7fc91c1017b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 --2- 172.21.15.42:0/1177761241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc91c101d80 0x7fc91c105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 -- 172.21.15.42:0/1177761241 >> 172.21.15.42:0/1177761241 conn(0x7fc91c077190 msgr2=0x7fc91c0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 -- 172.21.15.42:0/1177761241 shutdown_connections 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 -- 172.21.15.42:0/1177761241 wait complete. 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 Processor -- start 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.145+0000 7fc923fbb700 1 -- start start 2024-03-31T23:16:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc923fbb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c1013d0 0x7fc91c197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc923fbb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c101d80 0x7fc91c197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc923fbb700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc91c106420 0x7fc91c1981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc923fbb700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c111510 con 0x7fc91c101d80 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc923fbb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c111390 con 0x7fc91c1013d0 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc923fbb700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c111690 con 0x7fc91c106420 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c1013d0 0x7fc91c197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc922558700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc91c106420 0x7fc91c1981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921556700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c101d80 0x7fc91c197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c1013d0 0x7fc91c197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:38954/0 (socket says 172.21.15.42:38954) 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 -- 172.21.15.42:0/3142663090 learned_addr learned my addr 172.21.15.42:0/3142663090 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:33.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 -- 172.21.15.42:0/3142663090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc91c106420 msgr2=0x7fc91c1981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc91c106420 0x7fc91c1981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 -- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c101d80 msgr2=0x7fc91c197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc91c101d80 0x7fc91c197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 -- 172.21.15.42:0/3142663090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c1a6f90 con 0x7fc91c1013d0 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc921d57700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c1013d0 0x7fc91c197720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9180059d0 tx=0x7fc91800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.146+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918027070 con 0x7fc91c1013d0 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.147+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c1a7220 con 0x7fc91c1013d0 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.147+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc91800be40 con 0x7fc91c1013d0 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.147+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9180173f0 con 0x7fc91c1013d0 2024-03-31T23:16:33.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.147+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c1a7670 con 0x7fc91c1013d0 2024-03-31T23:16:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.148+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc91c0629d0 con 0x7fc91c1013d0 2024-03-31T23:16:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.149+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fc91802a070 con 0x7fc91c1013d0 2024-03-31T23:16:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.149+0000 7fc912ffd700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9080a25c0 0x7fc9080a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.149+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc9180cf750 con 0x7fc91c1013d0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.149+0000 7fc921556700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9080a25c0 0x7fc9080a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.149+0000 7fc912ffd700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] conn(0x7fc9080ad0d0 0x7fc9080af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.150+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 --> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc91800b0b0 con 0x7fc9080ad0d0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.150+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fc9180d6050 con 0x7fc91c1013d0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.150+0000 7fc922558700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] conn(0x7fc9080ad0d0 0x7fc9080af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.150+0000 7fc921556700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9080a25c0 0x7fc9080a4a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc91c199880 tx=0x7fc90c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.150+0000 7fc922558700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] conn(0x7fc9080ad0d0 0x7fc9080af510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.151+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== osd.7 v2:172.21.15.94:6816/2551405001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc91800b0b0 con 0x7fc9080ad0d0 2024-03-31T23:16:33.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.168+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 --> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc91c062e50 con 0x7fc9080ad0d0 2024-03-31T23:16:33.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc912ffd700 1 -- 172.21.15.42:0/3142663090 <== osd.7 v2:172.21.15.94:6816/2551405001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc91c062e50 con 0x7fc9080ad0d0 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] conn(0x7fc9080ad0d0 msgr2=0x7fc9080af510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] conn(0x7fc9080ad0d0 0x7fc9080af510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9080a25c0 msgr2=0x7fc9080a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9080a25c0 0x7fc9080a4a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc91c199880 tx=0x7fc90c009260 comp rx=0 tx=0).stop 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c1013d0 msgr2=0x7fc91c197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 --2- 172.21.15.42:0/3142663090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc91c1013d0 0x7fc91c197720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9180059d0 tx=0x7fc91800f690 comp rx=0 tx=0).stop 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc922558700 1 -- 172.21.15.42:0/3142663090 reap_dead start 2024-03-31T23:16:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 shutdown_connections 2024-03-31T23:16:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 >> 172.21.15.42:0/3142663090 conn(0x7fc91c077190 msgr2=0x7fc91c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 shutdown_connections 2024-03-31T23:16:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.169+0000 7fc923fbb700 1 -- 172.21.15.42:0/3142663090 wait complete. 2024-03-31T23:16:33.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:33 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:16:33.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:33 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:16:33.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:33 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:16:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.865+0000 7f635de0d700 1 -- 172.21.15.42:0/4166572270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102c50 msgr2=0x7f635810f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.865+0000 7f635de0d700 1 --2- 172.21.15.42:0/4166572270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102c50 0x7f635810f0f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f635000b0a0 tx=0x7f635000b3b0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 -- 172.21.15.42:0/4166572270 shutdown_connections 2024-03-31T23:16:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 --2- 172.21.15.42:0/4166572270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102c50 0x7f635810f0f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 --2- 172.21.15.42:0/4166572270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6358108340 0x7f6358108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 --2- 172.21.15.42:0/4166572270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6358102290 0x7f6358102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 -- 172.21.15.42:0/4166572270 >> 172.21.15.42:0/4166572270 conn(0x7f6358079370 msgr2=0x7f6358079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 -- 172.21.15.42:0/4166572270 shutdown_connections 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 -- 172.21.15.42:0/4166572270 wait complete. 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 Processor -- start 2024-03-31T23:16:33.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.866+0000 7f635de0d700 1 -- start start 2024-03-31T23:16:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102290 0x7f635819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6358102c50 0x7f635819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6358108340 0x7f6358198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6358112690 con 0x7f6358102290 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6358112510 con 0x7f6358102c50 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6358112810 con 0x7f6358108340 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102290 0x7f635819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f6356ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6358102c50 0x7f635819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102290 0x7f635819e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52158/0 (socket says 172.21.15.42:52158) 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 -- 172.21.15.42:0/1663316872 learned_addr learned my addr 172.21.15.42:0/1663316872 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f6357fff700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6358108340 0x7f6358198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 -- 172.21.15.42:0/1663316872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6358108340 msgr2=0x7f6358198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6358108340 0x7f6358198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 -- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6358102c50 msgr2=0x7f635819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6358102c50 0x7f635819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 -- 172.21.15.42:0/1663316872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6358198ff0 con 0x7f6358102290 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f6356ffd700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6358102c50 0x7f635819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f63577fe700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102290 0x7f635819e6d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f634800e9a0 tx=0x7f634800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634800ca10 con 0x7f6358102290 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63581992e0 con 0x7f6358102290 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f634800cbb0 con 0x7f6358102290 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.867+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348018710 con 0x7f6358102290 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.868+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63581a55a0 con 0x7f6358102290 2024-03-31T23:16:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.868+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6358062950 con 0x7f6358102290 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.869+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f6348010430 con 0x7f6358102290 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.870+0000 7f6354ff9700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f63400a2640 0x7f63400a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.870+0000 7f6356ffd700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f63400a2640 0x7f63400a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.870+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f63480cf390 con 0x7f6358102290 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.870+0000 7f6354ff9700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] conn(0x7f63400ad300 0x7f63400af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.870+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 --> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63400afe10 con 0x7f63400ad300 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.870+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f63480cf7e0 con 0x7f6358102290 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.871+0000 7f6356ffd700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f63400a2640 0x7f63400a4b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6358079990 tx=0x7f634c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.871+0000 7f6357fff700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] conn(0x7f63400ad300 0x7f63400af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.871+0000 7f6357fff700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] conn(0x7f63400ad300 0x7f63400af740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:33.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.872+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== osd.10 v2:172.21.15.94:6824/12358886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63400afe10 con 0x7f63400ad300 2024-03-31T23:16:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.890+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 --> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6358062d50 con 0x7f63400ad300 2024-03-31T23:16:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.890+0000 7f6354ff9700 1 -- 172.21.15.42:0/1663316872 <== osd.10 v2:172.21.15.94:6824/12358886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6358062d50 con 0x7f63400ad300 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] conn(0x7f63400ad300 msgr2=0x7f63400af740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] conn(0x7f63400ad300 0x7f63400af740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f63400a2640 msgr2=0x7f63400a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f63400a2640 0x7f63400a4b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6358079990 tx=0x7f634c0073d0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102290 msgr2=0x7f635819e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 --2- 172.21.15.42:0/1663316872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6358102290 0x7f635819e6d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f634800e9a0 tx=0x7f634800ecb0 comp rx=0 tx=0).stop 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f6357fff700 1 -- 172.21.15.42:0/1663316872 reap_dead start 2024-03-31T23:16:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 shutdown_connections 2024-03-31T23:16:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 >> 172.21.15.42:0/1663316872 conn(0x7f6358079370 msgr2=0x7f6358100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 shutdown_connections 2024-03-31T23:16:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:33.891+0000 7f635de0d700 1 -- 172.21.15.42:0/1663316872 wait complete. 2024-03-31T23:16:34.494 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:34 smithi188 ceph-mon[36068]: pgmap v315: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:16:34.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:34 smithi042 ceph-mon[32380]: pgmap v315: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:16:34.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:34 smithi094 ceph-mon[36167]: pgmap v315: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:16:35.228 INFO:teuthology.orchestra.run.smithi042.stdout:107374182463 2024-03-31T23:16:35.229 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-03-31T23:16:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 -- 172.21.15.42:0/2997165795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c101d80 msgr2=0x7fa81c105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 --2- 172.21.15.42:0/2997165795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c101d80 0x7fa81c105d40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa8180099c0 tx=0x7fa818009cd0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 -- 172.21.15.42:0/2997165795 shutdown_connections 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 --2- 172.21.15.42:0/2997165795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c1013d0 0x7fa81c1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 --2- 172.21.15.42:0/2997165795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa81c106420 0x7fa81c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 --2- 172.21.15.42:0/2997165795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c101d80 0x7fa81c105d40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 -- 172.21.15.42:0/2997165795 >> 172.21.15.42:0/2997165795 conn(0x7fa81c077190 msgr2=0x7fa81c0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 -- 172.21.15.42:0/2997165795 shutdown_connections 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.900+0000 7fa824272700 1 -- 172.21.15.42:0/2997165795 wait complete. 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 Processor -- start 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 -- start start 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa81c1013d0 0x7fa81c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c101d80 0x7fa81c19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c106420 0x7fa81c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c111520 con 0x7fa81c106420 2024-03-31T23:16:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1113a0 con 0x7fa81c1013d0 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa824272700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1116a0 con 0x7fa81c101d80 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa82280f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c106420 0x7fa81c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa82280f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c106420 0x7fa81c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52178/0 (socket says 172.21.15.42:52178) 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.901+0000 7fa82280f700 1 -- 172.21.15.42:0/2298014076 learned_addr learned my addr 172.21.15.42:0/2298014076 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82180d700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c101d80 0x7fa81c19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82200e700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa81c1013d0 0x7fa81c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82280f700 1 -- 172.21.15.42:0/2298014076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c101d80 msgr2=0x7fa81c19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82280f700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c101d80 0x7fa81c19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82280f700 1 -- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa81c1013d0 msgr2=0x7fa81c19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82280f700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa81c1013d0 0x7fa81c19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82280f700 1 -- 172.21.15.42:0/2298014076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c199070 con 0x7fa81c106420 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa82280f700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c106420 0x7fa81c198910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa81400ef30 tx=0x7fa81400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8140092e0 con 0x7fa81c106420 2024-03-31T23:16:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa814004bb0 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c199300 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814004280 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.902+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c1a5620 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.903+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa81c06aad0 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.904+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fa81401b030 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa8137fe700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8080a2640 0x7fa8080a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa82200e700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8080a2640 0x7fa8080a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa8140cee90 con 0x7fa81c106420 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa8137fe700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] conn(0x7fa8080ad300 0x7fa8080af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 --> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa814003e30 con 0x7fa8080ad300 2024-03-31T23:16:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa8140cf240 con 0x7fa81c106420 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa82200e700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8080a2640 0x7fa8080a4b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa81c199a50 tx=0x7fa80c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.905+0000 7fa82180d700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] conn(0x7fa8080ad300 0x7fa8080af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.906+0000 7fa82180d700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] conn(0x7fa8080ad300 0x7fa8080af740 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.906+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== osd.4 v2:172.21.15.94:6808/3966467075 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa814003e30 con 0x7fa8080ad300 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.923+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 --> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa81c102820 con 0x7fa8080ad300 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.923+0000 7fa8137fe700 1 -- 172.21.15.42:0/2298014076 <== osd.4 v2:172.21.15.94:6808/3966467075 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa81c102820 con 0x7fa8080ad300 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] conn(0x7fa8080ad300 msgr2=0x7fa8080af740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] conn(0x7fa8080ad300 0x7fa8080af740 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8080a2640 msgr2=0x7fa8080a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8080a2640 0x7fa8080a4b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa81c199a50 tx=0x7fa80c0073d0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c106420 msgr2=0x7fa81c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 --2- 172.21.15.42:0/2298014076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c106420 0x7fa81c198910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa81400ef30 tx=0x7fa81400c3a0 comp rx=0 tx=0).stop 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa82280f700 1 -- 172.21.15.42:0/2298014076 reap_dead start 2024-03-31T23:16:35.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 shutdown_connections 2024-03-31T23:16:35.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 >> 172.21.15.42:0/2298014076 conn(0x7fa81c077190 msgr2=0x7fa81c105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:35.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 shutdown_connections 2024-03-31T23:16:35.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:34.924+0000 7fa824272700 1 -- 172.21.15.42:0/2298014076 wait complete. 2024-03-31T23:16:36.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:36 smithi042 ceph-mon[32380]: pgmap v316: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-31T23:16:36.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:36 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.273 INFO:teuthology.orchestra.run.smithi042.stdout:219043332142 2024-03-31T23:16:36.274 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-03-31T23:16:36.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:36 smithi094 ceph-mon[36167]: pgmap v316: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-31T23:16:36.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:36 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 -- 172.21.15.42:0/2245027157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 msgr2=0x7f1f3410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/2245027157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 0x7f1f3410dff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00b0d0 tx=0x7f1f2c00b3e0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 -- 172.21.15.42:0/2245027157 shutdown_connections 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/2245027157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 0x7f1f3410dff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/2245027157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f341013d0 0x7f1f341017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/2245027157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 0x7f1f34105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 -- 172.21.15.42:0/2245027157 >> 172.21.15.42:0/2245027157 conn(0x7f1f34077190 msgr2=0x7f1f340775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 -- 172.21.15.42:0/2245027157 shutdown_connections 2024-03-31T23:16:36.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.447+0000 7f1f39cbc700 1 -- 172.21.15.42:0/2245027157 wait complete. 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 Processor -- start 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 -- start start 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f341013d0 0x7f1f3419e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 0x7f1f3419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 0x7f1f34198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34111550 con 0x7f1f34101d80 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341113d0 con 0x7f1f341013d0 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.448+0000 7f1f39cbc700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341116d0 con 0x7f1f34106420 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 0x7f1f3419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:36.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 0x7f1f3419ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52198/0 (socket says 172.21.15.42:52198) 2024-03-31T23:16:36.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 -- 172.21.15.42:0/74664749 learned_addr learned my addr 172.21.15.42:0/74664749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:36.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f33fff700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 0x7f1f34198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:36.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f337fe700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f341013d0 0x7f1f3419e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:36.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 -- 172.21.15.42:0/74664749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 msgr2=0x7f1f34198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:36.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 0x7f1f34198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 -- 172.21.15.42:0/74664749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f341013d0 msgr2=0x7f1f3419e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:36.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f341013d0 0x7f1f3419e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 -- 172.21.15.42:0/74664749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34198fe0 con 0x7f1f34101d80 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f33fff700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f34106420 0x7f1f34198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f337fe700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f341013d0 0x7f1f3419e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f32ffd700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 0x7f1f3419ebc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400ea30 tx=0x7f1f2400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400cbd0 con 0x7f1f34101d80 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f341992d0 con 0x7f1f34101d80 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f24004520 con 0x7f1f34101d80 2024-03-31T23:16:36.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f341a54e0 con 0x7f1f34101d80 2024-03-31T23:16:36.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.449+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24010430 con 0x7f1f34101d80 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.450+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f340629d0 con 0x7f1f34101d80 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.452+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f1f24003f10 con 0x7f1f34101d80 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.452+0000 7f1f30ff9700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1f200a25c0 0x7f1f200a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f1f240cedd0 con 0x7f1f34101d80 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f337fe700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1f200a25c0 0x7f1f200a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f30ff9700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] conn(0x7f1f200ad280 0x7f1f200af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 --> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f2400e1a0 con 0x7f1f200ad280 2024-03-31T23:16:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f1f240cf220 con 0x7f1f34101d80 2024-03-31T23:16:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f33fff700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] conn(0x7f1f200ad280 0x7f1f200af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.453+0000 7f1f337fe700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1f200a25c0 0x7f1f200a4a80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c011490 tx=0x7f1f1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.454+0000 7f1f33fff700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] conn(0x7f1f200ad280 0x7f1f200af6c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.454+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== osd.6 v2:172.21.15.42:6818/2819581932 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f2400e1a0 con 0x7f1f200ad280 2024-03-31T23:16:36.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:36 smithi188 ceph-mon[36068]: pgmap v316: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-31T23:16:36.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:36 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:16:36.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 --> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f34062dd0 con 0x7f1f200ad280 2024-03-31T23:16:36.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f30ff9700 1 -- 172.21.15.42:0/74664749 <== osd.6 v2:172.21.15.42:6818/2819581932 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1f34062dd0 con 0x7f1f200ad280 2024-03-31T23:16:36.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] conn(0x7f1f200ad280 msgr2=0x7f1f200af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:36.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] conn(0x7f1f200ad280 0x7f1f200af6c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:36.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1f200a25c0 msgr2=0x7f1f200a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:36.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f1f200a25c0 0x7f1f200a4a80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c011490 tx=0x7f1f1c009260 comp rx=0 tx=0).stop 2024-03-31T23:16:36.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 msgr2=0x7f1f3419ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f39cbc700 1 --2- 172.21.15.42:0/74664749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f34101d80 0x7f1f3419ebc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400ea30 tx=0x7f1f2400ed40 comp rx=0 tx=0).stop 2024-03-31T23:16:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.472+0000 7f1f33fff700 1 -- 172.21.15.42:0/74664749 reap_dead start 2024-03-31T23:16:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.473+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 shutdown_connections 2024-03-31T23:16:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.473+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 >> 172.21.15.42:0/74664749 conn(0x7f1f34077190 msgr2=0x7f1f3406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.473+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 shutdown_connections 2024-03-31T23:16:36.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:36.473+0000 7f1f39cbc700 1 -- 172.21.15.42:0/74664749 wait complete. 2024-03-31T23:16:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:38 smithi042 ceph-mon[32380]: pgmap v317: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-31T23:16:38.368 INFO:teuthology.orchestra.run.smithi042.stdout:141733920829 2024-03-31T23:16:38.369 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-03-31T23:16:38.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:38 smithi094 ceph-mon[36167]: pgmap v317: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-31T23:16:38.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:38 smithi188 ceph-mon[36068]: pgmap v317: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-31T23:16:39.043 INFO:teuthology.orchestra.run.smithi042.stdout:309237645341 2024-03-31T23:16:39.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.10 2024-03-31T23:16:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 -- 172.21.15.42:0/2576837434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 msgr2=0x7f83b410f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 --2- 172.21.15.42:0/2576837434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b410f070 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009990 tx=0x7f83b0009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 -- 172.21.15.42:0/2576837434 shutdown_connections 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 --2- 172.21.15.42:0/2576837434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b4108330 0x7f83b4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 --2- 172.21.15.42:0/2576837434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b410f070 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 --2- 172.21.15.42:0/2576837434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b41022c0 0x7f83b4102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 -- 172.21.15.42:0/2576837434 >> 172.21.15.42:0/2576837434 conn(0x7f83b4079310 msgr2=0x7f83b4079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 -- 172.21.15.42:0/2576837434 shutdown_connections 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.204+0000 7f83bb934700 1 -- 172.21.15.42:0/2576837434 wait complete. 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 Processor -- start 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 -- start start 2024-03-31T23:16:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b41022c0 0x7f83b4074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b4074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b4108330 0x7f83b4074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41126f0 con 0x7f83b4102c80 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4112570 con 0x7f83b4108330 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83bb934700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4112870 con 0x7f83b41022c0 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b8ecf700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b4074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b41022c0 0x7f83b4074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b41022c0 0x7f83b4074540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53934/0 (socket says 172.21.15.42:53934) 2024-03-31T23:16:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 -- 172.21.15.42:0/108624076 learned_addr learned my addr 172.21.15.42:0/108624076 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b9ed1700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b4108330 0x7f83b4074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b8ecf700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b4074a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52218/0 (socket says 172.21.15.42:52218) 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 -- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b4108330 msgr2=0x7f83b4074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b4108330 0x7f83b4074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 -- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 msgr2=0x7f83b4074a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b4074a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b96d0700 1 -- 172.21.15.42:0/108624076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b41a6f90 con 0x7f83b41022c0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.205+0000 7f83b8ecf700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83b4102c80 0x7f83b4074a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.206+0000 7f83b96d0700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b41022c0 0x7f83b4074540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e9a0 tx=0x7f83a400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.206+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a400ca10 con 0x7f83b41022c0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.206+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b41a7280 con 0x7f83b41022c0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.206+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b41a7810 con 0x7f83b41022c0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.206+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83a400cbb0 con 0x7f83b41022c0 2024-03-31T23:16:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.206+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4018710 con 0x7f83b41022c0 2024-03-31T23:16:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.207+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8398001030 con 0x7f83b41022c0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f83a40188b0 con 0x7f83b41022c0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83aa7fc700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f83a00a2640 0x7f83a00a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83b8ecf700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f83a00a2640 0x7f83a00a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f83a40cf250 con 0x7f83b41022c0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83aa7fc700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] conn(0x7f83a00ad300 0x7f83a00af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 --> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83a4019ec0 con 0x7f83a00ad300 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.209+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f83a40cf6a0 con 0x7f83b41022c0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.210+0000 7f83b9ed1700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] conn(0x7f83a00ad300 0x7f83a00af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.210+0000 7f83b8ecf700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f83a00a2640 0x7f83a00a4b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83b40798a0 tx=0x7f83ac00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.210+0000 7f83b9ed1700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] conn(0x7f83a00ad300 0x7f83a00af740 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.211+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== osd.1 v2:172.21.15.94:6800/3613405638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83a4019ec0 con 0x7f83a00ad300 2024-03-31T23:16:39.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.228+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 --> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8398002e60 con 0x7f83a00ad300 2024-03-31T23:16:39.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.228+0000 7f83aa7fc700 1 -- 172.21.15.42:0/108624076 <== osd.1 v2:172.21.15.94:6800/3613405638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8398002e60 con 0x7f83a00ad300 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] conn(0x7f83a00ad300 msgr2=0x7f83a00af740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] conn(0x7f83a00ad300 0x7f83a00af740 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f83a00a2640 msgr2=0x7f83a00a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f83a00a2640 0x7f83a00a4b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83b40798a0 tx=0x7f83ac00b040 comp rx=0 tx=0).stop 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b41022c0 msgr2=0x7f83b4074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 --2- 172.21.15.42:0/108624076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b41022c0 0x7f83b4074540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e9a0 tx=0x7f83a400ecb0 comp rx=0 tx=0).stop 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83b9ed1700 1 -- 172.21.15.42:0/108624076 reap_dead start 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 shutdown_connections 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 >> 172.21.15.42:0/108624076 conn(0x7f83b4079310 msgr2=0x7f83b4100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 shutdown_connections 2024-03-31T23:16:39.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:39.229+0000 7f83bb934700 1 -- 172.21.15.42:0/108624076 wait complete. 2024-03-31T23:16:39.917 INFO:teuthology.orchestra.run.smithi042.stdout:343597383704 2024-03-31T23:16:39.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.11 2024-03-31T23:16:40.318 INFO:teuthology.orchestra.run.smithi042.stdout:197568495667 2024-03-31T23:16:40.319 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-03-31T23:16:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:40 smithi188 ceph-mon[36068]: pgmap v318: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-31T23:16:40.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:40 smithi042 ceph-mon[32380]: pgmap v318: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-31T23:16:40.743 INFO:teuthology.orchestra.run.smithi042.stdout:55834574924 2024-03-31T23:16:40.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-03-31T23:16:40.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:40 smithi094 ceph-mon[36167]: pgmap v318: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-31T23:16:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 -- 172.21.15.42:0/4048512557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 msgr2=0x7fbc20108650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 --2- 172.21.15.42:0/4048512557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20108650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0099c0 tx=0x7fbc1c009cd0 comp rx=0 tx=0).stop 2024-03-31T23:16:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 -- 172.21.15.42:0/4048512557 shutdown_connections 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 --2- 172.21.15.42:0/4048512557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc20102c50 0x7fbc2010f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 --2- 172.21.15.42:0/4048512557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20108650 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 --2- 172.21.15.42:0/4048512557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc20102290 0x7fbc20102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 -- 172.21.15.42:0/4048512557 >> 172.21.15.42:0/4048512557 conn(0x7fbc20079370 msgr2=0x7fbc20079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 -- 172.21.15.42:0/4048512557 shutdown_connections 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.977+0000 7fbc27a25700 1 -- 172.21.15.42:0/4048512557 wait complete. 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 Processor -- start 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 -- start start 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc20102290 0x7fbc2019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc20102c50 0x7fbc2019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20112660 con 0x7fbc20108270 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbc201124e0 con 0x7fbc20102290 2024-03-31T23:16:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc27a25700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc201127e0 con 0x7fbc20102c50 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52236/0 (socket says 172.21.15.42:52236) 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc257c1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc20102290 0x7fbc2019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc24fc0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc20102c50 0x7fbc2019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 -- 172.21.15.42:0/1617883189 learned_addr learned my addr 172.21.15.42:0/1617883189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 -- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc20102c50 msgr2=0x7fbc2019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc20102c50 0x7fbc2019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 -- 172.21.15.42:0/1617883189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc20102290 msgr2=0x7fbc2019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc20102290 0x7fbc2019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 -- 172.21.15.42:0/1617883189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc20199060 con 0x7fbc20108270 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc257c1700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc20102290 0x7fbc2019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc24fc0700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc20102c50 0x7fbc2019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.978+0000 7fbc25fc2700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20198900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ef30 tx=0x7fbc1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.979+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc180092e0 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.979+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc18004bb0 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.979+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc201992f0 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.979+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18004280 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.979+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc201a5610 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.979+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc20062990 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.981+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fbc1801b030 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.981+0000 7fbc167fc700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbc0c0a25c0 0x7fbc0c0a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.981+0000 7fbc257c1700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbc0c0a25c0 0x7fbc0c0a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.981+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fbc180ceea0 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.982+0000 7fbc167fc700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] conn(0x7fbc0c0ad280 0x7fbc0c0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.982+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 --> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc1801fe50 con 0x7fbc0c0ad280 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.982+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fbc180cf2f0 con 0x7fbc20108270 2024-03-31T23:16:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.982+0000 7fbc24fc0700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] conn(0x7fbc0c0ad280 0x7fbc0c0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.982+0000 7fbc257c1700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbc0c0a25c0 0x7fbc0c0a4a80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc20199a40 tx=0x7fbc1c005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.982+0000 7fbc24fc0700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] conn(0x7fbc0c0ad280 0x7fbc0c0af6c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:40.983+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== osd.8 v2:172.21.15.188:6816/1325771974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc1801fe50 con 0x7fbc0c0ad280 2024-03-31T23:16:41.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.000+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 --> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc20062e10 con 0x7fbc0c0ad280 2024-03-31T23:16:41.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.000+0000 7fbc167fc700 1 -- 172.21.15.42:0/1617883189 <== osd.8 v2:172.21.15.188:6816/1325771974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbc20062e10 con 0x7fbc0c0ad280 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.000+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] conn(0x7fbc0c0ad280 msgr2=0x7fbc0c0af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.000+0000 7fbc27a25700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] conn(0x7fbc0c0ad280 0x7fbc0c0af6c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.000+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbc0c0a25c0 msgr2=0x7fbc0c0a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbc0c0a25c0 0x7fbc0c0a4a80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc20199a40 tx=0x7fbc1c005a90 comp rx=0 tx=0).stop 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 msgr2=0x7fbc20198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 --2- 172.21.15.42:0/1617883189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20108270 0x7fbc20198900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ef30 tx=0x7fbc1800c3a0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc25fc2700 1 -- 172.21.15.42:0/1617883189 reap_dead start 2024-03-31T23:16:41.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 shutdown_connections 2024-03-31T23:16:41.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 >> 172.21.15.42:0/1617883189 conn(0x7fbc20079370 msgr2=0x7fbc20100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:41.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 shutdown_connections 2024-03-31T23:16:41.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.001+0000 7fbc27a25700 1 -- 172.21.15.42:0/1617883189 wait complete. 2024-03-31T23:16:41.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 -- 172.21.15.42:0/772403365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c40749b0 msgr2=0x7f77c4074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 --2- 172.21.15.42:0/772403365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c40749b0 0x7f77c4074e30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009990 tx=0x7f77b0009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 -- 172.21.15.42:0/772403365 shutdown_connections 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 --2- 172.21.15.42:0/772403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77c4112ed0 0x7f77c41152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 --2- 172.21.15.42:0/772403365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77c4076270 0x7f77c4074470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 --2- 172.21.15.42:0/772403365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c40749b0 0x7f77c4074e30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 -- 172.21.15.42:0/772403365 >> 172.21.15.42:0/772403365 conn(0x7f77c4079370 msgr2=0x7f77c4079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 -- 172.21.15.42:0/772403365 shutdown_connections 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 -- 172.21.15.42:0/772403365 wait complete. 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 Processor -- start 2024-03-31T23:16:41.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.276+0000 7f77cac67700 1 -- start start 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77c40749b0 0x7f77c419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4076270 0x7f77c419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77c4112ed0 0x7f77c41a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4118c90 con 0x7f77c4076270 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4118b10 con 0x7f77c40749b0 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4118e10 con 0x7f77c4112ed0 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4076270 0x7f77c419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77c40749b0 0x7f77c419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4076270 0x7f77c419f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52262/0 (socket says 172.21.15.42:52262) 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c3fff700 1 -- 172.21.15.42:0/303381505 learned_addr learned my addr 172.21.15.42:0/303381505 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c9204700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77c4112ed0 0x7f77c41a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 -- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77c4112ed0 msgr2=0x7f77c41a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77c4112ed0 0x7f77c41a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 -- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4076270 msgr2=0x7f77c419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4076270 0x7f77c419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 -- 172.21.15.42:0/303381505 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c41a40e0 con 0x7f77c40749b0 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c3fff700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4076270 0x7f77c419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c8a03700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77c40749b0 0x7f77c419f120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77b800e9f0 tx=0x7f77b800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b800c9c0 con 0x7f77c40749b0 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77b800cb60 con 0x7f77c40749b0 2024-03-31T23:16:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c41a43d0 con 0x7f77c40749b0 2024-03-31T23:16:41.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.277+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8018680 con 0x7f77c40749b0 2024-03-31T23:16:41.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.278+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c41abc50 con 0x7f77c40749b0 2024-03-31T23:16:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.278+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77c4112630 con 0x7f77c40749b0 2024-03-31T23:16:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f77b8010430 con 0x7f77c40749b0 2024-03-31T23:16:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c1ffb700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f77b40a25c0 0x7f77b40a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c3fff700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f77b40a25c0 0x7f77b40a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f77b80cf4e0 con 0x7f77c40749b0 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c1ffb700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] conn(0x7f77b40ad280 0x7f77b40af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 --> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77b801bec0 con 0x7f77b40ad280 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.280+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f77b80cf890 con 0x7f77c40749b0 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.281+0000 7f77c3fff700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f77b40a25c0 0x7f77b40a4a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77c4079b90 tx=0x7f77b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.281+0000 7f77c9204700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] conn(0x7f77b40ad280 0x7f77b40af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.281+0000 7f77c9204700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] conn(0x7f77b40ad280 0x7f77b40af6c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:41.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.282+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== osd.5 v2:172.21.15.188:6808/432169288 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77b801bec0 con 0x7f77b40ad280 2024-03-31T23:16:41.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.298+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 --> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77c4075b20 con 0x7f77b40ad280 2024-03-31T23:16:41.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77c1ffb700 1 -- 172.21.15.42:0/303381505 <== osd.5 v2:172.21.15.188:6808/432169288 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f77c4075b20 con 0x7f77b40ad280 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] conn(0x7f77b40ad280 msgr2=0x7f77b40af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] conn(0x7f77b40ad280 0x7f77b40af6c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f77b40a25c0 msgr2=0x7f77b40a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f77b40a25c0 0x7f77b40a4a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77c4079b90 tx=0x7f77b001a040 comp rx=0 tx=0).stop 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77c40749b0 msgr2=0x7f77c419f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 --2- 172.21.15.42:0/303381505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77c40749b0 0x7f77c419f120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77b800e9f0 tx=0x7f77b800ed00 comp rx=0 tx=0).stop 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77c9204700 1 -- 172.21.15.42:0/303381505 reap_dead start 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 shutdown_connections 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 >> 172.21.15.42:0/303381505 conn(0x7f77c4079370 msgr2=0x7f77c4111bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 shutdown_connections 2024-03-31T23:16:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.299+0000 7f77cac67700 1 -- 172.21.15.42:0/303381505 wait complete. 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 -- 172.21.15.42:0/1825439079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2001011f0 msgr2=0x7fa20010f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1825439079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2001011f0 0x7fa20010f150 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800b0a0 tx=0x7fa1f800b3b0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 -- 172.21.15.42:0/1825439079 shutdown_connections 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1825439079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2001011f0 0x7fa20010f150 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1825439079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2001072b0 0x7fa200107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1825439079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa200100830 0x7fa200100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 -- 172.21.15.42:0/1825439079 >> 172.21.15.42:0/1825439079 conn(0x7fa200077740 msgr2=0x7fa2000feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 -- 172.21.15.42:0/1825439079 shutdown_connections 2024-03-31T23:16:41.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.501+0000 7fa2051e1700 1 -- 172.21.15.42:0/1825439079 wait complete. 2024-03-31T23:16:41.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 Processor -- start 2024-03-31T23:16:41.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 -- start start 2024-03-31T23:16:41.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa200100830 0x7fa20019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2001011f0 0x7fa20019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2001072b0 0x7fa2001989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa200112860 con 0x7fa200100830 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001126e0 con 0x7fa2001072b0 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa2051e1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001129e0 con 0x7fa2001011f0 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa1fed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa200100830 0x7fa20019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa1fed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa200100830 0x7fa20019e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52290/0 (socket says 172.21.15.42:52290) 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa1fed9d700 1 -- 172.21.15.42:0/1255725643 learned_addr learned my addr 172.21.15.42:0/1255725643 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa1fe59c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2001011f0 0x7fa20019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.502+0000 7fa1ff59e700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2001072b0 0x7fa2001989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fe59c700 1 -- 172.21.15.42:0/1255725643 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2001072b0 msgr2=0x7fa2001989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fe59c700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2001072b0 0x7fa2001989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fe59c700 1 -- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa200100830 msgr2=0x7fa20019e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fe59c700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa200100830 0x7fa20019e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fe59c700 1 -- 172.21.15.42:0/1255725643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa200199120 con 0x7fa2001011f0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fed9d700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa200100830 0x7fa20019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1ff59e700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2001072b0 0x7fa2001989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1fe59c700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2001011f0 0x7fa20019ecf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400e9f0 tx=0x7fa1f400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400c9c0 con 0x7fa2001011f0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1f400cb60 con 0x7fa2001011f0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4018680 con 0x7fa2001011f0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa200199410 con 0x7fa2001011f0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.503+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa200101940 con 0x7fa2001011f0 2024-03-31T23:16:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.504+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa200062950 con 0x7fa2001011f0 2024-03-31T23:16:41.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.506+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fa1f4010430 con 0x7fa2001011f0 2024-03-31T23:16:41.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.506+0000 7fa1e7fff700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa1e80a25c0 0x7fa1e80a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.506+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fa1f40cf5a0 con 0x7fa2001011f0 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.506+0000 7fa1e7fff700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] conn(0x7fa1e80ad720 0x7fa1e80afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.506+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 --> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1f401bec0 con 0x7fa1e80ad720 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.506+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa1f40cf9f0 con 0x7fa2001011f0 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.507+0000 7fa1fed9d700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa1e80a25c0 0x7fa1e80a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.507+0000 7fa1ff59e700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] conn(0x7fa1e80ad720 0x7fa1e80afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.507+0000 7fa1fed9d700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa1e80a25c0 0x7fa1e80a4a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa200106c40 tx=0x7fa1f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.507+0000 7fa1ff59e700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] conn(0x7fa1e80ad720 0x7fa1e80afbc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:41.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.508+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== osd.0 v2:172.21.15.42:6802/2561562305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1f401bec0 con 0x7fa1e80ad720 2024-03-31T23:16:41.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.524+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 --> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa200062d50 con 0x7fa1e80ad720 2024-03-31T23:16:41.525 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-03-31T23:16:41.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-03-31T23:16:41.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa1e7fff700 1 -- 172.21.15.42:0/1255725643 <== osd.0 v2:172.21.15.42:6802/2561562305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa200062d50 con 0x7fa1e80ad720 2024-03-31T23:16:41.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] conn(0x7fa1e80ad720 msgr2=0x7fa1e80afbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] conn(0x7fa1e80ad720 0x7fa1e80afbc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa1e80a25c0 msgr2=0x7fa1e80a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa1e80a25c0 0x7fa1e80a4a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa200106c40 tx=0x7fa1f0009260 comp rx=0 tx=0).stop 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2001011f0 msgr2=0x7fa20019ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 --2- 172.21.15.42:0/1255725643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2001011f0 0x7fa20019ecf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400e9f0 tx=0x7fa1f400ed00 comp rx=0 tx=0).stop 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa1ff59e700 1 -- 172.21.15.42:0/1255725643 reap_dead start 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 shutdown_connections 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.525+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 >> 172.21.15.42:0/1255725643 conn(0x7fa200077740 msgr2=0x7fa200105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.526+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 shutdown_connections 2024-03-31T23:16:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:41.526+0000 7fa2051e1700 1 -- 172.21.15.42:0/1255725643 wait complete. 2024-03-31T23:16:41.914 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-31T23:16:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-31T23:16:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-03-31T23:16:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-03-31T23:16:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-03-31T23:16:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-03-31T23:16:41.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-03-31T23:16:41.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]: dispatch 2024-03-31T23:16:41.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-03-31T23:16:41.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-03-31T23:16:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-03-31T23:16:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-03-31T23:16:42.558 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: pgmap v319: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-31T23:16:42.558 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-31T23:16:42.558 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-31T23:16:42.558 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-03-31T23:16:42.559 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:42 smithi042 ceph-mon[32380]: osdmap e90: 12 total, 12 up, 12 in 2024-03-31T23:16:42.592 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:42.592 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:42.594 INFO:teuthology.orchestra.run.smithi042.stdout:253403070505 2024-03-31T23:16:42.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.8 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: pgmap v319: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-03-31T23:16:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-03-31T23:16:42.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]': finished 2024-03-31T23:16:42.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-03-31T23:16:42.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-03-31T23:16:42.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:42 smithi094 ceph-mon[36167]: osdmap e90: 12 total, 12 up, 12 in 2024-03-31T23:16:42.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: pgmap v319: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-03-31T23:16:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:42 smithi188 ceph-mon[36068]: osdmap e90: 12 total, 12 up, 12 in 2024-03-31T23:16:43.726 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:43 smithi042 ceph-mon[32380]: osdmap e91: 12 total, 12 up, 12 in 2024-03-31T23:16:43.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:43 smithi094 ceph-mon[36167]: osdmap e91: 12 total, 12 up, 12 in 2024-03-31T23:16:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:43 smithi188 ceph-mon[36068]: osdmap e91: 12 total, 12 up, 12 in 2024-03-31T23:16:44.299 INFO:teuthology.orchestra.run.smithi042.stdout:163208757305 2024-03-31T23:16:44.300 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-03-31T23:16:44.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:44 smithi042 ceph-mon[32380]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-31T23:16:44.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:44 smithi042 ceph-mon[32380]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-31T23:16:44.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:44 smithi094 ceph-mon[36167]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-31T23:16:44.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:44 smithi094 ceph-mon[36167]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-31T23:16:44.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:44 smithi188 ceph-mon[36068]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-31T23:16:44.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:44 smithi188 ceph-mon[36068]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-31T23:16:45.298 INFO:teuthology.orchestra.run.smithi042.stdout:34359738449 2024-03-31T23:16:45.298 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-03-31T23:16:45.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:45 smithi042 ceph-mon[32380]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-31T23:16:45.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:45 smithi042 ceph-mon[32380]: Cluster is now healthy 2024-03-31T23:16:45.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:45 smithi094 ceph-mon[36167]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-31T23:16:45.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:45 smithi094 ceph-mon[36167]: Cluster is now healthy 2024-03-31T23:16:45.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:45 smithi188 ceph-mon[36068]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-31T23:16:45.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:45 smithi188 ceph-mon[36068]: Cluster is now healthy 2024-03-31T23:16:46.662 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:46.662 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:46.667 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:46.667 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:46.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:46 smithi042 ceph-mon[32380]: pgmap v323: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-03-31T23:16:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:46 smithi094 ceph-mon[36167]: pgmap v323: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-03-31T23:16:46.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:46 smithi188 ceph-mon[36068]: pgmap v323: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 -- 172.21.15.42:0/3428742825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b81072b0 msgr2=0x7f97b8107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3428742825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b81072b0 0x7f97b8107690 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009990 tx=0x7f97b4009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 -- 172.21.15.42:0/3428742825 shutdown_connections 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3428742825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97b81011f0 0x7f97b810f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3428742825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b81072b0 0x7f97b8107690 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3428742825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97b8100830 0x7f97b8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 -- 172.21.15.42:0/3428742825 >> 172.21.15.42:0/3428742825 conn(0x7f97b8077740 msgr2=0x7f97b80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 -- 172.21.15.42:0/3428742825 shutdown_connections 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.265+0000 7f97bf99b700 1 -- 172.21.15.42:0/3428742825 wait complete. 2024-03-31T23:16:47.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 Processor -- start 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 -- start start 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 0x7f97b819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97b81011f0 0x7f97b819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97b81072b0 0x7f97b8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97b81127d0 con 0x7f97b8100830 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8112650 con 0x7f97b81072b0 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bf99b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8112950 con 0x7f97b81011f0 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 0x7f97b819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 0x7f97b819e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36838/0 (socket says 172.21.15.42:36838) 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 -- 172.21.15.42:0/3594787975 learned_addr learned my addr 172.21.15.42:0/3594787975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bcf36700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97b81011f0 0x7f97b819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bdf38700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97b81072b0 0x7f97b8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 -- 172.21.15.42:0/3594787975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97b81011f0 msgr2=0x7f97b819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:47.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97b81011f0 0x7f97b819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 -- 172.21.15.42:0/3594787975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97b81072b0 msgr2=0x7f97b8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97b81072b0 0x7f97b8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 -- 172.21.15.42:0/3594787975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b8199190 con 0x7f97b8100830 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.266+0000 7f97bd737700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 0x7f97b819e7d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f97b4000c00 tx=0x7f97b400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.267+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4027070 con 0x7f97b8100830 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.267+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97b4022470 con 0x7f97b8100830 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.267+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b8199420 con 0x7f97b8100830 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.267+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4017630 con 0x7f97b8100830 2024-03-31T23:16:47.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.267+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b81a56a0 con 0x7f97b8100830 2024-03-31T23:16:47.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.268+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b8103b50 con 0x7f97b8100830 2024-03-31T23:16:47.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.270+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f97b402a070 con 0x7f97b8100830 2024-03-31T23:16:47.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.270+0000 7f97ae7fc700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f97a40a2640 0x7f97a40a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:47.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.270+0000 7f97bcf36700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f97a40a2640 0x7f97a40a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:47.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.270+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f97b40cfb60 con 0x7f97b8100830 2024-03-31T23:16:47.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.271+0000 7f97bcf36700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f97a40a2640 0x7f97a40a4b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97b80ffd30 tx=0x7f97a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:47.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.274+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f97b4031080 con 0x7f97b8100830 2024-03-31T23:16:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.486+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f97b8068f00 con 0x7f97b8100830 2024-03-31T23:16:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.486+0000 7f97ae7fc700 1 -- 172.21.15.42:0/3594787975 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f97b4013070 con 0x7f97b8100830 2024-03-31T23:16:47.488 INFO:teuthology.orchestra.run.smithi042.stdout:287762808869 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f97a40a2640 msgr2=0x7f97a40a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f97a40a2640 0x7f97a40a4b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97b80ffd30 tx=0x7f97a8009260 comp rx=0 tx=0).stop 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 msgr2=0x7f97b819e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 0x7f97b819e7d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f97b4000c00 tx=0x7f97b400b610 comp rx=0 tx=0).stop 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 shutdown_connections 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f97a40a2640 0x7f97a40a4b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97b81072b0 0x7f97b8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b8100830 0x7f97b819e7d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 --2- 172.21.15.42:0/3594787975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97b81011f0 0x7f97b819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 >> 172.21.15.42:0/3594787975 conn(0x7f97b8077740 msgr2=0x7f97b8105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 shutdown_connections 2024-03-31T23:16:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:47.489+0000 7f97bf99b700 1 -- 172.21.15.42:0/3594787975 wait complete. 2024-03-31T23:16:47.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3594787975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-31T23:16:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3594787975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-31T23:16:47.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3594787975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-31T23:16:48.124 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808865 got 287762808869 for osd.9 2024-03-31T23:16:48.124 DEBUG:teuthology.parallel:result is None 2024-03-31T23:16:48.702 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:48 smithi042 ceph-mon[32380]: pgmap v324: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:48.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 -- 172.21.15.42:0/1436984632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c06a9e0 msgr2=0x7f111c06adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:48.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1436984632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c06a9e0 0x7f111c06adc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b0a0 tx=0x7f110c00b3b0 comp rx=0 tx=0).stop 2024-03-31T23:16:48.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 -- 172.21.15.42:0/1436984632 shutdown_connections 2024-03-31T23:16:48.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1436984632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c107550 0x7f111c10f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:48.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1436984632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c06a9e0 0x7f111c06adc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:48.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1436984632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f111c06b390 0x7f111c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:48.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 -- 172.21.15.42:0/1436984632 >> 172.21.15.42:0/1436984632 conn(0x7f111c077190 msgr2=0x7f111c0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:48.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 -- 172.21.15.42:0/1436984632 shutdown_connections 2024-03-31T23:16:48.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.807+0000 7f1120b8b700 1 -- 172.21.15.42:0/1436984632 wait complete. 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 Processor -- start 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 -- start start 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c06a9e0 0x7f111c19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f111c06b390 0x7f111c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 0x7f111c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f111c112670 con 0x7f111c107550 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f111c1124f0 con 0x7f111c06a9e0 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f1120b8b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f111c1127f0 con 0x7f111c06b390 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.808+0000 7f111ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 0x7f111c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:48.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 0x7f111c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36868/0 (socket says 172.21.15.42:36868) 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 -- 172.21.15.42:0/1255967177 learned_addr learned my addr 172.21.15.42:0/1255967177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111a59c700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c06a9e0 0x7f111c19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f1119d9b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f111c06b390 0x7f111c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 -- 172.21.15.42:0/1255967177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f111c06b390 msgr2=0x7f111c19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f111c06b390 0x7f111c19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 -- 172.21.15.42:0/1255967177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c06a9e0 msgr2=0x7f111c19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c06a9e0 0x7f111c19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 -- 172.21.15.42:0/1255967177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c199010 con 0x7f111c107550 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111a59c700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c06a9e0 0x7f111c19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f111ad9d700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 0x7f111c198830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f111400e940 tx=0x7f111400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114004a30 con 0x7f111c107550 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1114005520 con 0x7f111c107550 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c199300 con 0x7f111c107550 2024-03-31T23:16:48.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111400ce80 con 0x7f111c107550 2024-03-31T23:16:48.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.809+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c1a5510 con 0x7f111c107550 2024-03-31T23:16:48.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.810+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c103950 con 0x7f111c107550 2024-03-31T23:16:48.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.811+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f1114005000 con 0x7f111c107550 2024-03-31T23:16:48.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.812+0000 7f11137fe700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11080a25c0 0x7f11080a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:48.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.812+0000 7f111a59c700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11080a25c0 0x7f11080a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:48.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.812+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f11140cf020 con 0x7f111c107550 2024-03-31T23:16:48.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.812+0000 7f111a59c700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11080a25c0 0x7f11080a4a80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f110c009e60 tx=0x7f110c00b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:48.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:48.816+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1114053280 con 0x7f111c107550 2024-03-31T23:16:48.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:48 smithi094 ceph-mon[36167]: pgmap v324: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:48.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:48 smithi188 ceph-mon[36068]: pgmap v324: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:49.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.025+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f111c02db30 con 0x7f111c107550 2024-03-31T23:16:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.026+0000 7f11137fe700 1 -- 172.21.15.42:0/1255967177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f111409bcc0 con 0x7f111c107550 2024-03-31T23:16:49.027 INFO:teuthology.orchestra.run.smithi042.stdout:77309411401 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11080a25c0 msgr2=0x7f11080a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11080a25c0 0x7f11080a4a80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f110c009e60 tx=0x7f110c00b700 comp rx=0 tx=0).stop 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 msgr2=0x7f111c198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 0x7f111c198830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f111400e940 tx=0x7f111400ec50 comp rx=0 tx=0).stop 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 shutdown_connections 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11080a25c0 0x7f11080a4a80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f111c107550 0x7f111c198830 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f111c06a9e0 0x7f111c19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 --2- 172.21.15.42:0/1255967177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f111c06b390 0x7f111c19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 >> 172.21.15.42:0/1255967177 conn(0x7f111c077190 msgr2=0x7f111c0ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 shutdown_connections 2024-03-31T23:16:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:49.028+0000 7f1120b8b700 1 -- 172.21.15.42:0/1255967177 wait complete. 2024-03-31T23:16:49.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:49 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1255967177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-31T23:16:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:49 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1255967177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-31T23:16:49.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:49 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1255967177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-31T23:16:50.823 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:50 smithi094 ceph-mon[36167]: pgmap v325: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:50.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:50 smithi042 ceph-mon[32380]: pgmap v325: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:50.845 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:50.846 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:50.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:50 smithi188 ceph-mon[36068]: pgmap v325: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:52.762 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:52 smithi042 ceph-mon[32380]: pgmap v326: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:52.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:52 smithi094 ceph-mon[36167]: pgmap v326: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:52.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:52 smithi188 ceph-mon[36068]: pgmap v326: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:53.245 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411401 for osd.2 2024-03-31T23:16:53.245 DEBUG:teuthology.parallel:result is None 2024-03-31T23:16:54.752 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:54 smithi042 ceph-mon[32380]: pgmap v327: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:54.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:54 smithi094 ceph-mon[36167]: pgmap v327: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:54.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:54 smithi188 ceph-mon[36068]: pgmap v327: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 2 B/s, 0 objects/s recovering 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 -- 172.21.15.42:0/1521973184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806b590 msgr2=0x7f92a8106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 --2- 172.21.15.42:0/1521973184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806b590 0x7f92a8106f50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009990 tx=0x7f92a4009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 -- 172.21.15.42:0/1521973184 shutdown_connections 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 --2- 172.21.15.42:0/1521973184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92a8107680 0x7f92a810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 --2- 172.21.15.42:0/1521973184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92a806abe0 0x7f92a806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 --2- 172.21.15.42:0/1521973184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806b590 0x7f92a8106f50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 -- 172.21.15.42:0/1521973184 >> 172.21.15.42:0/1521973184 conn(0x7f92a8077fa0 msgr2=0x7f92a80783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 -- 172.21.15.42:0/1521973184 shutdown_connections 2024-03-31T23:16:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 -- 172.21.15.42:0/1521973184 wait complete. 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 Processor -- start 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.224+0000 7f92b0406700 1 -- start start 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92b0406700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 0x7f92a819e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92b0406700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92a806b590 0x7f92a819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92b0406700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92a8107680 0x7f92a8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92b0406700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8112700 con 0x7f92a806abe0 2024-03-31T23:16:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92b0406700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8112580 con 0x7f92a806b590 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92b0406700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8112880 con 0x7f92a8107680 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 0x7f92a819e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ad9a1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92a806b590 0x7f92a819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 0x7f92a819e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52120/0 (socket says 172.21.15.42:52120) 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 -- 172.21.15.42:0/1721647582 learned_addr learned my addr 172.21.15.42:0/1721647582 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae9a3700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92a8107680 0x7f92a8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 -- 172.21.15.42:0/1721647582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92a8107680 msgr2=0x7f92a8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92a8107680 0x7f92a8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 -- 172.21.15.42:0/1721647582 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92a806b590 msgr2=0x7f92a819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92a806b590 0x7f92a819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 -- 172.21.15.42:0/1721647582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a81990a0 con 0x7f92a806abe0 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f92ae1a2700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 0x7f92a819e730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f929800e9a0 tx=0x7f929800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929800ca10 con 0x7f92a806abe0 2024-03-31T23:16:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f929800cbb0 con 0x7f92a806abe0 2024-03-31T23:16:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.225+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298018710 con 0x7f92a806abe0 2024-03-31T23:16:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.226+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a8199390 con 0x7f92a806abe0 2024-03-31T23:16:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.226+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a81a5600 con 0x7f92a806abe0 2024-03-31T23:16:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.227+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a8103a00 con 0x7f92a806abe0 2024-03-31T23:16:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.228+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f9298010430 con 0x7f92a806abe0 2024-03-31T23:16:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.228+0000 7f929f7fe700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92940a2640 0x7f92940a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.228+0000 7f92ad9a1700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92940a2640 0x7f92940a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.229+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f92980ced40 con 0x7f92a806abe0 2024-03-31T23:16:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.229+0000 7f92ad9a1700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92940a2640 0x7f92940a4b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f92a4006010 tx=0x7f92a4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:55.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.233+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f929809ba40 con 0x7f92a806abe0 2024-03-31T23:16:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.448+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f92a802db30 con 0x7f92a806abe0 2024-03-31T23:16:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.448+0000 7f929f7fe700 1 -- 172.21.15.42:0/1721647582 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f929809b340 con 0x7f92a806abe0 2024-03-31T23:16:55.449 INFO:teuthology.orchestra.run.smithi042.stdout:253403070507 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92940a2640 msgr2=0x7f92940a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92940a2640 0x7f92940a4b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f92a4006010 tx=0x7f92a4005960 comp rx=0 tx=0).stop 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 msgr2=0x7f92a819e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 0x7f92a819e730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f929800e9a0 tx=0x7f929800ecb0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 shutdown_connections 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f92940a2640 0x7f92940a4b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92a8107680 0x7f92a8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92a806abe0 0x7f92a819e730 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 --2- 172.21.15.42:0/1721647582 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92a806b590 0x7f92a819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:55.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 >> 172.21.15.42:0/1721647582 conn(0x7f92a8077fa0 msgr2=0x7f92a8100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:55.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.450+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 shutdown_connections 2024-03-31T23:16:55.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:55.451+0000 7f92b0406700 1 -- 172.21.15.42:0/1721647582 wait complete. 2024-03-31T23:16:55.720 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1721647582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-31T23:16:55.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1721647582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-31T23:16:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1721647582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-31T23:16:56.289 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:56.774 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:56 smithi042 ceph-mon[32380]: pgmap v328: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 1 B/s, 0 objects/s recovering 2024-03-31T23:16:56.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:56 smithi094 ceph-mon[36167]: pgmap v328: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 1 B/s, 0 objects/s recovering 2024-03-31T23:16:56.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:56 smithi188 ceph-mon[36068]: pgmap v328: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 1 B/s, 0 objects/s recovering 2024-03-31T23:16:57.690 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070505 got 253403070507 for osd.8 2024-03-31T23:16:57.690 DEBUG:teuthology.parallel:result is None 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 -- 172.21.15.42:0/1822155419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c0749b0 msgr2=0x7fb92c074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 --2- 172.21.15.42:0/1822155419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c0749b0 0x7fb92c074e30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009990 tx=0x7fb91c009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 -- 172.21.15.42:0/1822155419 shutdown_connections 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 --2- 172.21.15.42:0/1822155419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c076270 0x7fb92c074470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 --2- 172.21.15.42:0/1822155419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb92c112ed0 0x7fb92c1152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 --2- 172.21.15.42:0/1822155419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c0749b0 0x7fb92c074e30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 -- 172.21.15.42:0/1822155419 >> 172.21.15.42:0/1822155419 conn(0x7fb92c079370 msgr2=0x7fb92c079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 -- 172.21.15.42:0/1822155419 shutdown_connections 2024-03-31T23:16:57.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.911+0000 7fb93326b700 1 -- 172.21.15.42:0/1822155419 wait complete. 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 Processor -- start 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 -- start start 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0749b0 0x7fb92c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 0x7fb92c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb92c112ed0 0x7fb92c1a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c118c60 con 0x7fb92c076270 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c118ae0 con 0x7fb92c112ed0 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb93326b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c118de0 con 0x7fb92c0749b0 2024-03-31T23:16:57.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb930806700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 0x7fb92c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb930806700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 0x7fb92c19f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52136/0 (socket says 172.21.15.42:52136) 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb930806700 1 -- 172.21.15.42:0/3521983963 learned_addr learned my addr 172.21.15.42:0/3521983963 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb931007700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0749b0 0x7fb92c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.912+0000 7fb931808700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb92c112ed0 0x7fb92c1a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb930806700 1 -- 172.21.15.42:0/3521983963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0749b0 msgr2=0x7fb92c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb930806700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0749b0 0x7fb92c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb930806700 1 -- 172.21.15.42:0/3521983963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb92c112ed0 msgr2=0x7fb92c1a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb930806700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb92c112ed0 0x7fb92c1a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb930806700 1 -- 172.21.15.42:0/3521983963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c1a40e0 con 0x7fb92c076270 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb931007700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0749b0 0x7fb92c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb930806700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 0x7fb92c19f610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb91c000c00 tx=0x7fb91c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c027070 con 0x7fb92c076270 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c1a4370 con 0x7fb92c076270 2024-03-31T23:16:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c1abc50 con 0x7fb92c076270 2024-03-31T23:16:57.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb91c022470 con 0x7fb92c076270 2024-03-31T23:16:57.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.913+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c017630 con 0x7fb92c076270 2024-03-31T23:16:57.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.914+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb910005330 con 0x7fb92c076270 2024-03-31T23:16:57.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.915+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fb91c02a070 con 0x7fb92c076270 2024-03-31T23:16:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.916+0000 7fb9227fc700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb9180a2640 0x7fb9180a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.916+0000 7fb931007700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb9180a2640 0x7fb9180a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.916+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb91c0cf890 con 0x7fb92c076270 2024-03-31T23:16:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.917+0000 7fb931007700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb9180a2640 0x7fb9180a4b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb928011490 tx=0x7fb928009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:57.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:57.921+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb91c05e280 con 0x7fb92c076270 2024-03-31T23:16:58.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.133+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb9100058f0 con 0x7fb92c076270 2024-03-31T23:16:58.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.134+0000 7fb9227fc700 1 -- 172.21.15.42:0/3521983963 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb91c013070 con 0x7fb92c076270 2024-03-31T23:16:58.135 INFO:teuthology.orchestra.run.smithi042.stdout:141733920833 2024-03-31T23:16:58.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb9180a2640 msgr2=0x7fb9180a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb9180a2640 0x7fb9180a4b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb928011490 tx=0x7fb928009260 comp rx=0 tx=0).stop 2024-03-31T23:16:58.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 msgr2=0x7fb92c19f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 0x7fb92c19f610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb91c000c00 tx=0x7fb91c00b610 comp rx=0 tx=0).stop 2024-03-31T23:16:58.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 shutdown_connections 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb9180a2640 0x7fb9180a4b00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0749b0 0x7fb92c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb92c112ed0 0x7fb92c1a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 --2- 172.21.15.42:0/3521983963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb92c076270 0x7fb92c19f610 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 >> 172.21.15.42:0/3521983963 conn(0x7fb92c079370 msgr2=0x7fb92c111c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 shutdown_connections 2024-03-31T23:16:58.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.136+0000 7fb93326b700 1 -- 172.21.15.42:0/3521983963 wait complete. 2024-03-31T23:16:58.669 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:16:58.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 -- 172.21.15.42:0/505791353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c100830 msgr2=0x7f600c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 --2- 172.21.15.42:0/505791353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c100830 0x7f600c100cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009990 tx=0x7f5ffc009ca0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 -- 172.21.15.42:0/505791353 shutdown_connections 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 --2- 172.21.15.42:0/505791353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f600c1072b0 0x7f600c107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 --2- 172.21.15.42:0/505791353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f600c1011f0 0x7f600c10f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 --2- 172.21.15.42:0/505791353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c100830 0x7f600c100cb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 -- 172.21.15.42:0/505791353 >> 172.21.15.42:0/505791353 conn(0x7f600c077740 msgr2=0x7f600c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 -- 172.21.15.42:0/505791353 shutdown_connections 2024-03-31T23:16:58.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.683+0000 7f601386c700 1 -- 172.21.15.42:0/505791353 wait complete. 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 Processor -- start 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 -- start start 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f600c100830 0x7f600c19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 0x7f600c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f600c1072b0 0x7f600c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f600c112810 con 0x7f600c1011f0 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f600c112690 con 0x7f600c100830 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f601386c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f600c112990 con 0x7f600c1072b0 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 0x7f600c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6011608700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f600c100830 0x7f600c19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:58.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 0x7f600c19ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52160/0 (socket says 172.21.15.42:52160) 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 -- 172.21.15.42:0/1055319567 learned_addr learned my addr 172.21.15.42:0/1055319567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6011e09700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f600c1072b0 0x7f600c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 -- 172.21.15.42:0/1055319567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f600c1072b0 msgr2=0x7f600c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f600c1072b0 0x7f600c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 -- 172.21.15.42:0/1055319567 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f600c100830 msgr2=0x7f600c19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f600c100830 0x7f600c19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.684+0000 7f6010e07700 1 -- 172.21.15.42:0/1055319567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c199130 con 0x7f600c1011f0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.685+0000 7f6010e07700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 0x7f600c19ed50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000c00 tx=0x7f5ffc00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.685+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc027070 con 0x7f600c1011f0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.685+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c1993c0 con 0x7f600c1011f0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.685+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ffc022470 con 0x7f600c1011f0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.685+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c1a56e0 con 0x7f600c1011f0 2024-03-31T23:16:58.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.685+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc017630 con 0x7f600c1011f0 2024-03-31T23:16:58.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.686+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff0005330 con 0x7f600c1011f0 2024-03-31T23:16:58.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.688+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f5ffc02a070 con 0x7f600c1011f0 2024-03-31T23:16:58.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.689+0000 7f60027fc700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5ff80a2640 0x7f5ff80a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:58.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.689+0000 7f6011608700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5ff80a2640 0x7f5ff80a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:58.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.689+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5ffc0cfcf0 con 0x7f600c1011f0 2024-03-31T23:16:58.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.689+0000 7f6011608700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5ff80a2640 0x7f5ff80a4b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f600c199b10 tx=0x7f6008009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:58.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.693+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5ffc031020 con 0x7f600c1011f0 2024-03-31T23:16:58.756 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:58 smithi042 ceph-mon[32380]: pgmap v329: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 1 B/s, 0 objects/s recovering 2024-03-31T23:16:58.756 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:58 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3521983963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-31T23:16:58.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.899+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5ff00058f0 con 0x7f600c1011f0 2024-03-31T23:16:58.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.900+0000 7f60027fc700 1 -- 172.21.15.42:0/1055319567 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5ffc013070 con 0x7f600c1011f0 2024-03-31T23:16:58.901 INFO:teuthology.orchestra.run.smithi042.stdout:309237645346 2024-03-31T23:16:58.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5ff80a2640 msgr2=0x7f5ff80a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5ff80a2640 0x7f5ff80a4b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f600c199b10 tx=0x7f6008009260 comp rx=0 tx=0).stop 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 msgr2=0x7f600c19ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 0x7f600c19ed50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000c00 tx=0x7f5ffc00b610 comp rx=0 tx=0).stop 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 shutdown_connections 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5ff80a2640 0x7f5ff80a4b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f600c1072b0 0x7f600c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f600c100830 0x7f600c19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 --2- 172.21.15.42:0/1055319567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f600c1011f0 0x7f600c19ed50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 >> 172.21.15.42:0/1055319567 conn(0x7f600c077740 msgr2=0x7f600c105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 shutdown_connections 2024-03-31T23:16:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:58.902+0000 7f601386c700 1 -- 172.21.15.42:0/1055319567 wait complete. 2024-03-31T23:16:58.921 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:58 smithi094 ceph-mon[36167]: pgmap v329: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 1 B/s, 0 objects/s recovering 2024-03-31T23:16:58.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:58 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3521983963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-31T23:16:58.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:58 smithi188 ceph-mon[36068]: pgmap v329: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 1 B/s, 0 objects/s recovering 2024-03-31T23:16:58.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:58 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3521983963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-31T23:16:59.750 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:16:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1055319567' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-31T23:16:59.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 -- 172.21.15.42:0/85098307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0101140 msgr2=0x7ff4c01015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 --2- 172.21.15.42:0/85098307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0101140 0x7ff4c01015a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40098f0 tx=0x7ff4b4009c00 comp rx=0 tx=0).stop 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 -- 172.21.15.42:0/85098307 shutdown_connections 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 --2- 172.21.15.42:0/85098307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101ae0 0x7ff4c010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 --2- 172.21.15.42:0/85098307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0107180 0x7ff4c0107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 --2- 172.21.15.42:0/85098307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0101140 0x7ff4c01015a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 -- 172.21.15.42:0/85098307 >> 172.21.15.42:0/85098307 conn(0x7ff4c0078070 msgr2=0x7ff4c0078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 -- 172.21.15.42:0/85098307 shutdown_connections 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 -- 172.21.15.42:0/85098307 wait complete. 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 Processor -- start 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.854+0000 7ff4c8444700 1 -- start start 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c8444700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 0x7ff4c019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c8444700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0101ae0 0x7ff4c019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c8444700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0107180 0x7ff4c0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c8444700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0112650 con 0x7ff4c0101ae0 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c8444700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01124d0 con 0x7ff4c0101140 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c8444700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01127d0 con 0x7ff4c0107180 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 0x7ff4c019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c59df700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0101ae0 0x7ff4c019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 0x7ff4c019e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:49680/0 (socket says 172.21.15.42:49680) 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c59df700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0101ae0 0x7ff4c019ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52190/0 (socket says 172.21.15.42:52190) 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 -- 172.21.15.42:0/1838498688 learned_addr learned my addr 172.21.15.42:0/1838498688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c69e1700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0107180 0x7ff4c0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 -- 172.21.15.42:0/1838498688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0107180 msgr2=0x7ff4c0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0107180 0x7ff4c0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 -- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0101ae0 msgr2=0x7ff4c019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0101ae0 0x7ff4c019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 -- 172.21.15.42:0/1838498688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c0199190 con 0x7ff4c0101140 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.855+0000 7ff4c61e0700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 0x7ff4c019e820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009bd0 tx=0x7ff4bc009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.856+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00ba20 con 0x7ff4c0101140 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.856+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4bc004d30 con 0x7ff4c0101140 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.856+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c0199480 con 0x7ff4c0101140 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.856+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc019410 con 0x7ff4c0101140 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.856+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c010ecc0 con 0x7ff4c0101140 2024-03-31T23:16:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.856+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c0068f00 con 0x7ff4c0101140 2024-03-31T23:16:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.858+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7ff4bc004750 con 0x7ff4c0101140 2024-03-31T23:16:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.858+0000 7ff4b37fe700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff4ac0a25c0 0x7ff4ac0a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.858+0000 7ff4c59df700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff4ac0a25c0 0x7ff4ac0a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.858+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff4bc0d2ac0 con 0x7ff4c0101140 2024-03-31T23:16:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.859+0000 7ff4c59df700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff4ac0a25c0 0x7ff4ac0a4a80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009810 tx=0x7ff4b4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:59.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.866+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff4bc09f7c0 con 0x7ff4c0101140 2024-03-31T23:16:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:16:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1055319567' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-31T23:16:59.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 -- 172.21.15.42:0/3780910430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc1064b0 msgr2=0x7ffacc10e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 --2- 172.21.15.42:0/3780910430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc1064b0 0x7ffacc10e0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffac400b0d0 tx=0x7ffac400b3e0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 -- 172.21.15.42:0/3780910430 shutdown_connections 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 --2- 172.21.15.42:0/3780910430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc1064b0 0x7ffacc10e0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 --2- 172.21.15.42:0/3780910430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffacc101b00 0x7ffacc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 --2- 172.21.15.42:0/3780910430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 0x7ffacc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 -- 172.21.15.42:0/3780910430 >> 172.21.15.42:0/3780910430 conn(0x7ffacc077740 msgr2=0x7ffacc0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 -- 172.21.15.42:0/3780910430 shutdown_connections 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 -- 172.21.15.42:0/3780910430 wait complete. 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 Processor -- start 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.761+0000 7ffad2808700 1 -- start start 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad2808700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 0x7ffacc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad2808700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 0x7ffacc199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad2808700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffacc1064b0 0x7ffacc1a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad2808700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc111630 con 0x7ffacc101b00 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad2808700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1114b0 con 0x7ffacc1064b0 2024-03-31T23:16:59.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad2808700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1117b0 con 0x7ffacc1024b0 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 0x7ffacc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacb7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 0x7ffacc199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 0x7ffacc199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52164/0 (socket says 172.21.15.42:52164) 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 -- 172.21.15.42:0/679961600 learned_addr learned my addr 172.21.15.42:0/679961600 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffad0da5700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffacc1064b0 0x7ffacc1a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 -- 172.21.15.42:0/679961600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 msgr2=0x7ffacc199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 0x7ffacc199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 -- 172.21.15.42:0/679961600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffacc1064b0 msgr2=0x7ffacc1a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffacc1064b0 0x7ffacc1a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 -- 172.21.15.42:0/679961600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc1a4ed0 con 0x7ffacc101b00 2024-03-31T23:16:59.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacb7fe700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 0x7ffacc199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.762+0000 7ffacbfff700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 0x7ffacc199910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d980 tx=0x7ffabc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.763+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc016070 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.763+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc1a5100 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.763+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffabc004d30 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.763+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0056c0 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.763+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1a5690 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.764+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc068f00 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.765+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7ffabc004750 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.765+0000 7ffac97fa700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffab40a25c0 0x7ffab40a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.766+0000 7ffacb7fe700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffab40a25c0 0x7ffab40a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.766+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ffabc0cef40 con 0x7ffacc101b00 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.766+0000 7ffacb7fe700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffab40a25c0 0x7ffab40a4a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffacc1040e0 tx=0x7ffac0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:16:59.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.769+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ffabc01f020 con 0x7ffacc101b00 2024-03-31T23:16:59.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:16:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1055319567' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-31T23:16:59.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.980+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ffacc02db30 con 0x7ffacc101b00 2024-03-31T23:16:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.980+0000 7ffac97fa700 1 -- 172.21.15.42:0/679961600 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffabc09bbe0 con 0x7ffacc101b00 2024-03-31T23:16:59.981 INFO:teuthology.orchestra.run.smithi042.stdout:219043332147 2024-03-31T23:16:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffab40a25c0 msgr2=0x7ffab40a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffab40a25c0 0x7ffab40a4a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffacc1040e0 tx=0x7ffac0009260 comp rx=0 tx=0).stop 2024-03-31T23:16:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 msgr2=0x7ffacc199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:16:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 0x7ffacc199910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d980 tx=0x7ffabc00dc90 comp rx=0 tx=0).stop 2024-03-31T23:16:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 shutdown_connections 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffab40a25c0 0x7ffab40a4a80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffacc1064b0 0x7ffacc1a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffacc101b00 0x7ffacc199910 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 --2- 172.21.15.42:0/679961600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffacc1024b0 0x7ffacc199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.983+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 >> 172.21.15.42:0/679961600 conn(0x7ffacc077740 msgr2=0x7ffacc105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.984+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 shutdown_connections 2024-03-31T23:16:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:16:59.984+0000 7ffad2808700 1 -- 172.21.15.42:0/679961600 wait complete. 2024-03-31T23:17:00.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.087+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff4c002db30 con 0x7ff4c0101140 2024-03-31T23:17:00.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.088+0000 7ff4b37fe700 1 -- 172.21.15.42:0/1838498688 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff4bc09f0c0 con 0x7ff4c0101140 2024-03-31T23:17:00.089 INFO:teuthology.orchestra.run.smithi042.stdout:107374182470 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff4ac0a25c0 msgr2=0x7ff4ac0a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff4ac0a25c0 0x7ff4ac0a4a80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009810 tx=0x7ff4b4019040 comp rx=0 tx=0).stop 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 msgr2=0x7ff4c019e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 0x7ff4c019e820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009bd0 tx=0x7ff4bc009ee0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 shutdown_connections 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff4ac0a25c0 0x7ff4ac0a4a80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4c0107180 0x7ff4c0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4c0101140 0x7ff4c019e820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 --2- 172.21.15.42:0/1838498688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4c0101ae0 0x7ff4c019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 >> 172.21.15.42:0/1838498688 conn(0x7ff4c0078070 msgr2=0x7ff4c00ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 shutdown_connections 2024-03-31T23:17:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.090+0000 7ff4c8444700 1 -- 172.21.15.42:0/1838498688 wait complete. 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2987502183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 msgr2=0x7f6aa8108650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2987502183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8108650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40099c0 tx=0x7f6aa4009cd0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2987502183 shutdown_connections 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2987502183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102c50 0x7f6aa810f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2987502183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8108650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2987502183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6aa8102290 0x7f6aa8102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2987502183 >> 172.21.15.42:0/2987502183 conn(0x7f6aa8079370 msgr2=0x7f6aa8079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2987502183 shutdown_connections 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.230+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2987502183 wait complete. 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 Processor -- start 2024-03-31T23:17:00.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 -- start start 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102290 0x7f6aa8074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6aa8102c50 0x7f6aa8074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa8112610 con 0x7f6aa8108270 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa8112490 con 0x7f6aa8102290 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aafc4f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa8112790 con 0x7f6aa8102c50 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aae1ec700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aae1ec700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8074fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52214/0 (socket says 172.21.15.42:52214) 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aae1ec700 1 -- 172.21.15.42:0/2742903889 learned_addr learned my addr 172.21.15.42:0/2742903889 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102290 0x7f6aa8074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad1ea700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6aa8102c50 0x7f6aa8074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 -- 172.21.15.42:0/2742903889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6aa8102c50 msgr2=0x7f6aa8074a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6aa8102c50 0x7f6aa8074a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 -- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 msgr2=0x7f6aa8074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 -- 172.21.15.42:0/2742903889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa81a6f60 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aae1ec700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.231+0000 7f6aad9eb700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102290 0x7f6aa8074540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098e0 tx=0x7f6aa400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.232+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4027070 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.232+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa81a71f0 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.232+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6aa400be40 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.232+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4022db0 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.232+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa81a7640 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.232+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa8068f00 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.234+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f6aa402a070 con 0x7f6aa8102290 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.234+0000 7f6a9effd700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6a940a25c0 0x7f6a940a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.234+0000 7f6aad1ea700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6a940a25c0 0x7f6a940a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.234+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6aa40cf840 con 0x7f6aa8102290 2024-03-31T23:17:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.235+0000 7f6aad1ea700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6a940a25c0 0x7f6a940a4a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8079950 tx=0x7f6a98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.238+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6aa4013070 con 0x7f6aa8102290 2024-03-31T23:17:00.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.449+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6aa802dd90 con 0x7f6aa8102290 2024-03-31T23:17:00.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.450+0000 7f6a9effd700 1 -- 172.21.15.42:0/2742903889 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6aa40a2020 con 0x7f6aa8102290 2024-03-31T23:17:00.451 INFO:teuthology.orchestra.run.smithi042.stdout:343597383710 2024-03-31T23:17:00.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6a940a25c0 msgr2=0x7f6a940a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6a940a25c0 0x7f6a940a4a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8079950 tx=0x7f6a98009260 comp rx=0 tx=0).stop 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102290 msgr2=0x7f6aa8074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102290 0x7f6aa8074540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098e0 tx=0x7f6aa400f690 comp rx=0 tx=0).stop 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 shutdown_connections 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6a940a25c0 0x7f6a940a4a80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6aa8108270 0x7f6aa8074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6aa8102290 0x7f6aa8074540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 --2- 172.21.15.42:0/2742903889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6aa8102c50 0x7f6aa8074a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 >> 172.21.15.42:0/2742903889 conn(0x7f6aa8079370 msgr2=0x7f6aa8100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 shutdown_connections 2024-03-31T23:17:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:00.452+0000 7f6aafc4f700 1 -- 172.21.15.42:0/2742903889 wait complete. 2024-03-31T23:17:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:00 smithi042 ceph-mon[32380]: pgmap v330: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/679961600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-31T23:17:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1838498688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-31T23:17:00.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2742903889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-31T23:17:00.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:00 smithi094 ceph-mon[36167]: pgmap v330: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:00.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/679961600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-31T23:17:00.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1838498688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-31T23:17:00.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2742903889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-31T23:17:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:00 smithi188 ceph-mon[36068]: pgmap v330: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/679961600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-31T23:17:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1838498688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-31T23:17:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2742903889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.440+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/1524941404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102ed0 msgr2=0x7fb2b0106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.440+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/1524941404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102ed0 0x7fb2b0106e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00faf0 tx=0x7fb2ac00fe00 comp rx=0 tx=0).stop 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/1524941404 shutdown_connections 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/1524941404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2b0102520 0x7fb2b0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/1524941404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 0x7fb2b010f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/1524941404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102ed0 0x7fb2b0106e70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/1524941404 >> 172.21.15.42:0/1524941404 conn(0x7fb2b00792d0 msgr2=0x7fb2b00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/1524941404 shutdown_connections 2024-03-31T23:17:01.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.441+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/1524941404 wait complete. 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 Processor -- start 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 -- start start 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 0x7fb2b019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2b0102ed0 0x7fb2b019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 0x7fb2b01966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01104c0 con 0x7fb2b0102520 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0110340 con 0x7fb2b0107550 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b7a4c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0110640 con 0x7fb2b0102ed0 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b57e8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 0x7fb2b019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b57e8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 0x7fb2b019c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52234/0 (socket says 172.21.15.42:52234) 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b5fe9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 0x7fb2b01966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b57e8700 1 -- 172.21.15.42:0/257568601 learned_addr learned my addr 172.21.15.42:0/257568601 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b4fe7700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2b0102ed0 0x7fb2b019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b5fe9700 1 -- 172.21.15.42:0/257568601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2b0102ed0 msgr2=0x7fb2b019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b5fe9700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2b0102ed0 0x7fb2b019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b5fe9700 1 -- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 msgr2=0x7fb2b019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b5fe9700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 0x7fb2b019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b5fe9700 1 -- 172.21.15.42:0/257568601 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b0196fc0 con 0x7fb2b0107550 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.442+0000 7fb2b57e8700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 0x7fb2b019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.443+0000 7fb2b5fe9700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 0x7fb2b01966e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80042f0 tx=0x7fb2a8004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.443+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80093a0 con 0x7fb2b0107550 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.443+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2a8004db0 con 0x7fb2b0107550 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.443+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b01972b0 con 0x7fb2b0107550 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.443+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a801da80 con 0x7fb2b0107550 2024-03-31T23:17:01.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.443+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b01a3540 con 0x7fb2b0107550 2024-03-31T23:17:01.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.444+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b0103950 con 0x7fb2b0107550 2024-03-31T23:17:01.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.446+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fb2a8007cb0 con 0x7fb2b0107550 2024-03-31T23:17:01.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.446+0000 7fb2a67fc700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb29c0a2640 0x7fb29c0a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:01.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.446+0000 7fb2b57e8700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb29c0a2640 0x7fb29c0a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:01.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.446+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb2a80d6d70 con 0x7fb2b0107550 2024-03-31T23:17:01.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.447+0000 7fb2b57e8700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb29c0a2640 0x7fb29c0a4b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0011550 tx=0x7fb2a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:01.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.451+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb2a80a3b00 con 0x7fb2b0107550 2024-03-31T23:17:01.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.664+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb2b0197bc0 con 0x7fb2b0107550 2024-03-31T23:17:01.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.665+0000 7fb2a67fc700 1 -- 172.21.15.42:0/257568601 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb2a80a3400 con 0x7fb2b0107550 2024-03-31T23:17:01.666 INFO:teuthology.orchestra.run.smithi042.stdout:163208757309 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb29c0a2640 msgr2=0x7fb29c0a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb29c0a2640 0x7fb29c0a4b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0011550 tx=0x7fb2a0009260 comp rx=0 tx=0).stop 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 msgr2=0x7fb2b01966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 0x7fb2b01966e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80042f0 tx=0x7fb2a8004600 comp rx=0 tx=0).stop 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 shutdown_connections 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb29c0a2640 0x7fb29c0a4b00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2b0107550 0x7fb2b01966e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b0102520 0x7fb2b019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 --2- 172.21.15.42:0/257568601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2b0102ed0 0x7fb2b019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 >> 172.21.15.42:0/257568601 conn(0x7fb2b00792d0 msgr2=0x7fb2b0100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 shutdown_connections 2024-03-31T23:17:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:01.667+0000 7fb2b7a4c700 1 -- 172.21.15.42:0/257568601 wait complete. 2024-03-31T23:17:02.079 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645341 got 309237645346 for osd.10 2024-03-31T23:17:02.079 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:02.649 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:02 smithi042 ceph-mon[32380]: pgmap v331: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:02.649 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:02 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/257568601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-31T23:17:02.676 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182463 got 107374182470 for osd.3 2024-03-31T23:17:02.677 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:02 smithi094 ceph-mon[36167]: pgmap v331: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:02.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:02 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/257568601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-31T23:17:02.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:02 smithi188 ceph-mon[36068]: pgmap v331: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:02.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:02 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/257568601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-31T23:17:03.523 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757305 got 163208757309 for osd.5 2024-03-31T23:17:03.523 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:03.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 -- 172.21.15.42:0/1204905477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 msgr2=0x7f07b4105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:03.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 --2- 172.21.15.42:0/1204905477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4105d40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07a40099c0 tx=0x7f07a4009cd0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 -- 172.21.15.42:0/1204905477 shutdown_connections 2024-03-31T23:17:03.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 --2- 172.21.15.42:0/1204905477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 --2- 172.21.15.42:0/1204905477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07b4106420 0x7f07b410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 --2- 172.21.15.42:0/1204905477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4105d40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 -- 172.21.15.42:0/1204905477 >> 172.21.15.42:0/1204905477 conn(0x7f07b4077190 msgr2=0x7f07b40775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:03.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 -- 172.21.15.42:0/1204905477 shutdown_connections 2024-03-31T23:17:03.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.690+0000 7f07ba699700 1 -- 172.21.15.42:0/1204905477 wait complete. 2024-03-31T23:17:03.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.691+0000 7f07ba699700 1 Processor -- start 2024-03-31T23:17:03.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.691+0000 7f07ba699700 1 -- start start 2024-03-31T23:17:03.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.691+0000 7f07ba699700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b4199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.691+0000 7f07ba699700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.691+0000 7f07ba699700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07b4106420 0x7f07b41a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07ba699700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f07b41114f0 con 0x7f07b4101d80 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07ba699700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f07b4111370 con 0x7f07b4106420 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07ba699700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f07b4111670 con 0x7f07b41013d0 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b4199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37956/0 (socket says 172.21.15.42:37956) 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b4199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:49680/0 (socket says 172.21.15.42:49680) 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b37fe700 1 -- 172.21.15.42:0/1255570741 learned_addr learned my addr 172.21.15.42:0/1255570741 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b8c36700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07b4106420 0x7f07b41a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 -- 172.21.15.42:0/1255570741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07b4106420 msgr2=0x7f07b41a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07b4106420 0x7f07b41a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 -- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 msgr2=0x7f07b4199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 -- 172.21.15.42:0/1255570741 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b41a4f50 con 0x7f07b41013d0 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b37fe700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b3fff700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b4199990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f079c009be0 tx=0x7f079c009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c00ba80 con 0x7f07b41013d0 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f079c004d30 con 0x7f07b41013d0 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b4197780 con 0x7f07b41013d0 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.692+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c019410 con 0x7f07b41013d0 2024-03-31T23:17:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.693+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b4197c40 con 0x7f07b41013d0 2024-03-31T23:17:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.693+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b4068f00 con 0x7f07b41013d0 2024-03-31T23:17:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.695+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7f079c020020 con 0x7f07b41013d0 2024-03-31T23:17:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.695+0000 7f07b17fa700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f07a00a25c0 0x7f07a00a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.695+0000 7f07b37fe700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f07a00a25c0 0x7f07a00a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.695+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f079c0d2890 con 0x7f07b41013d0 2024-03-31T23:17:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.696+0000 7f07b37fe700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f07a00a25c0 0x7f07a00a4a80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07b41078f0 tx=0x7f07a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:03.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.699+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f079c027070 con 0x7f07b41013d0 2024-03-31T23:17:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.910+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f07b402db30 con 0x7f07b41013d0 2024-03-31T23:17:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.910+0000 7f07b17fa700 1 -- 172.21.15.42:0/1255570741 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f079c020310 con 0x7f07b41013d0 2024-03-31T23:17:03.911 INFO:teuthology.orchestra.run.smithi042.stdout:197568495672 2024-03-31T23:17:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.912+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f07a00a25c0 msgr2=0x7f07a00a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.912+0000 7f07ba699700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f07a00a25c0 0x7f07a00a4a80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07b41078f0 tx=0x7f07a4005fb0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.912+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 msgr2=0x7f07b4199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.912+0000 7f07ba699700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b4199990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f079c009be0 tx=0x7f079c009ef0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 shutdown_connections 2024-03-31T23:17:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f07a00a25c0 0x7f07a00a4a80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07b41013d0 0x7f07b4199990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07b4106420 0x7f07b41a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 --2- 172.21.15.42:0/1255570741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4101d80 0x7f07b4199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 >> 172.21.15.42:0/1255570741 conn(0x7f07b4077190 msgr2=0x7f07b40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 shutdown_connections 2024-03-31T23:17:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:03.913+0000 7f07ba699700 1 -- 172.21.15.42:0/1255570741 wait complete. 2024-03-31T23:17:04.246 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332142 got 219043332147 for osd.7 2024-03-31T23:17:04.246 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:04.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:04 smithi042 ceph-mon[32380]: pgmap v332: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:04.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:04 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1255570741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-31T23:17:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:04 smithi094 ceph-mon[36167]: pgmap v332: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:04.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:04 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1255570741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-31T23:17:04.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920829 got 141733920833 for osd.4 2024-03-31T23:17:04.961 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:04 smithi188 ceph-mon[36068]: pgmap v332: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:04.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:04 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1255570741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-31T23:17:06.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495667 got 197568495672 for osd.6 2024-03-31T23:17:06.437 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:06.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:06 smithi042 ceph-mon[32380]: pgmap v333: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:06.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:06.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:06 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:06 smithi094 ceph-mon[36167]: pgmap v333: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:06.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:06 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:06.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:06 smithi188 ceph-mon[36068]: pgmap v333: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:06.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:06.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:06 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:07.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 -- 172.21.15.42:0/3717421745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8108270 msgr2=0x7fefe8108650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:07.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 --2- 172.21.15.42:0/3717421745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8108270 0x7fefe8108650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009fc0 tx=0x7fefd800b330 comp rx=0 tx=0).stop 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 -- 172.21.15.42:0/3717421745 shutdown_connections 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 --2- 172.21.15.42:0/3717421745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefe8102c50 0x7fefe810f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 --2- 172.21.15.42:0/3717421745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8108270 0x7fefe8108650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 --2- 172.21.15.42:0/3717421745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe8102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 -- 172.21.15.42:0/3717421745 >> 172.21.15.42:0/3717421745 conn(0x7fefe8079370 msgr2=0x7fefe8079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 -- 172.21.15.42:0/3717421745 shutdown_connections 2024-03-31T23:17:07.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.749+0000 7fefed619700 1 -- 172.21.15.42:0/3717421745 wait complete. 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.750+0000 7fefed619700 1 Processor -- start 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.750+0000 7fefed619700 1 -- start start 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.750+0000 7fefed619700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.750+0000 7fefed619700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8102c50 0x7fefe819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.750+0000 7fefed619700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefe8108270 0x7fefe81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefed619700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8112630 con 0x7fefe8102290 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefed619700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81124b0 con 0x7fefe8102c50 2024-03-31T23:17:07.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefed619700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81127b0 con 0x7fefe8108270 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe819e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37966/0 (socket says 172.21.15.42:37966) 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 -- 172.21.15.42:0/115725975 learned_addr learned my addr 172.21.15.42:0/115725975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe77fe700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefe8108270 0x7fefe81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe67fc700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8102c50 0x7fefe819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 -- 172.21.15.42:0/115725975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefe8108270 msgr2=0x7fefe81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefe8108270 0x7fefe81987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 -- 172.21.15.42:0/115725975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8102c50 msgr2=0x7fefe819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:07.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8102c50 0x7fefe819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 -- 172.21.15.42:0/115725975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe8198fb0 con 0x7fefe8102290 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefe6ffd700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe819e650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fefd8004fd0 tx=0x7fefd800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8021070 con 0x7fefe8102290 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe8199240 con 0x7fefe8102290 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fefd801d450 con 0x7fefe8102290 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80052a0 con 0x7fefe8102290 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.751+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81a54b0 con 0x7fefe8102290 2024-03-31T23:17:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.752+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe8103920 con 0x7fefe8102290 2024-03-31T23:17:07.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.754+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fefd8024070 con 0x7fefe8102290 2024-03-31T23:17:07.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.755+0000 7fefdffff700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fefd40a25c0 0x7fefd40a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:07.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.755+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fefd800f020 con 0x7fefe8102290 2024-03-31T23:17:07.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.755+0000 7fefe67fc700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fefd40a25c0 0x7fefd40a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:07.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.755+0000 7fefe67fc700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fefd40a25c0 0x7fefd40a4a80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fefe8079950 tx=0x7fefd00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:07.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.758+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fefd802b020 con 0x7fefe8102290 2024-03-31T23:17:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.969+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fefe802db30 con 0x7fefe8102290 2024-03-31T23:17:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.970+0000 7fefdffff700 1 -- 172.21.15.42:0/115725975 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefd809d2f0 con 0x7fefe8102290 2024-03-31T23:17:07.971 INFO:teuthology.orchestra.run.smithi042.stdout:55834574930 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fefd40a25c0 msgr2=0x7fefd40a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fefd40a25c0 0x7fefd40a4a80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fefe8079950 tx=0x7fefd00073d0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 msgr2=0x7fefe819e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe819e650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fefd8004fd0 tx=0x7fefd800bca0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 shutdown_connections 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fefd40a25c0 0x7fefd40a4a80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefe8108270 0x7fefe81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8102290 0x7fefe819e650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 --2- 172.21.15.42:0/115725975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefe8102c50 0x7fefe819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 >> 172.21.15.42:0/115725975 conn(0x7fefe8079370 msgr2=0x7fefe8100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 shutdown_connections 2024-03-31T23:17:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:07.972+0000 7fefed619700 1 -- 172.21.15.42:0/115725975 wait complete. 2024-03-31T23:17:08.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:08 smithi042 ceph-mon[32380]: pgmap v334: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:08 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:17:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:08 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:17:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:08 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:08 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/115725975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-31T23:17:08.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:08 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/29778745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-31T23:17:08.828 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383704 got 343597383710 for osd.11 2024-03-31T23:17:08.828 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 -- 172.21.15.42:0/3168653952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc1011e0 msgr2=0x7fe0dc101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/3168653952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc101660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009990 tx=0x7fe0c8009ca0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 -- 172.21.15.42:0/3168653952 shutdown_connections 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/3168653952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc10e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/3168653952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc103130 0x7fe0dc103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/3168653952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc101660 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.105+0000 7fe0e2d52700 1 -- 172.21.15.42:0/3168653952 >> 172.21.15.42:0/3168653952 conn(0x7fe0dc077190 msgr2=0x7fe0dc0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 -- 172.21.15.42:0/3168653952 shutdown_connections 2024-03-31T23:17:08.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 -- 172.21.15.42:0/3168653952 wait complete. 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 Processor -- start 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 -- start start 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc103130 0x7fe0dc1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1116b0 con 0x7fe0dc101ba0 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111530 con 0x7fe0dc1011e0 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e2d52700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111830 con 0x7fe0dc103130 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e0aee700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0dbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0e0aee700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:38594/0 (socket says 172.21.15.42:38594) 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 -- 172.21.15.42:0/29778745 learned_addr learned my addr 172.21.15.42:0/29778745 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.106+0000 7fe0dbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc19dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37984/0 (socket says 172.21.15.42:37984) 2024-03-31T23:17:08.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e12ef700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc103130 0x7fe0dc1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 -- 172.21.15.42:0/29778745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc103130 msgr2=0x7fe0dc1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc103130 0x7fe0dc1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 -- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 msgr2=0x7fe0dc19dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc19dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 -- 172.21.15.42:0/29778745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc198050 con 0x7fe0dc1011e0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e12ef700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc103130 0x7fe0dc1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0dbfff700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc19dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e0aee700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc19d730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000eab0 tx=0x7fe0d000edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d001c070 con 0x7fe0dc1011e0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0d0017410 con 0x7fe0dc1011e0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc198340 con 0x7fe0dc1011e0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0016610 con 0x7fe0dc1011e0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.107+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc06a9e0 con 0x7fe0dc1011e0 2024-03-31T23:17:08.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.108+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc068f00 con 0x7fe0dc1011e0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.109+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) ==== 137371+0+0 (secure 0 0 0) 0x7fe0d001f070 con 0x7fe0dc1011e0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.110+0000 7fe0d9ffb700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe0cc0a25c0 0x7fe0cc0a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.110+0000 7fe0dbfff700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe0cc0a25c0 0x7fe0cc0a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.110+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe0d00cff40 con 0x7fe0dc1011e0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.110+0000 7fe0dbfff700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe0cc0a25c0 0x7fe0cc0a4a80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800b2e0 tx=0x7fe0c801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.113+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe0d009cc40 con 0x7fe0dc1011e0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.319+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe0dc06b470 con 0x7fe0dc1011e0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.320+0000 7fe0d9ffb700 1 -- 172.21.15.42:0/29778745 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0d009c540 con 0x7fe0dc1011e0 2024-03-31T23:17:08.922 INFO:teuthology.orchestra.run.smithi042.stdout:34359738454 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe0cc0a25c0 msgr2=0x7fe0cc0a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe0cc0a25c0 0x7fe0cc0a4a80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800b2e0 tx=0x7fe0c801a040 comp rx=0 tx=0).stop 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 msgr2=0x7fe0dc19d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc19d730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000eab0 tx=0x7fe0d000edc0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 shutdown_connections 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe0cc0a25c0 0x7fe0cc0a4a80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc103130 0x7fe0dc1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0dc1011e0 0x7fe0dc19d730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 --2- 172.21.15.42:0/29778745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0dc101ba0 0x7fe0dc19dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 >> 172.21.15.42:0/29778745 conn(0x7fe0dc077190 msgr2=0x7fe0dc0fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 shutdown_connections 2024-03-31T23:17:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:08.322+0000 7fe0e2d52700 1 -- 172.21.15.42:0/29778745 wait complete. 2024-03-31T23:17:08.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:08 smithi094 ceph-mon[36167]: pgmap v334: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:08.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:08 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:17:08.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:08 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:17:08.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:08 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:08.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:08 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/115725975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-31T23:17:08.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:08 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/29778745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-31T23:17:08.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:08 smithi188 ceph-mon[36068]: pgmap v334: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:08.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:08 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:17:08.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:08 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:17:08.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:08 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' 2024-03-31T23:17:08.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:08 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/115725975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-31T23:17:08.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:08 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/29778745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-31T23:17:09.532 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738454 for osd.0 2024-03-31T23:17:09.532 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:10.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574924 got 55834574930 for osd.1 2024-03-31T23:17:10.011 DEBUG:teuthology.parallel:result is None 2024-03-31T23:17:10.011 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-31T23:17:10.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-31T23:17:10.265 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:10.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:10 smithi042 ceph-mon[32380]: pgmap v335: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:10.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:10 smithi094 ceph-mon[36167]: pgmap v335: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:10.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:10 smithi188 ceph-mon[36068]: pgmap v335: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:12.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 -- 172.21.15.42:0/1539924265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101140 msgr2=0x7f12481015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:12.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1539924265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101140 0x7f12481015a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1238009990 tx=0x7f1238009ca0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 -- 172.21.15.42:0/1539924265 shutdown_connections 2024-03-31T23:17:12.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1539924265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101ae0 0x7f124810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1539924265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1248107180 0x7f1248107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1539924265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101140 0x7f12481015a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 -- 172.21.15.42:0/1539924265 >> 172.21.15.42:0/1539924265 conn(0x7f1248078070 msgr2=0x7f1248078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 -- 172.21.15.42:0/1539924265 shutdown_connections 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.011+0000 7f124d7b2700 1 -- 172.21.15.42:0/1539924265 wait complete. 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.012+0000 7f124d7b2700 1 Processor -- start 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.012+0000 7f124d7b2700 1 -- start start 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.012+0000 7f124d7b2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101140 0x7f1248199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.012+0000 7f124d7b2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 0x7f1248199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.012+0000 7f124d7b2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1248107180 0x7f12481a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f124d7b2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1248111520 con 0x7f1248101ae0 2024-03-31T23:17:12.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f124d7b2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12481113a0 con 0x7f1248107180 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f124d7b2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12481116a0 con 0x7f1248101140 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f12467fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 0x7f1248199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101140 0x7f1248199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f12467fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 0x7f1248199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38002/0 (socket says 172.21.15.42:38002) 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f12467fc700 1 -- 172.21.15.42:0/1884723558 learned_addr learned my addr 172.21.15.42:0/1884723558 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f12477fe700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1248107180 0x7f12481a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 -- 172.21.15.42:0/1884723558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1248107180 msgr2=0x7f12481a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1248107180 0x7f12481a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 -- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 msgr2=0x7f1248199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 0x7f1248199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 -- 172.21.15.42:0/1884723558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12481a4ec0 con 0x7f1248101140 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f12467fc700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 0x7f1248199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f1246ffd700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101140 0x7f1248199900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f123000e9f0 tx=0x7f123000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:12.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123000c9c0 con 0x7f1248101140 2024-03-31T23:17:12.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f123000cb60 con 0x7f1248101140 2024-03-31T23:17:12.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12481a50f0 con 0x7f1248101140 2024-03-31T23:17:12.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.013+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230018680 con 0x7f1248101140 2024-03-31T23:17:12.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.014+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12481a5600 con 0x7f1248101140 2024-03-31T23:17:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.014+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1248068f00 con 0x7f1248101140 2024-03-31T23:17:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.016+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f1230010430 con 0x7f1248101140 2024-03-31T23:17:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.016+0000 7f123ffff700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f12340a2530 0x7f12340a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.016+0000 7f12467fc700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f12340a2530 0x7f12340a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.016+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f12300cf0c0 con 0x7f1248101140 2024-03-31T23:17:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.017+0000 7f12467fc700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f12340a2530 0x7f12340a49f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1248078650 tx=0x7f123801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.020+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f123009bec0 con 0x7f1248101140 2024-03-31T23:17:12.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.219+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1248062680 con 0x7f12340a2530 2024-03-31T23:17:12.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.229+0000 7f123ffff700 1 -- 172.21.15.42:0/1884723558 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340701 (secure 0 0 0) 0x7f1248062680 con 0x7f12340a2530 2024-03-31T23:17:12.234 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.232+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f12340a2530 msgr2=0x7f12340a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.232+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f12340a2530 0x7f12340a49f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1248078650 tx=0x7f123801a040 comp rx=0 tx=0).stop 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.232+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101140 msgr2=0x7f1248199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.232+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101140 0x7f1248199900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f123000e9f0 tx=0x7f123000ed00 comp rx=0 tx=0).stop 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 shutdown_connections 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f12340a2530 0x7f12340a49f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1248101140 0x7f1248199900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1248107180 0x7f12481a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 --2- 172.21.15.42:0/1884723558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1248101ae0 0x7f1248199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 >> 172.21.15.42:0/1884723558 conn(0x7f1248078070 msgr2=0x7f12480ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 shutdown_connections 2024-03-31T23:17:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:12.233+0000 7f124d7b2700 1 -- 172.21.15.42:0/1884723558 wait complete. 2024-03-31T23:17:12.238 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:17:12.650 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:12 smithi042 ceph-mon[32380]: pgmap v336: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:12.650 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:12 smithi042 ceph-mon[32380]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-31T23:17:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:12 smithi094 ceph-mon[36167]: pgmap v336: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:12.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:12 smithi094 ceph-mon[36167]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-31T23:17:12.968 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-03-31T23:17:10.787281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661553,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":839,"num_read_kb":547,"num_write":426,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361532,"kb_used_data":12296,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580292,"statfs":{"total":1151940427776,"available":1151570219008,"internally_reserved":0,"allocated":12591104,"data_stored":7970369,"data_compressed":359754,"data_compressed_allocated":491520,"data_compressed_original":2482176,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003160"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477929+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:16:42.477929+0000","last_peered":"2024-03-31T23:16:42.477929+0000","last_clean":"2024-03-31T23:16:42.477929+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:16:42.477929+0000","last_undegraded":"2024-03-31T23:16:42.477929+0000","last_fullsized":"2024-03-31T23:16:42.477929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478858+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:16:42.478858+0000","last_peered":"2024-03-31T23:16:42.478858+0000","last_clean":"2024-03-31T23:16:42.478858+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:16:42.478858+0000","last_undegraded":"2024-03-31T23:16:42.478858+0000","last_fullsized":"2024-03-31T23:16:42.478858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478245+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:16:42.478245+0000","last_peered":"2024-03-31T23:16:42.478245+0000","last_clean":"2024-03-31T23:16:42.478245+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:16:42.478245+0000","last_undegraded":"2024-03-31T23:16:42.478245+0000","last_fullsized":"2024-03-31T23:16:42.478245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473871+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:16:42.473871+0000","last_peered":"2024-03-31T23:16:42.473871+0000","last_clean":"2024-03-31T23:16:42.473871+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:16:42.473871+0000","last_undegraded":"2024-03-31T23:16:42.473871+0000","last_fullsized":"2024-03-31T23:16:42.473871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475586+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:16:42.475586+0000","last_peered":"2024-03-31T23:16:42.475586+0000","last_clean":"2024-03-31T23:16:42.475586+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:16:42.475586+0000","last_undegraded":"2024-03-31T23:16:42.475586+0000","last_fullsized":"2024-03-31T23:16:42.475586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476926+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:16:42.476926+0000","last_peered":"2024-03-31T23:16:42.476926+0000","last_clean":"2024-03-31T23:16:42.476926+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:16:42.476926+0000","last_undegraded":"2024-03-31T23:16:42.476926+0000","last_fullsized":"2024-03-31T23:16:42.476926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518305+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:16:42.518305+0000","last_peered":"2024-03-31T23:16:42.518305+0000","last_clean":"2024-03-31T23:16:42.518305+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:16:42.518305+0000","last_undegraded":"2024-03-31T23:16:42.518305+0000","last_fullsized":"2024-03-31T23:16:42.518305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481938+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:16:42.481938+0000","last_peered":"2024-03-31T23:16:42.481938+0000","last_clean":"2024-03-31T23:16:42.481938+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:16:42.481938+0000","last_undegraded":"2024-03-31T23:16:42.481938+0000","last_fullsized":"2024-03-31T23:16:42.481938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518962+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:16:42.518962+0000","last_peered":"2024-03-31T23:16:42.518962+0000","last_clean":"2024-03-31T23:16:42.518962+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:16:42.518962+0000","last_undegraded":"2024-03-31T23:16:42.518962+0000","last_fullsized":"2024-03-31T23:16:42.518962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477468+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:16:42.477468+0000","last_peered":"2024-03-31T23:16:42.477468+0000","last_clean":"2024-03-31T23:16:42.477468+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:16:42.477468+0000","last_undegraded":"2024-03-31T23:16:42.477468+0000","last_fullsized":"2024-03-31T23:16:42.477468+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.519264+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:16:42.519264+0000","last_peered":"2024-03-31T23:16:42.519264+0000","last_clean":"2024-03-31T23:16:42.519264+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:16:42.519264+0000","last_undegraded":"2024-03-31T23:16:42.519264+0000","last_fullsized":"2024-03-31T23:16:42.519264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474057+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:16:42.474057+0000","last_peered":"2024-03-31T23:16:42.474057+0000","last_clean":"2024-03-31T23:16:42.474057+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:16:42.474057+0000","last_undegraded":"2024-03-31T23:16:42.474057+0000","last_fullsized":"2024-03-31T23:16:42.474057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476081+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:16:42.476081+0000","last_peered":"2024-03-31T23:16:42.476081+0000","last_clean":"2024-03-31T23:16:42.476081+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:16:42.476081+0000","last_undegraded":"2024-03-31T23:16:42.476081+0000","last_fullsized":"2024-03-31T23:16:42.476081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477943+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:16:42.477943+0000","last_peered":"2024-03-31T23:16:42.477943+0000","last_clean":"2024-03-31T23:16:42.477943+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:16:42.477943+0000","last_undegraded":"2024-03-31T23:16:42.477943+0000","last_fullsized":"2024-03-31T23:16:42.477943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478267+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:16:42.478267+0000","last_peered":"2024-03-31T23:16:42.478267+0000","last_clean":"2024-03-31T23:16:42.478267+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:16:42.478267+0000","last_undegraded":"2024-03-31T23:16:42.478267+0000","last_fullsized":"2024-03-31T23:16:42.478267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518926+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:16:42.518926+0000","last_peered":"2024-03-31T23:16:42.518926+0000","last_clean":"2024-03-31T23:16:42.518926+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:16:42.518926+0000","last_undegraded":"2024-03-31T23:16:42.518926+0000","last_fullsized":"2024-03-31T23:16:42.518926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477838+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:16:42.477838+0000","last_peered":"2024-03-31T23:16:42.477838+0000","last_clean":"2024-03-31T23:16:42.477838+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:16:42.477838+0000","last_undegraded":"2024-03-31T23:16:42.477838+0000","last_fullsized":"2024-03-31T23:16:42.477838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474634+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:16:42.474634+0000","last_peered":"2024-03-31T23:16:42.474634+0000","last_clean":"2024-03-31T23:16:42.474634+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:16:42.474634+0000","last_undegraded":"2024-03-31T23:16:42.474634+0000","last_fullsized":"2024-03-31T23:16:42.474634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474285+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:16:42.474285+0000","last_peered":"2024-03-31T23:16:42.474285+0000","last_clean":"2024-03-31T23:16:42.474285+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:16:42.474285+0000","last_undegraded":"2024-03-31T23:16:42.474285+0000","last_fullsized":"2024-03-31T23:16:42.474285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473962+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:16:42.473962+0000","last_peered":"2024-03-31T23:16:42.473962+0000","last_clean":"2024-03-31T23:16:42.473962+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:16:42.473962+0000","last_undegraded":"2024-03-31T23:16:42.473962+0000","last_fullsized":"2024-03-31T23:16:42.473962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:07.332491+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:17:07.332491+0000","last_peered":"2024-03-31T23:17:07.332491+0000","last_clean":"2024-03-31T23:17:07.332491+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:17:07.332491+0000","last_undegraded":"2024-03-31T23:17:07.332491+0000","last_fullsized":"2024-03-31T23:17:07.332491+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482553+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:16:42.482553+0000","last_peered":"2024-03-31T23:16:42.482553+0000","last_clean":"2024-03-31T23:16:42.482553+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:16:42.482553+0000","last_undegraded":"2024-03-31T23:16:42.482553+0000","last_fullsized":"2024-03-31T23:16:42.482553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473517+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:16:42.473517+0000","last_peered":"2024-03-31T23:16:42.473517+0000","last_clean":"2024-03-31T23:16:42.473517+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:16:42.473517+0000","last_undegraded":"2024-03-31T23:16:42.473517+0000","last_fullsized":"2024-03-31T23:16:42.473517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482614+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:16:42.482614+0000","last_peered":"2024-03-31T23:16:42.482614+0000","last_clean":"2024-03-31T23:16:42.482614+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:16:42.482614+0000","last_undegraded":"2024-03-31T23:16:42.482614+0000","last_fullsized":"2024-03-31T23:16:42.482614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478247+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:16:42.478247+0000","last_peered":"2024-03-31T23:16:42.478247+0000","last_clean":"2024-03-31T23:16:42.478247+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:16:42.478247+0000","last_undegraded":"2024-03-31T23:16:42.478247+0000","last_fullsized":"2024-03-31T23:16:42.478247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473697+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:16:42.473697+0000","last_peered":"2024-03-31T23:16:42.473697+0000","last_clean":"2024-03-31T23:16:42.473697+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:16:42.473697+0000","last_undegraded":"2024-03-31T23:16:42.473697+0000","last_fullsized":"2024-03-31T23:16:42.473697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476407+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:16:42.476407+0000","last_peered":"2024-03-31T23:16:42.476407+0000","last_clean":"2024-03-31T23:16:42.476407+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:16:42.476407+0000","last_undegraded":"2024-03-31T23:16:42.476407+0000","last_fullsized":"2024-03-31T23:16:42.476407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518603+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:16:42.518603+0000","last_peered":"2024-03-31T23:16:42.518603+0000","last_clean":"2024-03-31T23:16:42.518603+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:16:42.518603+0000","last_undegraded":"2024-03-31T23:16:42.518603+0000","last_fullsized":"2024-03-31T23:16:42.518603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473627+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:16:42.473627+0000","last_peered":"2024-03-31T23:16:42.473627+0000","last_clean":"2024-03-31T23:16:42.473627+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:16:42.473627+0000","last_undegraded":"2024-03-31T23:16:42.473627+0000","last_fullsized":"2024-03-31T23:16:42.473627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476675+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:16:42.476675+0000","last_peered":"2024-03-31T23:16:42.476675+0000","last_clean":"2024-03-31T23:16:42.476675+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:16:42.476675+0000","last_undegraded":"2024-03-31T23:16:42.476675+0000","last_fullsized":"2024-03-31T23:16:42.476675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481062+0000","last_change":"2024-03-31T23:15:33.842873+0000","last_active":"2024-03-31T23:16:42.481062+0000","last_peered":"2024-03-31T23:16:42.481062+0000","last_clean":"2024-03-31T23:16:42.481062+0000","last_became_active":"2024-03-31T23:15:33.842575+0000","last_became_peered":"2024-03-31T23:15:33.842575+0000","last_unstale":"2024-03-31T23:16:42.481062+0000","last_undegraded":"2024-03-31T23:16:42.481062+0000","last_fullsized":"2024-03-31T23:16:42.481062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:23:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474127+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:16:42.474127+0000","last_peered":"2024-03-31T23:16:42.474127+0000","last_clean":"2024-03-31T23:16:42.474127+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:16:42.474127+0000","last_undegraded":"2024-03-31T23:16:42.474127+0000","last_fullsized":"2024-03-31T23:16:42.474127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:06.328968+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:17:06.328968+0000","last_peered":"2024-03-31T23:17:06.328968+0000","last_clean":"2024-03-31T23:17:06.328968+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:17:06.328968+0000","last_undegraded":"2024-03-31T23:17:06.328968+0000","last_fullsized":"2024-03-31T23:17:06.328968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476298+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:16:42.476298+0000","last_peered":"2024-03-31T23:16:42.476298+0000","last_clean":"2024-03-31T23:16:42.476298+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:16:42.476298+0000","last_undegraded":"2024-03-31T23:16:42.476298+0000","last_fullsized":"2024-03-31T23:16:42.476298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474011+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:16:42.474011+0000","last_peered":"2024-03-31T23:16:42.474011+0000","last_clean":"2024-03-31T23:16:42.474011+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:16:42.474011+0000","last_undegraded":"2024-03-31T23:16:42.474011+0000","last_fullsized":"2024-03-31T23:16:42.474011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476814+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:16:42.476814+0000","last_peered":"2024-03-31T23:16:42.476814+0000","last_clean":"2024-03-31T23:16:42.476814+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:16:42.476814+0000","last_undegraded":"2024-03-31T23:16:42.476814+0000","last_fullsized":"2024-03-31T23:16:42.476814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480814+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:16:42.480814+0000","last_peered":"2024-03-31T23:16:42.480814+0000","last_clean":"2024-03-31T23:16:42.480814+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:16:42.480814+0000","last_undegraded":"2024-03-31T23:16:42.480814+0000","last_fullsized":"2024-03-31T23:16:42.480814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482887+0000","last_change":"2024-03-31T23:16:42.482887+0000","last_active":"2024-03-31T23:16:42.482887+0000","last_peered":"2024-03-31T23:16:42.482887+0000","last_clean":"2024-03-31T23:16:42.482887+0000","last_became_active":"2024-03-31T23:16:42.482434+0000","last_became_peered":"2024-03-31T23:16:42.482434+0000","last_unstale":"2024-03-31T23:16:42.482887+0000","last_undegraded":"2024-03-31T23:16:42.482887+0000","last_fullsized":"2024-03-31T23:16:42.482887+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:17.721985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476279+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:16:42.476279+0000","last_peered":"2024-03-31T23:16:42.476279+0000","last_clean":"2024-03-31T23:16:42.476279+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:16:42.476279+0000","last_undegraded":"2024-03-31T23:16:42.476279+0000","last_fullsized":"2024-03-31T23:16:42.476279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481791+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:16:42.481791+0000","last_peered":"2024-03-31T23:16:42.481791+0000","last_clean":"2024-03-31T23:16:42.481791+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:16:42.481791+0000","last_undegraded":"2024-03-31T23:16:42.481791+0000","last_fullsized":"2024-03-31T23:16:42.481791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478793+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:16:42.478793+0000","last_peered":"2024-03-31T23:16:42.478793+0000","last_clean":"2024-03-31T23:16:42.478793+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:16:42.478793+0000","last_undegraded":"2024-03-31T23:16:42.478793+0000","last_fullsized":"2024-03-31T23:16:42.478793+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480194+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:16:42.480194+0000","last_peered":"2024-03-31T23:16:42.480194+0000","last_clean":"2024-03-31T23:16:42.480194+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:16:42.480194+0000","last_undegraded":"2024-03-31T23:16:42.480194+0000","last_fullsized":"2024-03-31T23:16:42.480194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473662+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:16:42.473662+0000","last_peered":"2024-03-31T23:16:42.473662+0000","last_clean":"2024-03-31T23:16:42.473662+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:16:42.473662+0000","last_undegraded":"2024-03-31T23:16:42.473662+0000","last_fullsized":"2024-03-31T23:16:42.473662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481935+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:16:42.481935+0000","last_peered":"2024-03-31T23:16:42.481935+0000","last_clean":"2024-03-31T23:16:42.481935+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:16:42.481935+0000","last_undegraded":"2024-03-31T23:16:42.481935+0000","last_fullsized":"2024-03-31T23:16:42.481935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:08.330324+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:17:08.330324+0000","last_peered":"2024-03-31T23:17:08.330324+0000","last_clean":"2024-03-31T23:17:08.330324+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:17:08.330324+0000","last_undegraded":"2024-03-31T23:17:08.330324+0000","last_fullsized":"2024-03-31T23:17:08.330324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518885+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:16:42.518885+0000","last_peered":"2024-03-31T23:16:42.518885+0000","last_clean":"2024-03-31T23:16:42.518885+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:16:42.518885+0000","last_undegraded":"2024-03-31T23:16:42.518885+0000","last_fullsized":"2024-03-31T23:16:42.518885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473479+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:16:42.473479+0000","last_peered":"2024-03-31T23:16:42.473479+0000","last_clean":"2024-03-31T23:16:42.473479+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:16:42.473479+0000","last_undegraded":"2024-03-31T23:16:42.473479+0000","last_fullsized":"2024-03-31T23:16:42.473479+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.519220+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:16:42.519220+0000","last_peered":"2024-03-31T23:16:42.519220+0000","last_clean":"2024-03-31T23:16:42.519220+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:16:42.519220+0000","last_undegraded":"2024-03-31T23:16:42.519220+0000","last_fullsized":"2024-03-31T23:16:42.519220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478809+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:16:42.478809+0000","last_peered":"2024-03-31T23:16:42.478809+0000","last_clean":"2024-03-31T23:16:42.478809+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:16:42.478809+0000","last_undegraded":"2024-03-31T23:16:42.478809+0000","last_fullsized":"2024-03-31T23:16:42.478809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474193+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:16:42.474193+0000","last_peered":"2024-03-31T23:16:42.474193+0000","last_clean":"2024-03-31T23:16:42.474193+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:16:42.474193+0000","last_undegraded":"2024-03-31T23:16:42.474193+0000","last_fullsized":"2024-03-31T23:16:42.474193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480938+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:16:42.480938+0000","last_peered":"2024-03-31T23:16:42.480938+0000","last_clean":"2024-03-31T23:16:42.480938+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:16:42.480938+0000","last_undegraded":"2024-03-31T23:16:42.480938+0000","last_fullsized":"2024-03-31T23:16:42.480938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518704+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:16:42.518704+0000","last_peered":"2024-03-31T23:16:42.518704+0000","last_clean":"2024-03-31T23:16:42.518704+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:16:42.518704+0000","last_undegraded":"2024-03-31T23:16:42.518704+0000","last_fullsized":"2024-03-31T23:16:42.518704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473546+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:16:42.473546+0000","last_peered":"2024-03-31T23:16:42.473546+0000","last_clean":"2024-03-31T23:16:42.473546+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:16:42.473546+0000","last_undegraded":"2024-03-31T23:16:42.473546+0000","last_fullsized":"2024-03-31T23:16:42.473546+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'35","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:08.330372+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:17:08.330372+0000","last_peered":"2024-03-31T23:17:08.330372+0000","last_clean":"2024-03-31T23:17:08.330372+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:17:08.330372+0000","last_undegraded":"2024-03-31T23:17:08.330372+0000","last_fullsized":"2024-03-31T23:17:08.330372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":37,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476163+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:16:42.476163+0000","last_peered":"2024-03-31T23:16:42.476163+0000","last_clean":"2024-03-31T23:16:42.476163+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:16:42.476163+0000","last_undegraded":"2024-03-31T23:16:42.476163+0000","last_fullsized":"2024-03-31T23:16:42.476163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481225+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:16:42.481225+0000","last_peered":"2024-03-31T23:16:42.481225+0000","last_clean":"2024-03-31T23:16:42.481225+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:16:42.481225+0000","last_undegraded":"2024-03-31T23:16:42.481225+0000","last_fullsized":"2024-03-31T23:16:42.481225+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473915+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:16:42.473915+0000","last_peered":"2024-03-31T23:16:42.473915+0000","last_clean":"2024-03-31T23:16:42.473915+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:16:42.473915+0000","last_undegraded":"2024-03-31T23:16:42.473915+0000","last_fullsized":"2024-03-31T23:16:42.473915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477391+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:16:42.477391+0000","last_peered":"2024-03-31T23:16:42.477391+0000","last_clean":"2024-03-31T23:16:42.477391+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:16:42.477391+0000","last_undegraded":"2024-03-31T23:16:42.477391+0000","last_fullsized":"2024-03-31T23:16:42.477391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477544+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:16:42.477544+0000","last_peered":"2024-03-31T23:16:42.477544+0000","last_clean":"2024-03-31T23:16:42.477544+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:16:42.477544+0000","last_undegraded":"2024-03-31T23:16:42.477544+0000","last_fullsized":"2024-03-31T23:16:42.477544+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480884+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:16:42.480884+0000","last_peered":"2024-03-31T23:16:42.480884+0000","last_clean":"2024-03-31T23:16:42.480884+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:16:42.480884+0000","last_undegraded":"2024-03-31T23:16:42.480884+0000","last_fullsized":"2024-03-31T23:16:42.480884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518682+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:16:42.518682+0000","last_peered":"2024-03-31T23:16:42.518682+0000","last_clean":"2024-03-31T23:16:42.518682+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:16:42.518682+0000","last_undegraded":"2024-03-31T23:16:42.518682+0000","last_fullsized":"2024-03-31T23:16:42.518682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474168+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:16:42.474168+0000","last_peered":"2024-03-31T23:16:42.474168+0000","last_clean":"2024-03-31T23:16:42.474168+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:16:42.474168+0000","last_undegraded":"2024-03-31T23:16:42.474168+0000","last_fullsized":"2024-03-31T23:16:42.474168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:06.331887+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:17:06.331887+0000","last_peered":"2024-03-31T23:17:06.331887+0000","last_clean":"2024-03-31T23:17:06.331887+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:17:06.331887+0000","last_undegraded":"2024-03-31T23:17:06.331887+0000","last_fullsized":"2024-03-31T23:17:06.331887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518318+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:16:42.518318+0000","last_peered":"2024-03-31T23:16:42.518318+0000","last_clean":"2024-03-31T23:16:42.518318+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:16:42.518318+0000","last_undegraded":"2024-03-31T23:16:42.518318+0000","last_fullsized":"2024-03-31T23:16:42.518318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476530+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:16:42.476530+0000","last_peered":"2024-03-31T23:16:42.476530+0000","last_clean":"2024-03-31T23:16:42.476530+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:16:42.476530+0000","last_undegraded":"2024-03-31T23:16:42.476530+0000","last_fullsized":"2024-03-31T23:16:42.476530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475428+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:16:42.475428+0000","last_peered":"2024-03-31T23:16:42.475428+0000","last_clean":"2024-03-31T23:16:42.475428+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:16:42.475428+0000","last_undegraded":"2024-03-31T23:16:42.475428+0000","last_fullsized":"2024-03-31T23:16:42.475428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.520776+0000","last_change":"2024-03-31T23:16:42.520338+0000","last_active":"2024-03-31T23:16:42.520776+0000","last_peered":"2024-03-31T23:16:42.520776+0000","last_clean":"2024-03-31T23:16:42.520776+0000","last_became_active":"2024-03-31T23:16:42.519941+0000","last_became_peered":"2024-03-31T23:16:42.519941+0000","last_unstale":"2024-03-31T23:16:42.520776+0000","last_undegraded":"2024-03-31T23:16:42.520776+0000","last_fullsized":"2024-03-31T23:16:42.520776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:49:47.173204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.521195+0000","last_change":"2024-03-31T23:16:42.520660+0000","last_active":"2024-03-31T23:16:42.521195+0000","last_peered":"2024-03-31T23:16:42.521195+0000","last_clean":"2024-03-31T23:16:42.521195+0000","last_became_active":"2024-03-31T23:16:42.520061+0000","last_became_peered":"2024-03-31T23:16:42.520061+0000","last_unstale":"2024-03-31T23:16:42.521195+0000","last_undegraded":"2024-03-31T23:16:42.521195+0000","last_fullsized":"2024-03-31T23:16:42.521195+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:18:20.495238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.486599+0000","last_change":"2024-03-31T23:16:42.486185+0000","last_active":"2024-03-31T23:16:42.486599+0000","last_peered":"2024-03-31T23:16:42.486599+0000","last_clean":"2024-03-31T23:16:42.486599+0000","last_became_active":"2024-03-31T23:16:42.480591+0000","last_became_peered":"2024-03-31T23:16:42.480591+0000","last_unstale":"2024-03-31T23:16:42.486599+0000","last_undegraded":"2024-03-31T23:16:42.486599+0000","last_fullsized":"2024-03-31T23:16:42.486599+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:01:32.270666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477711+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:16:42.477711+0000","last_peered":"2024-03-31T23:16:42.477711+0000","last_clean":"2024-03-31T23:16:42.477711+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:16:42.477711+0000","last_undegraded":"2024-03-31T23:16:42.477711+0000","last_fullsized":"2024-03-31T23:16:42.477711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.520508+0000","last_change":"2024-03-31T23:16:42.520508+0000","last_active":"2024-03-31T23:16:42.520508+0000","last_peered":"2024-03-31T23:16:42.520508+0000","last_clean":"2024-03-31T23:16:42.520508+0000","last_became_active":"2024-03-31T23:16:42.520076+0000","last_became_peered":"2024-03-31T23:16:42.520076+0000","last_unstale":"2024-03-31T23:16:42.520508+0000","last_undegraded":"2024-03-31T23:16:42.520508+0000","last_fullsized":"2024-03-31T23:16:42.520508+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:32:07.192476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473826+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:16:42.473826+0000","last_peered":"2024-03-31T23:16:42.473826+0000","last_clean":"2024-03-31T23:16:42.473826+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:16:42.473826+0000","last_undegraded":"2024-03-31T23:16:42.473826+0000","last_fullsized":"2024-03-31T23:16:42.473826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477258+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:16:42.477258+0000","last_peered":"2024-03-31T23:16:42.477258+0000","last_clean":"2024-03-31T23:16:42.477258+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:16:42.477258+0000","last_undegraded":"2024-03-31T23:16:42.477258+0000","last_fullsized":"2024-03-31T23:16:42.477258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475695+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:16:42.475695+0000","last_peered":"2024-03-31T23:16:42.475695+0000","last_clean":"2024-03-31T23:16:42.475695+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:16:42.475695+0000","last_undegraded":"2024-03-31T23:16:42.475695+0000","last_fullsized":"2024-03-31T23:16:42.475695+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:06.331823+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:17:06.331823+0000","last_peered":"2024-03-31T23:17:06.331823+0000","last_clean":"2024-03-31T23:17:06.331823+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:17:06.331823+0000","last_undegraded":"2024-03-31T23:17:06.331823+0000","last_fullsized":"2024-03-31T23:17:06.331823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476889+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:16:42.476889+0000","last_peered":"2024-03-31T23:16:42.476889+0000","last_clean":"2024-03-31T23:16:42.476889+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:16:42.476889+0000","last_undegraded":"2024-03-31T23:16:42.476889+0000","last_fullsized":"2024-03-31T23:16:42.476889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476808+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:16:42.476808+0000","last_peered":"2024-03-31T23:16:42.476808+0000","last_clean":"2024-03-31T23:16:42.476808+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:16:42.476808+0000","last_undegraded":"2024-03-31T23:16:42.476808+0000","last_fullsized":"2024-03-31T23:16:42.476808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480308+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:16:42.480308+0000","last_peered":"2024-03-31T23:16:42.480308+0000","last_clean":"2024-03-31T23:16:42.480308+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:16:42.480308+0000","last_undegraded":"2024-03-31T23:16:42.480308+0000","last_fullsized":"2024-03-31T23:16:42.480308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:06.331428+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:17:06.331428+0000","last_peered":"2024-03-31T23:17:06.331428+0000","last_clean":"2024-03-31T23:17:06.331428+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:17:06.331428+0000","last_undegraded":"2024-03-31T23:17:06.331428+0000","last_fullsized":"2024-03-31T23:17:06.331428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518722+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:16:42.518722+0000","last_peered":"2024-03-31T23:16:42.518722+0000","last_clean":"2024-03-31T23:16:42.518722+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:16:42.518722+0000","last_undegraded":"2024-03-31T23:16:42.518722+0000","last_fullsized":"2024-03-31T23:16:42.518722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482148+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:16:42.482148+0000","last_peered":"2024-03-31T23:16:42.482148+0000","last_clean":"2024-03-31T23:16:42.482148+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:16:42.482148+0000","last_undegraded":"2024-03-31T23:16:42.482148+0000","last_fullsized":"2024-03-31T23:16:42.482148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473706+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:16:42.473706+0000","last_peered":"2024-03-31T23:16:42.473706+0000","last_clean":"2024-03-31T23:16:42.473706+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:16:42.473706+0000","last_undegraded":"2024-03-31T23:16:42.473706+0000","last_fullsized":"2024-03-31T23:16:42.473706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":363,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518203+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:16:42.518203+0000","last_peered":"2024-03-31T23:16:42.518203+0000","last_clean":"2024-03-31T23:16:42.518203+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:16:42.518203+0000","last_undegraded":"2024-03-31T23:16:42.518203+0000","last_fullsized":"2024-03-31T23:16:42.518203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481003+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:16:42.481003+0000","last_peered":"2024-03-31T23:16:42.481003+0000","last_clean":"2024-03-31T23:16:42.481003+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:16:42.481003+0000","last_undegraded":"2024-03-31T23:16:42.481003+0000","last_fullsized":"2024-03-31T23:16:42.481003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478674+0000","last_change":"2024-03-31T23:16:42.478674+0000","last_active":"2024-03-31T23:16:42.478674+0000","last_peered":"2024-03-31T23:16:42.478674+0000","last_clean":"2024-03-31T23:16:42.478674+0000","last_became_active":"2024-03-31T23:16:42.478317+0000","last_became_peered":"2024-03-31T23:16:42.478317+0000","last_unstale":"2024-03-31T23:16:42.478674+0000","last_undegraded":"2024-03-31T23:16:42.478674+0000","last_fullsized":"2024-03-31T23:16:42.478674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:43.917393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518200+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:16:42.518200+0000","last_peered":"2024-03-31T23:16:42.518200+0000","last_clean":"2024-03-31T23:16:42.518200+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:16:42.518200+0000","last_undegraded":"2024-03-31T23:16:42.518200+0000","last_fullsized":"2024-03-31T23:16:42.518200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477907+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:16:42.477907+0000","last_peered":"2024-03-31T23:16:42.477907+0000","last_clean":"2024-03-31T23:16:42.477907+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:16:42.477907+0000","last_undegraded":"2024-03-31T23:16:42.477907+0000","last_fullsized":"2024-03-31T23:16:42.477907+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476257+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:16:42.476257+0000","last_peered":"2024-03-31T23:16:42.476257+0000","last_clean":"2024-03-31T23:16:42.476257+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:16:42.476257+0000","last_undegraded":"2024-03-31T23:16:42.476257+0000","last_fullsized":"2024-03-31T23:16:42.476257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475968+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:16:42.475968+0000","last_peered":"2024-03-31T23:16:42.475968+0000","last_clean":"2024-03-31T23:16:42.475968+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:16:42.475968+0000","last_undegraded":"2024-03-31T23:16:42.475968+0000","last_fullsized":"2024-03-31T23:16:42.475968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481672+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:16:42.481672+0000","last_peered":"2024-03-31T23:16:42.481672+0000","last_clean":"2024-03-31T23:16:42.481672+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:16:42.481672+0000","last_undegraded":"2024-03-31T23:16:42.481672+0000","last_fullsized":"2024-03-31T23:16:42.481672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474668+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:16:42.474668+0000","last_peered":"2024-03-31T23:16:42.474668+0000","last_clean":"2024-03-31T23:16:42.474668+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:16:42.474668+0000","last_undegraded":"2024-03-31T23:16:42.474668+0000","last_fullsized":"2024-03-31T23:16:42.474668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482519+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:16:42.482519+0000","last_peered":"2024-03-31T23:16:42.482519+0000","last_clean":"2024-03-31T23:16:42.482519+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:16:42.482519+0000","last_undegraded":"2024-03-31T23:16:42.482519+0000","last_fullsized":"2024-03-31T23:16:42.482519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473656+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:16:42.473656+0000","last_peered":"2024-03-31T23:16:42.473656+0000","last_clean":"2024-03-31T23:16:42.473656+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:16:42.473656+0000","last_undegraded":"2024-03-31T23:16:42.473656+0000","last_fullsized":"2024-03-31T23:16:42.473656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474275+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:16:42.474275+0000","last_peered":"2024-03-31T23:16:42.474275+0000","last_clean":"2024-03-31T23:16:42.474275+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:16:42.474275+0000","last_undegraded":"2024-03-31T23:16:42.474275+0000","last_fullsized":"2024-03-31T23:16:42.474275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.479778+0000","last_change":"2024-03-31T23:16:42.479778+0000","last_active":"2024-03-31T23:16:42.479778+0000","last_peered":"2024-03-31T23:16:42.479778+0000","last_clean":"2024-03-31T23:16:42.479778+0000","last_became_active":"2024-03-31T23:16:42.479401+0000","last_became_peered":"2024-03-31T23:16:42.479401+0000","last_unstale":"2024-03-31T23:16:42.479778+0000","last_undegraded":"2024-03-31T23:16:42.479778+0000","last_fullsized":"2024-03-31T23:16:42.479778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:01:58.138818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473838+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:16:42.473838+0000","last_peered":"2024-03-31T23:16:42.473838+0000","last_clean":"2024-03-31T23:16:42.473838+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:16:42.473838+0000","last_undegraded":"2024-03-31T23:16:42.473838+0000","last_fullsized":"2024-03-31T23:16:42.473838+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518564+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:16:42.518564+0000","last_peered":"2024-03-31T23:16:42.518564+0000","last_clean":"2024-03-31T23:16:42.518564+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:16:42.518564+0000","last_undegraded":"2024-03-31T23:16:42.518564+0000","last_fullsized":"2024-03-31T23:16:42.518564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475547+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:16:42.475547+0000","last_peered":"2024-03-31T23:16:42.475547+0000","last_clean":"2024-03-31T23:16:42.475547+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:16:42.475547+0000","last_undegraded":"2024-03-31T23:16:42.475547+0000","last_fullsized":"2024-03-31T23:16:42.475547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.483901+0000","last_change":"2024-03-31T23:16:42.483336+0000","last_active":"2024-03-31T23:16:42.483901+0000","last_peered":"2024-03-31T23:16:42.483901+0000","last_clean":"2024-03-31T23:16:42.483901+0000","last_became_active":"2024-03-31T23:16:42.482909+0000","last_became_peered":"2024-03-31T23:16:42.482909+0000","last_unstale":"2024-03-31T23:16:42.483901+0000","last_undegraded":"2024-03-31T23:16:42.483901+0000","last_fullsized":"2024-03-31T23:16:42.483901+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:38:02.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481767+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:16:42.481767+0000","last_peered":"2024-03-31T23:16:42.481767+0000","last_clean":"2024-03-31T23:16:42.481767+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:16:42.481767+0000","last_undegraded":"2024-03-31T23:16:42.481767+0000","last_fullsized":"2024-03-31T23:16:42.481767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476002+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:16:42.476002+0000","last_peered":"2024-03-31T23:16:42.476002+0000","last_clean":"2024-03-31T23:16:42.476002+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:16:42.476002+0000","last_undegraded":"2024-03-31T23:16:42.476002+0000","last_fullsized":"2024-03-31T23:16:42.476002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473687+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:16:42.473687+0000","last_peered":"2024-03-31T23:16:42.473687+0000","last_clean":"2024-03-31T23:16:42.473687+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:16:42.473687+0000","last_undegraded":"2024-03-31T23:16:42.473687+0000","last_fullsized":"2024-03-31T23:16:42.473687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.490032+0000","last_change":"2024-03-31T23:16:42.489599+0000","last_active":"2024-03-31T23:16:42.490032+0000","last_peered":"2024-03-31T23:16:42.490032+0000","last_clean":"2024-03-31T23:16:42.490032+0000","last_became_active":"2024-03-31T23:16:42.483090+0000","last_became_peered":"2024-03-31T23:16:42.483090+0000","last_unstale":"2024-03-31T23:16:42.490032+0000","last_undegraded":"2024-03-31T23:16:42.490032+0000","last_fullsized":"2024-03-31T23:16:42.490032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:31:32.544161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482472+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:16:42.482472+0000","last_peered":"2024-03-31T23:16:42.482472+0000","last_clean":"2024-03-31T23:16:42.482472+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:16:42.482472+0000","last_undegraded":"2024-03-31T23:16:42.482472+0000","last_fullsized":"2024-03-31T23:16:42.482472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473756+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:16:42.473756+0000","last_peered":"2024-03-31T23:16:42.473756+0000","last_clean":"2024-03-31T23:16:42.473756+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:16:42.473756+0000","last_undegraded":"2024-03-31T23:16:42.473756+0000","last_fullsized":"2024-03-31T23:16:42.473756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475454+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:16:42.475454+0000","last_peered":"2024-03-31T23:16:42.475454+0000","last_clean":"2024-03-31T23:16:42.475454+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:16:42.475454+0000","last_undegraded":"2024-03-31T23:16:42.475454+0000","last_fullsized":"2024-03-31T23:16:42.475454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.519056+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:16:42.519056+0000","last_peered":"2024-03-31T23:16:42.519056+0000","last_clean":"2024-03-31T23:16:42.519056+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:16:42.519056+0000","last_undegraded":"2024-03-31T23:16:42.519056+0000","last_fullsized":"2024-03-31T23:16:42.519056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518562+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:16:42.518562+0000","last_peered":"2024-03-31T23:16:42.518562+0000","last_clean":"2024-03-31T23:16:42.518562+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:16:42.518562+0000","last_undegraded":"2024-03-31T23:16:42.518562+0000","last_fullsized":"2024-03-31T23:16:42.518562+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:08.333731+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:17:08.333731+0000","last_peered":"2024-03-31T23:17:08.333731+0000","last_clean":"2024-03-31T23:17:08.333731+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:17:08.333731+0000","last_undegraded":"2024-03-31T23:17:08.333731+0000","last_fullsized":"2024-03-31T23:17:08.333731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.519349+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:16:42.519349+0000","last_peered":"2024-03-31T23:16:42.519349+0000","last_clean":"2024-03-31T23:16:42.519349+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:16:42.519349+0000","last_undegraded":"2024-03-31T23:16:42.519349+0000","last_fullsized":"2024-03-31T23:16:42.519349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477466+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:16:42.477466+0000","last_peered":"2024-03-31T23:16:42.477466+0000","last_clean":"2024-03-31T23:16:42.477466+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:16:42.477466+0000","last_undegraded":"2024-03-31T23:16:42.477466+0000","last_fullsized":"2024-03-31T23:16:42.477466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481117+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:16:42.481117+0000","last_peered":"2024-03-31T23:16:42.481117+0000","last_clean":"2024-03-31T23:16:42.481117+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:16:42.481117+0000","last_undegraded":"2024-03-31T23:16:42.481117+0000","last_fullsized":"2024-03-31T23:16:42.481117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518619+0000","last_change":"2024-03-31T23:15:33.851537+0000","last_active":"2024-03-31T23:16:42.518619+0000","last_peered":"2024-03-31T23:16:42.518619+0000","last_clean":"2024-03-31T23:16:42.518619+0000","last_became_active":"2024-03-31T23:15:33.851146+0000","last_became_peered":"2024-03-31T23:15:33.851146+0000","last_unstale":"2024-03-31T23:16:42.518619+0000","last_undegraded":"2024-03-31T23:16:42.518619+0000","last_fullsized":"2024-03-31T23:16:42.518619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:36:36.549600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.479631+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:16:42.479631+0000","last_peered":"2024-03-31T23:16:42.479631+0000","last_clean":"2024-03-31T23:16:42.479631+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:16:42.479631+0000","last_undegraded":"2024-03-31T23:16:42.479631+0000","last_fullsized":"2024-03-31T23:16:42.479631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476420+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:16:42.476420+0000","last_peered":"2024-03-31T23:16:42.476420+0000","last_clean":"2024-03-31T23:16:42.476420+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:16:42.476420+0000","last_undegraded":"2024-03-31T23:16:42.476420+0000","last_fullsized":"2024-03-31T23:16:42.476420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.519362+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:16:42.519362+0000","last_peered":"2024-03-31T23:16:42.519362+0000","last_clean":"2024-03-31T23:16:42.519362+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:16:42.519362+0000","last_undegraded":"2024-03-31T23:16:42.519362+0000","last_fullsized":"2024-03-31T23:16:42.519362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476095+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:16:42.476095+0000","last_peered":"2024-03-31T23:16:42.476095+0000","last_clean":"2024-03-31T23:16:42.476095+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:16:42.476095+0000","last_undegraded":"2024-03-31T23:16:42.476095+0000","last_fullsized":"2024-03-31T23:16:42.476095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474267+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:16:42.474267+0000","last_peered":"2024-03-31T23:16:42.474267+0000","last_clean":"2024-03-31T23:16:42.474267+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:16:42.474267+0000","last_undegraded":"2024-03-31T23:16:42.474267+0000","last_fullsized":"2024-03-31T23:16:42.474267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473697+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:16:42.473697+0000","last_peered":"2024-03-31T23:16:42.473697+0000","last_clean":"2024-03-31T23:16:42.473697+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:16:42.473697+0000","last_undegraded":"2024-03-31T23:16:42.473697+0000","last_fullsized":"2024-03-31T23:16:42.473697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480375+0000","last_change":"2024-03-31T23:16:42.480375+0000","last_active":"2024-03-31T23:16:42.480375+0000","last_peered":"2024-03-31T23:16:42.480375+0000","last_clean":"2024-03-31T23:16:42.480375+0000","last_became_active":"2024-03-31T23:16:42.480005+0000","last_became_peered":"2024-03-31T23:16:42.480005+0000","last_unstale":"2024-03-31T23:16:42.480375+0000","last_undegraded":"2024-03-31T23:16:42.480375+0000","last_fullsized":"2024-03-31T23:16:42.480375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:31:15.217708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477172+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:16:42.477172+0000","last_peered":"2024-03-31T23:16:42.477172+0000","last_clean":"2024-03-31T23:16:42.477172+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:16:42.477172+0000","last_undegraded":"2024-03-31T23:16:42.477172+0000","last_fullsized":"2024-03-31T23:16:42.477172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477750+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:16:42.477750+0000","last_peered":"2024-03-31T23:16:42.477750+0000","last_clean":"2024-03-31T23:16:42.477750+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:16:42.477750+0000","last_undegraded":"2024-03-31T23:16:42.477750+0000","last_fullsized":"2024-03-31T23:16:42.477750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474370+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:16:42.474370+0000","last_peered":"2024-03-31T23:16:42.474370+0000","last_clean":"2024-03-31T23:16:42.474370+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:16:42.474370+0000","last_undegraded":"2024-03-31T23:16:42.474370+0000","last_fullsized":"2024-03-31T23:16:42.474370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482637+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:16:42.482637+0000","last_peered":"2024-03-31T23:16:42.482637+0000","last_clean":"2024-03-31T23:16:42.482637+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:16:42.482637+0000","last_undegraded":"2024-03-31T23:16:42.482637+0000","last_fullsized":"2024-03-31T23:16:42.482637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480301+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:16:42.480301+0000","last_peered":"2024-03-31T23:16:42.480301+0000","last_clean":"2024-03-31T23:16:42.480301+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:16:42.480301+0000","last_undegraded":"2024-03-31T23:16:42.480301+0000","last_fullsized":"2024-03-31T23:16:42.480301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481798+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:16:42.481798+0000","last_peered":"2024-03-31T23:16:42.481798+0000","last_clean":"2024-03-31T23:16:42.481798+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:16:42.481798+0000","last_undegraded":"2024-03-31T23:16:42.481798+0000","last_fullsized":"2024-03-31T23:16:42.481798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518725+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:16:42.518725+0000","last_peered":"2024-03-31T23:16:42.518725+0000","last_clean":"2024-03-31T23:16:42.518725+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:16:42.518725+0000","last_undegraded":"2024-03-31T23:16:42.518725+0000","last_fullsized":"2024-03-31T23:16:42.518725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476206+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:16:42.476206+0000","last_peered":"2024-03-31T23:16:42.476206+0000","last_clean":"2024-03-31T23:16:42.476206+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:16:42.476206+0000","last_undegraded":"2024-03-31T23:16:42.476206+0000","last_fullsized":"2024-03-31T23:16:42.476206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477597+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:16:42.477597+0000","last_peered":"2024-03-31T23:16:42.477597+0000","last_clean":"2024-03-31T23:16:42.477597+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:16:42.477597+0000","last_undegraded":"2024-03-31T23:16:42.477597+0000","last_fullsized":"2024-03-31T23:16:42.477597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70951,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":703,"num_read_kb":428,"num_write":243,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":212853,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383712,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":501838,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1150976,"data_stored":1151988,"data_compressed":58082,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808874,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":505451,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070511,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":501711,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332149,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":1098621,"data_compressed":56475,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495674,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":496859,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":561245,"data_compressed":22219,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1028096,"data_stored":498706,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":562247,"data_compressed":22219,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":496567,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920836,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":501324,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1093812,"data_compressed":56475,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65108,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66110,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65483,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:17:12.974 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-31T23:17:12.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:12 smithi188 ceph-mon[36068]: pgmap v336: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:12.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:12 smithi188 ceph-mon[36068]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-31T23:17:13.221 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:13.592 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:13 smithi042 ceph-mon[32380]: from='client.24913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:13.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:13 smithi094 ceph-mon[36167]: from='client.24913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:13.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:13 smithi188 ceph-mon[36068]: from='client.24913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:14.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:14 smithi042 ceph-mon[32380]: pgmap v337: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:14 smithi094 ceph-mon[36167]: pgmap v337: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:14.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:14 smithi188 ceph-mon[36068]: pgmap v337: 129 pgs: 129 active+clean; 646 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:15.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 -- 172.21.15.42:0/3781880445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102c50 msgr2=0x7f362010f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:15.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 --2- 172.21.15.42:0/3781880445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102c50 0x7f362010f090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f361800b0d0 tx=0x7f361800b3e0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 -- 172.21.15.42:0/3781880445 shutdown_connections 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 --2- 172.21.15.42:0/3781880445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102c50 0x7f362010f090 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 --2- 172.21.15.42:0/3781880445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620108270 0x7f3620108650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 --2- 172.21.15.42:0/3781880445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3620102290 0x7f3620102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 -- 172.21.15.42:0/3781880445 >> 172.21.15.42:0/3781880445 conn(0x7f3620079370 msgr2=0x7f3620079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 -- 172.21.15.42:0/3781880445 shutdown_connections 2024-03-31T23:17:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 -- 172.21.15.42:0/3781880445 wait complete. 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 Processor -- start 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.015+0000 7f362760c700 1 -- start start 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 0x7f362019e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620102c50 0x7f362019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3620108270 0x7f36201987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3620112660 con 0x7f3620102290 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f36201124e0 con 0x7f3620102c50 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36201127e0 con 0x7f3620108270 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f36253a8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 0x7f362019e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f36253a8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 0x7f362019e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33538/0 (socket says 172.21.15.42:33538) 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f36253a8700 1 -- 172.21.15.42:0/3465370112 learned_addr learned my addr 172.21.15.42:0/3465370112 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620102c50 0x7f362019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3625ba9700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3620108270 0x7f36201987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 -- 172.21.15.42:0/3465370112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3620108270 msgr2=0x7f36201987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3620108270 0x7f36201987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 -- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 msgr2=0x7f362019e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 0x7f362019e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 -- 172.21.15.42:0/3465370112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3620198f80 con 0x7f3620102c50 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f36253a8700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 0x7f362019e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f3624ba7700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620102c50 0x7f362019eb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f361000e9f0 tx=0x7f361000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610004220 con 0x7f3620102c50 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.016+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3620199270 con 0x7f3620102c50 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.017+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3610004d30 con 0x7f3620102c50 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.017+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36201a5480 con 0x7f3620102c50 2024-03-31T23:17:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.017+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610005080 con 0x7f3620102c50 2024-03-31T23:17:15.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.018+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3620103920 con 0x7f3620102c50 2024-03-31T23:17:15.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.019+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f3610005360 con 0x7f3620102c50 2024-03-31T23:17:15.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.019+0000 7f36167fc700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f360c0a2530 0x7f360c0a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:15.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.019+0000 7f36253a8700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f360c0a2530 0x7f360c0a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:15.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.019+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f36100ce960 con 0x7f3620102c50 2024-03-31T23:17:15.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.020+0000 7f36253a8700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f360c0a2530 0x7f360c0a49f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f361c011550 tx=0x7f361c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.024+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f361009b7c0 con 0x7f3620102c50 2024-03-31T23:17:15.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.222+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3620062680 con 0x7f360c0a2530 2024-03-31T23:17:15.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.231+0000 7f36167fc700 1 -- 172.21.15.42:0/3465370112 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340950 (secure 0 0 0) 0x7f3620062680 con 0x7f360c0a2530 2024-03-31T23:17:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f360c0a2530 msgr2=0x7f360c0a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f360c0a2530 0x7f360c0a49f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f361c011550 tx=0x7f361c009260 comp rx=0 tx=0).stop 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620102c50 msgr2=0x7f362019eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620102c50 0x7f362019eb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f361000e9f0 tx=0x7f361000ed00 comp rx=0 tx=0).stop 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 shutdown_connections 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f360c0a2530 0x7f360c0a49f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3620108270 0x7f36201987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3620102290 0x7f362019e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 --2- 172.21.15.42:0/3465370112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3620102c50 0x7f362019eb60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 >> 172.21.15.42:0/3465370112 conn(0x7f3620079370 msgr2=0x7f3620100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 shutdown_connections 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:15.235+0000 7f362760c700 1 -- 172.21.15.42:0/3465370112 wait complete. 2024-03-31T23:17:15.239 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:17:15.970 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-03-31T23:17:14.788289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662225,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":893,"num_read_kb":576,"num_write":437,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":861,"ondisk_log_size":861,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361456,"kb_used_data":12296,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580368,"statfs":{"total":1151940427776,"available":1151570296832,"internally_reserved":0,"allocated":12591104,"data_stored":7972136,"data_compressed":359754,"data_compressed_allocated":491520,"data_compressed_original":2482176,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":79,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003152"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.799712+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:17:10.799712+0000","last_peered":"2024-03-31T23:17:10.799712+0000","last_clean":"2024-03-31T23:17:10.799712+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:17:10.799712+0000","last_undegraded":"2024-03-31T23:17:10.799712+0000","last_fullsized":"2024-03-31T23:17:10.799712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.787002+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:17:10.787002+0000","last_peered":"2024-03-31T23:17:10.787002+0000","last_clean":"2024-03-31T23:17:10.787002+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:17:10.787002+0000","last_undegraded":"2024-03-31T23:17:10.787002+0000","last_fullsized":"2024-03-31T23:17:10.787002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.799601+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:17:10.799601+0000","last_peered":"2024-03-31T23:17:10.799601+0000","last_clean":"2024-03-31T23:17:10.799601+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:17:10.799601+0000","last_undegraded":"2024-03-31T23:17:10.799601+0000","last_fullsized":"2024-03-31T23:17:10.799601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.780363+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:17:10.780363+0000","last_peered":"2024-03-31T23:17:10.780363+0000","last_clean":"2024-03-31T23:17:10.780363+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:17:10.780363+0000","last_undegraded":"2024-03-31T23:17:10.780363+0000","last_fullsized":"2024-03-31T23:17:10.780363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.781993+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:17:10.781993+0000","last_peered":"2024-03-31T23:17:10.781993+0000","last_clean":"2024-03-31T23:17:10.781993+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:17:10.781993+0000","last_undegraded":"2024-03-31T23:17:10.781993+0000","last_fullsized":"2024-03-31T23:17:10.781993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.775869+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:17:10.775869+0000","last_peered":"2024-03-31T23:17:10.775869+0000","last_clean":"2024-03-31T23:17:10.775869+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:17:10.775869+0000","last_undegraded":"2024-03-31T23:17:10.775869+0000","last_fullsized":"2024-03-31T23:17:10.775869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.780659+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:17:10.780659+0000","last_peered":"2024-03-31T23:17:10.780659+0000","last_clean":"2024-03-31T23:17:10.780659+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:17:10.780659+0000","last_undegraded":"2024-03-31T23:17:10.780659+0000","last_fullsized":"2024-03-31T23:17:10.780659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790727+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:17:10.790727+0000","last_peered":"2024-03-31T23:17:10.790727+0000","last_clean":"2024-03-31T23:17:10.790727+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:17:10.790727+0000","last_undegraded":"2024-03-31T23:17:10.790727+0000","last_fullsized":"2024-03-31T23:17:10.790727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.798982+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:17:10.798982+0000","last_peered":"2024-03-31T23:17:10.798982+0000","last_clean":"2024-03-31T23:17:10.798982+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:17:10.798982+0000","last_undegraded":"2024-03-31T23:17:10.798982+0000","last_fullsized":"2024-03-31T23:17:10.798982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.789677+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:17:10.789677+0000","last_peered":"2024-03-31T23:17:10.789677+0000","last_clean":"2024-03-31T23:17:10.789677+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:17:10.789677+0000","last_undegraded":"2024-03-31T23:17:10.789677+0000","last_fullsized":"2024-03-31T23:17:10.789677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.798108+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:17:10.798108+0000","last_peered":"2024-03-31T23:17:10.798108+0000","last_clean":"2024-03-31T23:17:10.798108+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:17:10.798108+0000","last_undegraded":"2024-03-31T23:17:10.798108+0000","last_fullsized":"2024-03-31T23:17:10.798108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.779122+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:17:10.779122+0000","last_peered":"2024-03-31T23:17:10.779122+0000","last_clean":"2024-03-31T23:17:10.779122+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:17:10.779122+0000","last_undegraded":"2024-03-31T23:17:10.779122+0000","last_fullsized":"2024-03-31T23:17:10.779122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.781255+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:17:10.781255+0000","last_peered":"2024-03-31T23:17:10.781255+0000","last_clean":"2024-03-31T23:17:10.781255+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:17:10.781255+0000","last_undegraded":"2024-03-31T23:17:10.781255+0000","last_fullsized":"2024-03-31T23:17:10.781255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.777747+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:17:10.777747+0000","last_peered":"2024-03-31T23:17:10.777747+0000","last_clean":"2024-03-31T23:17:10.777747+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:17:10.777747+0000","last_undegraded":"2024-03-31T23:17:10.777747+0000","last_fullsized":"2024-03-31T23:17:10.777747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790763+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:17:10.790763+0000","last_peered":"2024-03-31T23:17:10.790763+0000","last_clean":"2024-03-31T23:17:10.790763+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:17:10.790763+0000","last_undegraded":"2024-03-31T23:17:10.790763+0000","last_fullsized":"2024-03-31T23:17:10.790763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.799192+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:17:10.799192+0000","last_peered":"2024-03-31T23:17:10.799192+0000","last_clean":"2024-03-31T23:17:10.799192+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:17:10.799192+0000","last_undegraded":"2024-03-31T23:17:10.799192+0000","last_fullsized":"2024-03-31T23:17:10.799192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.799826+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:17:10.799826+0000","last_peered":"2024-03-31T23:17:10.799826+0000","last_clean":"2024-03-31T23:17:10.799826+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:17:10.799826+0000","last_undegraded":"2024-03-31T23:17:10.799826+0000","last_fullsized":"2024-03-31T23:17:10.799826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790021+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:17:10.790021+0000","last_peered":"2024-03-31T23:17:10.790021+0000","last_clean":"2024-03-31T23:17:10.790021+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:17:10.790021+0000","last_undegraded":"2024-03-31T23:17:10.790021+0000","last_fullsized":"2024-03-31T23:17:10.790021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.783199+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:17:10.783199+0000","last_peered":"2024-03-31T23:17:10.783199+0000","last_clean":"2024-03-31T23:17:10.783199+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:17:10.783199+0000","last_undegraded":"2024-03-31T23:17:10.783199+0000","last_fullsized":"2024-03-31T23:17:10.783199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473962+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:16:42.473962+0000","last_peered":"2024-03-31T23:16:42.473962+0000","last_clean":"2024-03-31T23:16:42.473962+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:16:42.473962+0000","last_undegraded":"2024-03-31T23:16:42.473962+0000","last_fullsized":"2024-03-31T23:16:42.473962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":113,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:12.337870+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:17:12.337870+0000","last_peered":"2024-03-31T23:17:12.337870+0000","last_clean":"2024-03-31T23:17:12.337870+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:17:12.337870+0000","last_undegraded":"2024-03-31T23:17:12.337870+0000","last_fullsized":"2024-03-31T23:17:12.337870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790425+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:17:10.790425+0000","last_peered":"2024-03-31T23:17:10.790425+0000","last_clean":"2024-03-31T23:17:10.790425+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:17:10.790425+0000","last_undegraded":"2024-03-31T23:17:10.790425+0000","last_fullsized":"2024-03-31T23:17:10.790425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473517+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:16:42.473517+0000","last_peered":"2024-03-31T23:16:42.473517+0000","last_clean":"2024-03-31T23:16:42.473517+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:16:42.473517+0000","last_undegraded":"2024-03-31T23:16:42.473517+0000","last_fullsized":"2024-03-31T23:16:42.473517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482614+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:16:42.482614+0000","last_peered":"2024-03-31T23:16:42.482614+0000","last_clean":"2024-03-31T23:16:42.482614+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:16:42.482614+0000","last_undegraded":"2024-03-31T23:16:42.482614+0000","last_fullsized":"2024-03-31T23:16:42.482614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.799837+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:17:10.799837+0000","last_peered":"2024-03-31T23:17:10.799837+0000","last_clean":"2024-03-31T23:17:10.799837+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:17:10.799837+0000","last_undegraded":"2024-03-31T23:17:10.799837+0000","last_fullsized":"2024-03-31T23:17:10.799837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473697+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:16:42.473697+0000","last_peered":"2024-03-31T23:16:42.473697+0000","last_clean":"2024-03-31T23:16:42.473697+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:16:42.473697+0000","last_undegraded":"2024-03-31T23:16:42.473697+0000","last_fullsized":"2024-03-31T23:16:42.473697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476407+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:16:42.476407+0000","last_peered":"2024-03-31T23:16:42.476407+0000","last_clean":"2024-03-31T23:16:42.476407+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:16:42.476407+0000","last_undegraded":"2024-03-31T23:16:42.476407+0000","last_fullsized":"2024-03-31T23:16:42.476407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.800716+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:17:10.800716+0000","last_peered":"2024-03-31T23:17:10.800716+0000","last_clean":"2024-03-31T23:17:10.800716+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:17:10.800716+0000","last_undegraded":"2024-03-31T23:17:10.800716+0000","last_fullsized":"2024-03-31T23:17:10.800716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473627+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:16:42.473627+0000","last_peered":"2024-03-31T23:16:42.473627+0000","last_clean":"2024-03-31T23:16:42.473627+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:16:42.473627+0000","last_undegraded":"2024-03-31T23:16:42.473627+0000","last_fullsized":"2024-03-31T23:16:42.473627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476675+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:16:42.476675+0000","last_peered":"2024-03-31T23:16:42.476675+0000","last_clean":"2024-03-31T23:16:42.476675+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:16:42.476675+0000","last_undegraded":"2024-03-31T23:16:42.476675+0000","last_fullsized":"2024-03-31T23:16:42.476675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.795392+0000","last_change":"2024-03-31T23:15:33.842873+0000","last_active":"2024-03-31T23:17:10.795392+0000","last_peered":"2024-03-31T23:17:10.795392+0000","last_clean":"2024-03-31T23:17:10.795392+0000","last_became_active":"2024-03-31T23:15:33.842575+0000","last_became_peered":"2024-03-31T23:15:33.842575+0000","last_unstale":"2024-03-31T23:17:10.795392+0000","last_undegraded":"2024-03-31T23:17:10.795392+0000","last_fullsized":"2024-03-31T23:17:10.795392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:23:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474127+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:16:42.474127+0000","last_peered":"2024-03-31T23:16:42.474127+0000","last_clean":"2024-03-31T23:16:42.474127+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:16:42.474127+0000","last_undegraded":"2024-03-31T23:16:42.474127+0000","last_fullsized":"2024-03-31T23:16:42.474127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:11.334469+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:17:11.334469+0000","last_peered":"2024-03-31T23:17:11.334469+0000","last_clean":"2024-03-31T23:17:11.334469+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:17:11.334469+0000","last_undegraded":"2024-03-31T23:17:11.334469+0000","last_fullsized":"2024-03-31T23:17:11.334469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.789397+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:17:10.789397+0000","last_peered":"2024-03-31T23:17:10.789397+0000","last_clean":"2024-03-31T23:17:10.789397+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:17:10.789397+0000","last_undegraded":"2024-03-31T23:17:10.789397+0000","last_fullsized":"2024-03-31T23:17:10.789397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474011+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:16:42.474011+0000","last_peered":"2024-03-31T23:16:42.474011+0000","last_clean":"2024-03-31T23:16:42.474011+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:16:42.474011+0000","last_undegraded":"2024-03-31T23:16:42.474011+0000","last_fullsized":"2024-03-31T23:16:42.474011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476814+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:16:42.476814+0000","last_peered":"2024-03-31T23:16:42.476814+0000","last_clean":"2024-03-31T23:16:42.476814+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:16:42.476814+0000","last_undegraded":"2024-03-31T23:16:42.476814+0000","last_fullsized":"2024-03-31T23:16:42.476814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.788748+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:17:10.788748+0000","last_peered":"2024-03-31T23:17:10.788748+0000","last_clean":"2024-03-31T23:17:10.788748+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:17:10.788748+0000","last_undegraded":"2024-03-31T23:17:10.788748+0000","last_fullsized":"2024-03-31T23:17:10.788748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.482887+0000","last_change":"2024-03-31T23:16:42.482887+0000","last_active":"2024-03-31T23:16:42.482887+0000","last_peered":"2024-03-31T23:16:42.482887+0000","last_clean":"2024-03-31T23:16:42.482887+0000","last_became_active":"2024-03-31T23:16:42.482434+0000","last_became_peered":"2024-03-31T23:16:42.482434+0000","last_unstale":"2024-03-31T23:16:42.482887+0000","last_undegraded":"2024-03-31T23:16:42.482887+0000","last_fullsized":"2024-03-31T23:16:42.482887+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:17.721985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476279+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:16:42.476279+0000","last_peered":"2024-03-31T23:16:42.476279+0000","last_clean":"2024-03-31T23:16:42.476279+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:16:42.476279+0000","last_undegraded":"2024-03-31T23:16:42.476279+0000","last_fullsized":"2024-03-31T23:16:42.476279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.782104+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:17:10.782104+0000","last_peered":"2024-03-31T23:17:10.782104+0000","last_clean":"2024-03-31T23:17:10.782104+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:17:10.782104+0000","last_undegraded":"2024-03-31T23:17:10.782104+0000","last_fullsized":"2024-03-31T23:17:10.782104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.478793+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:16:42.478793+0000","last_peered":"2024-03-31T23:16:42.478793+0000","last_clean":"2024-03-31T23:16:42.478793+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:16:42.478793+0000","last_undegraded":"2024-03-31T23:16:42.478793+0000","last_fullsized":"2024-03-31T23:16:42.478793+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480194+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:16:42.480194+0000","last_peered":"2024-03-31T23:16:42.480194+0000","last_clean":"2024-03-31T23:16:42.480194+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:16:42.480194+0000","last_undegraded":"2024-03-31T23:16:42.480194+0000","last_fullsized":"2024-03-31T23:16:42.480194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.782560+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:17:10.782560+0000","last_peered":"2024-03-31T23:17:10.782560+0000","last_clean":"2024-03-31T23:17:10.782560+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:17:10.782560+0000","last_undegraded":"2024-03-31T23:17:10.782560+0000","last_fullsized":"2024-03-31T23:17:10.782560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481935+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:16:42.481935+0000","last_peered":"2024-03-31T23:16:42.481935+0000","last_clean":"2024-03-31T23:16:42.481935+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:16:42.481935+0000","last_undegraded":"2024-03-31T23:16:42.481935+0000","last_fullsized":"2024-03-31T23:16:42.481935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:13.336301+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:17:13.336301+0000","last_peered":"2024-03-31T23:17:13.336301+0000","last_clean":"2024-03-31T23:17:13.336301+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:17:13.336301+0000","last_undegraded":"2024-03-31T23:17:13.336301+0000","last_fullsized":"2024-03-31T23:17:13.336301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":144,"num_read_kb":144,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.797335+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:17:10.797335+0000","last_peered":"2024-03-31T23:17:10.797335+0000","last_clean":"2024-03-31T23:17:10.797335+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:17:10.797335+0000","last_undegraded":"2024-03-31T23:17:10.797335+0000","last_fullsized":"2024-03-31T23:17:10.797335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473479+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:16:42.473479+0000","last_peered":"2024-03-31T23:16:42.473479+0000","last_clean":"2024-03-31T23:16:42.473479+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:16:42.473479+0000","last_undegraded":"2024-03-31T23:16:42.473479+0000","last_fullsized":"2024-03-31T23:16:42.473479+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.519220+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:16:42.519220+0000","last_peered":"2024-03-31T23:16:42.519220+0000","last_clean":"2024-03-31T23:16:42.519220+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:16:42.519220+0000","last_undegraded":"2024-03-31T23:16:42.519220+0000","last_fullsized":"2024-03-31T23:16:42.519220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.784086+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:17:10.784086+0000","last_peered":"2024-03-31T23:17:10.784086+0000","last_clean":"2024-03-31T23:17:10.784086+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:17:10.784086+0000","last_undegraded":"2024-03-31T23:17:10.784086+0000","last_fullsized":"2024-03-31T23:17:10.784086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474193+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:16:42.474193+0000","last_peered":"2024-03-31T23:16:42.474193+0000","last_clean":"2024-03-31T23:16:42.474193+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:16:42.474193+0000","last_undegraded":"2024-03-31T23:16:42.474193+0000","last_fullsized":"2024-03-31T23:16:42.474193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480938+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:16:42.480938+0000","last_peered":"2024-03-31T23:16:42.480938+0000","last_clean":"2024-03-31T23:16:42.480938+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:16:42.480938+0000","last_undegraded":"2024-03-31T23:16:42.480938+0000","last_fullsized":"2024-03-31T23:16:42.480938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.801044+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:17:10.801044+0000","last_peered":"2024-03-31T23:17:10.801044+0000","last_clean":"2024-03-31T23:17:10.801044+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:17:10.801044+0000","last_undegraded":"2024-03-31T23:17:10.801044+0000","last_fullsized":"2024-03-31T23:17:10.801044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473546+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:16:42.473546+0000","last_peered":"2024-03-31T23:16:42.473546+0000","last_clean":"2024-03-31T23:16:42.473546+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:16:42.473546+0000","last_undegraded":"2024-03-31T23:16:42.473546+0000","last_fullsized":"2024-03-31T23:16:42.473546+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:13.336192+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:17:13.336192+0000","last_peered":"2024-03-31T23:17:13.336192+0000","last_clean":"2024-03-31T23:17:13.336192+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:17:13.336192+0000","last_undegraded":"2024-03-31T23:17:13.336192+0000","last_fullsized":"2024-03-31T23:17:13.336192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63605,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":138,"num_write":40,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.774657+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:17:10.774657+0000","last_peered":"2024-03-31T23:17:10.774657+0000","last_clean":"2024-03-31T23:17:10.774657+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:17:10.774657+0000","last_undegraded":"2024-03-31T23:17:10.774657+0000","last_fullsized":"2024-03-31T23:17:10.774657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481225+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:16:42.481225+0000","last_peered":"2024-03-31T23:16:42.481225+0000","last_clean":"2024-03-31T23:16:42.481225+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:16:42.481225+0000","last_undegraded":"2024-03-31T23:16:42.481225+0000","last_fullsized":"2024-03-31T23:16:42.481225+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473915+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:16:42.473915+0000","last_peered":"2024-03-31T23:16:42.473915+0000","last_clean":"2024-03-31T23:16:42.473915+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:16:42.473915+0000","last_undegraded":"2024-03-31T23:16:42.473915+0000","last_fullsized":"2024-03-31T23:16:42.473915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.773018+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:17:10.773018+0000","last_peered":"2024-03-31T23:17:10.773018+0000","last_clean":"2024-03-31T23:17:10.773018+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:17:10.773018+0000","last_undegraded":"2024-03-31T23:17:10.773018+0000","last_fullsized":"2024-03-31T23:17:10.773018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477544+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:16:42.477544+0000","last_peered":"2024-03-31T23:16:42.477544+0000","last_clean":"2024-03-31T23:16:42.477544+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:16:42.477544+0000","last_undegraded":"2024-03-31T23:16:42.477544+0000","last_fullsized":"2024-03-31T23:16:42.477544+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.480884+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:16:42.480884+0000","last_peered":"2024-03-31T23:16:42.480884+0000","last_clean":"2024-03-31T23:16:42.480884+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:16:42.480884+0000","last_undegraded":"2024-03-31T23:16:42.480884+0000","last_fullsized":"2024-03-31T23:16:42.480884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.795451+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:17:10.795451+0000","last_peered":"2024-03-31T23:17:10.795451+0000","last_clean":"2024-03-31T23:17:10.795451+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:17:10.795451+0000","last_undegraded":"2024-03-31T23:17:10.795451+0000","last_fullsized":"2024-03-31T23:17:10.795451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474168+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:16:42.474168+0000","last_peered":"2024-03-31T23:16:42.474168+0000","last_clean":"2024-03-31T23:16:42.474168+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:16:42.474168+0000","last_undegraded":"2024-03-31T23:16:42.474168+0000","last_fullsized":"2024-03-31T23:16:42.474168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:11.338279+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:17:11.338279+0000","last_peered":"2024-03-31T23:17:11.338279+0000","last_clean":"2024-03-31T23:17:11.338279+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:17:11.338279+0000","last_undegraded":"2024-03-31T23:17:11.338279+0000","last_fullsized":"2024-03-31T23:17:11.338279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.793220+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:17:10.793220+0000","last_peered":"2024-03-31T23:17:10.793220+0000","last_clean":"2024-03-31T23:17:10.793220+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:17:10.793220+0000","last_undegraded":"2024-03-31T23:17:10.793220+0000","last_fullsized":"2024-03-31T23:17:10.793220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476530+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:16:42.476530+0000","last_peered":"2024-03-31T23:16:42.476530+0000","last_clean":"2024-03-31T23:16:42.476530+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:16:42.476530+0000","last_undegraded":"2024-03-31T23:16:42.476530+0000","last_fullsized":"2024-03-31T23:16:42.476530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475428+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:16:42.475428+0000","last_peered":"2024-03-31T23:16:42.475428+0000","last_clean":"2024-03-31T23:16:42.475428+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:16:42.475428+0000","last_undegraded":"2024-03-31T23:16:42.475428+0000","last_fullsized":"2024-03-31T23:16:42.475428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.785522+0000","last_change":"2024-03-31T23:16:42.520338+0000","last_active":"2024-03-31T23:17:10.785522+0000","last_peered":"2024-03-31T23:17:10.785522+0000","last_clean":"2024-03-31T23:17:10.785522+0000","last_became_active":"2024-03-31T23:16:42.519941+0000","last_became_peered":"2024-03-31T23:16:42.519941+0000","last_unstale":"2024-03-31T23:17:10.785522+0000","last_undegraded":"2024-03-31T23:17:10.785522+0000","last_fullsized":"2024-03-31T23:17:10.785522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:49:47.173204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.521195+0000","last_change":"2024-03-31T23:16:42.520660+0000","last_active":"2024-03-31T23:16:42.521195+0000","last_peered":"2024-03-31T23:16:42.521195+0000","last_clean":"2024-03-31T23:16:42.521195+0000","last_became_active":"2024-03-31T23:16:42.520061+0000","last_became_peered":"2024-03-31T23:16:42.520061+0000","last_unstale":"2024-03-31T23:16:42.521195+0000","last_undegraded":"2024-03-31T23:16:42.521195+0000","last_fullsized":"2024-03-31T23:16:42.521195+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:18:20.495238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.486599+0000","last_change":"2024-03-31T23:16:42.486185+0000","last_active":"2024-03-31T23:16:42.486599+0000","last_peered":"2024-03-31T23:16:42.486599+0000","last_clean":"2024-03-31T23:16:42.486599+0000","last_became_active":"2024-03-31T23:16:42.480591+0000","last_became_peered":"2024-03-31T23:16:42.480591+0000","last_unstale":"2024-03-31T23:16:42.486599+0000","last_undegraded":"2024-03-31T23:16:42.486599+0000","last_fullsized":"2024-03-31T23:16:42.486599+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:01:32.270666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.794145+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:17:10.794145+0000","last_peered":"2024-03-31T23:17:10.794145+0000","last_clean":"2024-03-31T23:17:10.794145+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:17:10.794145+0000","last_undegraded":"2024-03-31T23:17:10.794145+0000","last_fullsized":"2024-03-31T23:17:10.794145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.520508+0000","last_change":"2024-03-31T23:16:42.520508+0000","last_active":"2024-03-31T23:16:42.520508+0000","last_peered":"2024-03-31T23:16:42.520508+0000","last_clean":"2024-03-31T23:16:42.520508+0000","last_became_active":"2024-03-31T23:16:42.520076+0000","last_became_peered":"2024-03-31T23:16:42.520076+0000","last_unstale":"2024-03-31T23:16:42.520508+0000","last_undegraded":"2024-03-31T23:16:42.520508+0000","last_fullsized":"2024-03-31T23:16:42.520508+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:32:07.192476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473826+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:16:42.473826+0000","last_peered":"2024-03-31T23:16:42.473826+0000","last_clean":"2024-03-31T23:16:42.473826+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:16:42.473826+0000","last_undegraded":"2024-03-31T23:16:42.473826+0000","last_fullsized":"2024-03-31T23:16:42.473826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.779076+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:17:10.779076+0000","last_peered":"2024-03-31T23:17:10.779076+0000","last_clean":"2024-03-31T23:17:10.779076+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:17:10.779076+0000","last_undegraded":"2024-03-31T23:17:10.779076+0000","last_fullsized":"2024-03-31T23:17:10.779076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475695+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:16:42.475695+0000","last_peered":"2024-03-31T23:16:42.475695+0000","last_clean":"2024-03-31T23:16:42.475695+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:16:42.475695+0000","last_undegraded":"2024-03-31T23:16:42.475695+0000","last_fullsized":"2024-03-31T23:16:42.475695+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:11.337197+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:17:11.337197+0000","last_peered":"2024-03-31T23:17:11.337197+0000","last_clean":"2024-03-31T23:17:11.337197+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:17:11.337197+0000","last_undegraded":"2024-03-31T23:17:11.337197+0000","last_fullsized":"2024-03-31T23:17:11.337197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.767617+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:17:10.767617+0000","last_peered":"2024-03-31T23:17:10.767617+0000","last_clean":"2024-03-31T23:17:10.767617+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:17:10.767617+0000","last_undegraded":"2024-03-31T23:17:10.767617+0000","last_fullsized":"2024-03-31T23:17:10.767617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476808+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:16:42.476808+0000","last_peered":"2024-03-31T23:16:42.476808+0000","last_clean":"2024-03-31T23:16:42.476808+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:16:42.476808+0000","last_undegraded":"2024-03-31T23:16:42.476808+0000","last_fullsized":"2024-03-31T23:16:42.476808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790905+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:17:10.790905+0000","last_peered":"2024-03-31T23:17:10.790905+0000","last_clean":"2024-03-31T23:17:10.790905+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:17:10.790905+0000","last_undegraded":"2024-03-31T23:17:10.790905+0000","last_fullsized":"2024-03-31T23:17:10.790905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:11.336659+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:17:11.336659+0000","last_peered":"2024-03-31T23:17:11.336659+0000","last_clean":"2024-03-31T23:17:11.336659+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:17:11.336659+0000","last_undegraded":"2024-03-31T23:17:11.336659+0000","last_fullsized":"2024-03-31T23:17:11.336659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518722+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:16:42.518722+0000","last_peered":"2024-03-31T23:16:42.518722+0000","last_clean":"2024-03-31T23:16:42.518722+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:16:42.518722+0000","last_undegraded":"2024-03-31T23:16:42.518722+0000","last_fullsized":"2024-03-31T23:16:42.518722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.794862+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:17:10.794862+0000","last_peered":"2024-03-31T23:17:10.794862+0000","last_clean":"2024-03-31T23:17:10.794862+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:17:10.794862+0000","last_undegraded":"2024-03-31T23:17:10.794862+0000","last_fullsized":"2024-03-31T23:17:10.794862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473706+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:16:42.473706+0000","last_peered":"2024-03-31T23:16:42.473706+0000","last_clean":"2024-03-31T23:16:42.473706+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:16:42.473706+0000","last_undegraded":"2024-03-31T23:16:42.473706+0000","last_fullsized":"2024-03-31T23:16:42.473706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":363,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518203+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:16:42.518203+0000","last_peered":"2024-03-31T23:16:42.518203+0000","last_clean":"2024-03-31T23:16:42.518203+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:16:42.518203+0000","last_undegraded":"2024-03-31T23:16:42.518203+0000","last_fullsized":"2024-03-31T23:16:42.518203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481003+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:16:42.481003+0000","last_peered":"2024-03-31T23:16:42.481003+0000","last_clean":"2024-03-31T23:16:42.481003+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:16:42.481003+0000","last_undegraded":"2024-03-31T23:16:42.481003+0000","last_fullsized":"2024-03-31T23:16:42.481003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.778524+0000","last_change":"2024-03-31T23:16:42.478674+0000","last_active":"2024-03-31T23:17:10.778524+0000","last_peered":"2024-03-31T23:17:10.778524+0000","last_clean":"2024-03-31T23:17:10.778524+0000","last_became_active":"2024-03-31T23:16:42.478317+0000","last_became_peered":"2024-03-31T23:16:42.478317+0000","last_unstale":"2024-03-31T23:17:10.778524+0000","last_undegraded":"2024-03-31T23:17:10.778524+0000","last_fullsized":"2024-03-31T23:17:10.778524+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:43.917393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518200+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:16:42.518200+0000","last_peered":"2024-03-31T23:16:42.518200+0000","last_clean":"2024-03-31T23:16:42.518200+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:16:42.518200+0000","last_undegraded":"2024-03-31T23:16:42.518200+0000","last_fullsized":"2024-03-31T23:16:42.518200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477907+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:16:42.477907+0000","last_peered":"2024-03-31T23:16:42.477907+0000","last_clean":"2024-03-31T23:16:42.477907+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:16:42.477907+0000","last_undegraded":"2024-03-31T23:16:42.477907+0000","last_fullsized":"2024-03-31T23:16:42.477907+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476257+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:16:42.476257+0000","last_peered":"2024-03-31T23:16:42.476257+0000","last_clean":"2024-03-31T23:16:42.476257+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:16:42.476257+0000","last_undegraded":"2024-03-31T23:16:42.476257+0000","last_fullsized":"2024-03-31T23:16:42.476257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.778791+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:17:10.778791+0000","last_peered":"2024-03-31T23:17:10.778791+0000","last_clean":"2024-03-31T23:17:10.778791+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:17:10.778791+0000","last_undegraded":"2024-03-31T23:17:10.778791+0000","last_fullsized":"2024-03-31T23:17:10.778791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481672+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:16:42.481672+0000","last_peered":"2024-03-31T23:16:42.481672+0000","last_clean":"2024-03-31T23:16:42.481672+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:16:42.481672+0000","last_undegraded":"2024-03-31T23:16:42.481672+0000","last_fullsized":"2024-03-31T23:16:42.481672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474718+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:16:42.474718+0000","last_peered":"2024-03-31T23:16:42.474718+0000","last_clean":"2024-03-31T23:16:42.474718+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:16:42.474718+0000","last_undegraded":"2024-03-31T23:16:42.474718+0000","last_fullsized":"2024-03-31T23:16:42.474718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790974+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:17:10.790974+0000","last_peered":"2024-03-31T23:17:10.790974+0000","last_clean":"2024-03-31T23:17:10.790974+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:17:10.790974+0000","last_undegraded":"2024-03-31T23:17:10.790974+0000","last_fullsized":"2024-03-31T23:17:10.790974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473656+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:16:42.473656+0000","last_peered":"2024-03-31T23:16:42.473656+0000","last_clean":"2024-03-31T23:16:42.473656+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:16:42.473656+0000","last_undegraded":"2024-03-31T23:16:42.473656+0000","last_fullsized":"2024-03-31T23:16:42.473656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.474275+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:16:42.474275+0000","last_peered":"2024-03-31T23:16:42.474275+0000","last_clean":"2024-03-31T23:16:42.474275+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:16:42.474275+0000","last_undegraded":"2024-03-31T23:16:42.474275+0000","last_fullsized":"2024-03-31T23:16:42.474275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.784221+0000","last_change":"2024-03-31T23:16:42.479778+0000","last_active":"2024-03-31T23:17:10.784221+0000","last_peered":"2024-03-31T23:17:10.784221+0000","last_clean":"2024-03-31T23:17:10.784221+0000","last_became_active":"2024-03-31T23:16:42.479401+0000","last_became_peered":"2024-03-31T23:16:42.479401+0000","last_unstale":"2024-03-31T23:17:10.784221+0000","last_undegraded":"2024-03-31T23:17:10.784221+0000","last_fullsized":"2024-03-31T23:17:10.784221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:01:58.138818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473838+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:16:42.473838+0000","last_peered":"2024-03-31T23:16:42.473838+0000","last_clean":"2024-03-31T23:16:42.473838+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:16:42.473838+0000","last_undegraded":"2024-03-31T23:16:42.473838+0000","last_fullsized":"2024-03-31T23:16:42.473838+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518564+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:16:42.518564+0000","last_peered":"2024-03-31T23:16:42.518564+0000","last_clean":"2024-03-31T23:16:42.518564+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:16:42.518564+0000","last_undegraded":"2024-03-31T23:16:42.518564+0000","last_fullsized":"2024-03-31T23:16:42.518564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.744955+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:17:10.744955+0000","last_peered":"2024-03-31T23:17:10.744955+0000","last_clean":"2024-03-31T23:17:10.744955+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:17:10.744955+0000","last_undegraded":"2024-03-31T23:17:10.744955+0000","last_fullsized":"2024-03-31T23:17:10.744955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.483901+0000","last_change":"2024-03-31T23:16:42.483336+0000","last_active":"2024-03-31T23:16:42.483901+0000","last_peered":"2024-03-31T23:16:42.483901+0000","last_clean":"2024-03-31T23:16:42.483901+0000","last_became_active":"2024-03-31T23:16:42.482909+0000","last_became_peered":"2024-03-31T23:16:42.482909+0000","last_unstale":"2024-03-31T23:16:42.483901+0000","last_undegraded":"2024-03-31T23:16:42.483901+0000","last_fullsized":"2024-03-31T23:16:42.483901+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:38:02.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481767+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:16:42.481767+0000","last_peered":"2024-03-31T23:16:42.481767+0000","last_clean":"2024-03-31T23:16:42.481767+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:16:42.481767+0000","last_undegraded":"2024-03-31T23:16:42.481767+0000","last_fullsized":"2024-03-31T23:16:42.481767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.793596+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:17:10.793596+0000","last_peered":"2024-03-31T23:17:10.793596+0000","last_clean":"2024-03-31T23:17:10.793596+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:17:10.793596+0000","last_undegraded":"2024-03-31T23:17:10.793596+0000","last_fullsized":"2024-03-31T23:17:10.793596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473687+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:16:42.473687+0000","last_peered":"2024-03-31T23:16:42.473687+0000","last_clean":"2024-03-31T23:16:42.473687+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:16:42.473687+0000","last_undegraded":"2024-03-31T23:16:42.473687+0000","last_fullsized":"2024-03-31T23:16:42.473687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.490032+0000","last_change":"2024-03-31T23:16:42.489599+0000","last_active":"2024-03-31T23:16:42.490032+0000","last_peered":"2024-03-31T23:16:42.490032+0000","last_clean":"2024-03-31T23:16:42.490032+0000","last_became_active":"2024-03-31T23:16:42.483090+0000","last_became_peered":"2024-03-31T23:16:42.483090+0000","last_unstale":"2024-03-31T23:16:42.490032+0000","last_undegraded":"2024-03-31T23:16:42.490032+0000","last_fullsized":"2024-03-31T23:16:42.490032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:31:32.544161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.781044+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:17:10.781044+0000","last_peered":"2024-03-31T23:17:10.781044+0000","last_clean":"2024-03-31T23:17:10.781044+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:17:10.781044+0000","last_undegraded":"2024-03-31T23:17:10.781044+0000","last_fullsized":"2024-03-31T23:17:10.781044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.473756+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:16:42.473756+0000","last_peered":"2024-03-31T23:16:42.473756+0000","last_clean":"2024-03-31T23:16:42.473756+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:16:42.473756+0000","last_undegraded":"2024-03-31T23:16:42.473756+0000","last_fullsized":"2024-03-31T23:16:42.473756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.475454+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:16:42.475454+0000","last_peered":"2024-03-31T23:16:42.475454+0000","last_clean":"2024-03-31T23:16:42.475454+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:16:42.475454+0000","last_undegraded":"2024-03-31T23:16:42.475454+0000","last_fullsized":"2024-03-31T23:16:42.475454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.798008+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:17:10.798008+0000","last_peered":"2024-03-31T23:17:10.798008+0000","last_clean":"2024-03-31T23:17:10.798008+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:17:10.798008+0000","last_undegraded":"2024-03-31T23:17:10.798008+0000","last_fullsized":"2024-03-31T23:17:10.798008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.518562+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:16:42.518562+0000","last_peered":"2024-03-31T23:16:42.518562+0000","last_clean":"2024-03-31T23:16:42.518562+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:16:42.518562+0000","last_undegraded":"2024-03-31T23:16:42.518562+0000","last_fullsized":"2024-03-31T23:16:42.518562+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'7","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:13.339772+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:17:13.339772+0000","last_peered":"2024-03-31T23:17:13.339772+0000","last_clean":"2024-03-31T23:17:13.339772+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:17:13.339772+0000","last_undegraded":"2024-03-31T23:17:13.339772+0000","last_fullsized":"2024-03-31T23:17:13.339772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.798046+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:17:10.798046+0000","last_peered":"2024-03-31T23:17:10.798046+0000","last_clean":"2024-03-31T23:17:10.798046+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:17:10.798046+0000","last_undegraded":"2024-03-31T23:17:10.798046+0000","last_fullsized":"2024-03-31T23:17:10.798046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.477466+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:16:42.477466+0000","last_peered":"2024-03-31T23:16:42.477466+0000","last_clean":"2024-03-31T23:16:42.477466+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:16:42.477466+0000","last_undegraded":"2024-03-31T23:16:42.477466+0000","last_fullsized":"2024-03-31T23:16:42.477466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.481117+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:16:42.481117+0000","last_peered":"2024-03-31T23:16:42.481117+0000","last_clean":"2024-03-31T23:16:42.481117+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:16:42.481117+0000","last_undegraded":"2024-03-31T23:16:42.481117+0000","last_fullsized":"2024-03-31T23:16:42.481117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.789851+0000","last_change":"2024-03-31T23:15:33.851537+0000","last_active":"2024-03-31T23:17:10.789851+0000","last_peered":"2024-03-31T23:17:10.789851+0000","last_clean":"2024-03-31T23:17:10.789851+0000","last_became_active":"2024-03-31T23:15:33.851146+0000","last_became_peered":"2024-03-31T23:15:33.851146+0000","last_unstale":"2024-03-31T23:17:10.789851+0000","last_undegraded":"2024-03-31T23:17:10.789851+0000","last_fullsized":"2024-03-31T23:17:10.789851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:36:36.549600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.479631+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:16:42.479631+0000","last_peered":"2024-03-31T23:16:42.479631+0000","last_clean":"2024-03-31T23:16:42.479631+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:16:42.479631+0000","last_undegraded":"2024-03-31T23:16:42.479631+0000","last_fullsized":"2024-03-31T23:16:42.479631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:16:42.476420+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:16:42.476420+0000","last_peered":"2024-03-31T23:16:42.476420+0000","last_clean":"2024-03-31T23:16:42.476420+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:16:42.476420+0000","last_undegraded":"2024-03-31T23:16:42.476420+0000","last_fullsized":"2024-03-31T23:16:42.476420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.795545+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:17:10.795545+0000","last_peered":"2024-03-31T23:17:10.795545+0000","last_clean":"2024-03-31T23:17:10.795545+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:17:10.795545+0000","last_undegraded":"2024-03-31T23:17:10.795545+0000","last_fullsized":"2024-03-31T23:17:10.795545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.794299+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:17:10.794299+0000","last_peered":"2024-03-31T23:17:10.794299+0000","last_clean":"2024-03-31T23:17:10.794299+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:17:10.794299+0000","last_undegraded":"2024-03-31T23:17:10.794299+0000","last_fullsized":"2024-03-31T23:17:10.794299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.793541+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:17:10.793541+0000","last_peered":"2024-03-31T23:17:10.793541+0000","last_clean":"2024-03-31T23:17:10.793541+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:17:10.793541+0000","last_undegraded":"2024-03-31T23:17:10.793541+0000","last_fullsized":"2024-03-31T23:17:10.793541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790125+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:17:10.790125+0000","last_peered":"2024-03-31T23:17:10.790125+0000","last_clean":"2024-03-31T23:17:10.790125+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:17:10.790125+0000","last_undegraded":"2024-03-31T23:17:10.790125+0000","last_fullsized":"2024-03-31T23:17:10.790125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.775231+0000","last_change":"2024-03-31T23:16:42.480375+0000","last_active":"2024-03-31T23:17:10.775231+0000","last_peered":"2024-03-31T23:17:10.775231+0000","last_clean":"2024-03-31T23:17:10.775231+0000","last_became_active":"2024-03-31T23:16:42.480005+0000","last_became_peered":"2024-03-31T23:16:42.480005+0000","last_unstale":"2024-03-31T23:17:10.775231+0000","last_undegraded":"2024-03-31T23:17:10.775231+0000","last_fullsized":"2024-03-31T23:17:10.775231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:31:15.217708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.776645+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:17:10.776645+0000","last_peered":"2024-03-31T23:17:10.776645+0000","last_clean":"2024-03-31T23:17:10.776645+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:17:10.776645+0000","last_undegraded":"2024-03-31T23:17:10.776645+0000","last_fullsized":"2024-03-31T23:17:10.776645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.794221+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:17:10.794221+0000","last_peered":"2024-03-31T23:17:10.794221+0000","last_clean":"2024-03-31T23:17:10.794221+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:17:10.794221+0000","last_undegraded":"2024-03-31T23:17:10.794221+0000","last_fullsized":"2024-03-31T23:17:10.794221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.799282+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:17:10.799282+0000","last_peered":"2024-03-31T23:17:10.799282+0000","last_clean":"2024-03-31T23:17:10.799282+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:17:10.799282+0000","last_undegraded":"2024-03-31T23:17:10.799282+0000","last_fullsized":"2024-03-31T23:17:10.799282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.781439+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:17:10.781439+0000","last_peered":"2024-03-31T23:17:10.781439+0000","last_clean":"2024-03-31T23:17:10.781439+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:17:10.781439+0000","last_undegraded":"2024-03-31T23:17:10.781439+0000","last_fullsized":"2024-03-31T23:17:10.781439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.790324+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:17:10.790324+0000","last_peered":"2024-03-31T23:17:10.790324+0000","last_clean":"2024-03-31T23:17:10.790324+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:17:10.790324+0000","last_undegraded":"2024-03-31T23:17:10.790324+0000","last_fullsized":"2024-03-31T23:17:10.790324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.786792+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:17:10.786792+0000","last_peered":"2024-03-31T23:17:10.786792+0000","last_clean":"2024-03-31T23:17:10.786792+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:17:10.786792+0000","last_undegraded":"2024-03-31T23:17:10.786792+0000","last_fullsized":"2024-03-31T23:17:10.786792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.797335+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:17:10.797335+0000","last_peered":"2024-03-31T23:17:10.797335+0000","last_clean":"2024-03-31T23:17:10.797335+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:17:10.797335+0000","last_undegraded":"2024-03-31T23:17:10.797335+0000","last_fullsized":"2024-03-31T23:17:10.797335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.777665+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:17:10.777665+0000","last_peered":"2024-03-31T23:17:10.777665+0000","last_clean":"2024-03-31T23:17:10.777665+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:17:10.777665+0000","last_undegraded":"2024-03-31T23:17:10.777665+0000","last_fullsized":"2024-03-31T23:17:10.777665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-03-31T23:17:10.784802+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:17:10.784802+0000","last_peered":"2024-03-31T23:17:10.784802+0000","last_clean":"2024-03-31T23:17:10.784802+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:17:10.784802+0000","last_undegraded":"2024-03-31T23:17:10.784802+0000","last_fullsized":"2024-03-31T23:17:10.784802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71623,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":757,"num_read_kb":457,"num_write":254,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":214869,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383713,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":501979,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":1152378,"data_compressed":58082,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808875,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":505451,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070512,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":501711,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":1098903,"data_compressed":56475,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":496859,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":561245,"data_compressed":22219,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1028096,"data_stored":498847,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1089536,"data_stored":562778,"data_compressed":22219,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":496567,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920837,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1011712,"data_stored":501465,"data_compressed":20612,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":1093953,"data_compressed":56475,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65357,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66641,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65873,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:17:15.974 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-31T23:17:15.974 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-31T23:17:15.974 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-31T23:17:15.975 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph health --format=json 2024-03-31T23:17:16.218 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:16.596 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:16 smithi042 ceph-mon[32380]: pgmap v338: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-31T23:17:16.597 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:16 smithi042 ceph-mon[32380]: from='client.24956 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:16 smithi094 ceph-mon[36167]: pgmap v338: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-31T23:17:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:16 smithi094 ceph-mon[36167]: from='client.24956 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:16 smithi188 ceph-mon[36068]: pgmap v338: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-31T23:17:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:16 smithi188 ceph-mon[36068]: from='client.24956 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:17.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.916+0000 7f85cf1bf700 1 -- 172.21.15.42:0/1726256272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c80749b0 msgr2=0x7f85c8074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:17.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.916+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/1726256272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c80749b0 0x7f85c8074e30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009990 tx=0x7f85b4009ca0 comp rx=0 tx=0).stop 2024-03-31T23:17:17.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- 172.21.15.42:0/1726256272 shutdown_connections 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/1726256272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c8112ed0 0x7f85c81152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/1726256272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8076270 0x7f85c8074470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/1726256272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c80749b0 0x7f85c8074e30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- 172.21.15.42:0/1726256272 >> 172.21.15.42:0/1726256272 conn(0x7f85c8079370 msgr2=0x7f85c8079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- 172.21.15.42:0/1726256272 shutdown_connections 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- 172.21.15.42:0/1726256272 wait complete. 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 Processor -- start 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- start start 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c80749b0 0x7f85c819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c8076270 0x7f85c819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8112ed0 0x7f85c81a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:17.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8118c60 con 0x7f85c8076270 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8118ae0 con 0x7f85c8112ed0 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.917+0000 7f85cf1bf700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8118de0 con 0x7f85c80749b0 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85c7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c8076270 0x7f85c819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85c7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c8076270 0x7f85c819f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33544/0 (socket says 172.21.15.42:33544) 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c80749b0 0x7f85c819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85c7fff700 1 -- 172.21.15.42:0/181561749 learned_addr learned my addr 172.21.15.42:0/181561749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85cd75c700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8112ed0 0x7f85c81a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 -- 172.21.15.42:0/181561749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8112ed0 msgr2=0x7f85c81a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:17.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8112ed0 0x7f85c81a3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 -- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c8076270 msgr2=0x7f85c819f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c8076270 0x7f85c819f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 -- 172.21.15.42:0/181561749 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c81a4070 con 0x7f85c80749b0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85cd75c700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8112ed0 0x7f85c81a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85ccf5b700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c80749b0 0x7f85c819f0b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00e9f0 tx=0x7f85bc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00cb70 con 0x7f85c80749b0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c81a4360 con 0x7f85c80749b0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85bc00ee90 con 0x7f85c80749b0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.918+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc010430 con 0x7f85c80749b0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.919+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c81abbe0 con 0x7f85c80749b0 2024-03-31T23:17:17.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.919+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c8068f00 con 0x7f85c80749b0 2024-03-31T23:17:17.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.920+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f85bc003e90 con 0x7f85c80749b0 2024-03-31T23:17:17.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.921+0000 7f85c5ffb700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85b80a2530 0x7f85b80a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:17.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.921+0000 7f85c7fff700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85b80a2530 0x7f85b80a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:17.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.921+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f85bc0cec70 con 0x7f85c80749b0 2024-03-31T23:17:17.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.921+0000 7f85c7fff700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85b80a2530 0x7f85b80a49f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f85c8079b90 tx=0x7f85b4009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:17.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:17.926+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f85bc09ba70 con 0x7f85c80749b0 2024-03-31T23:17:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.178+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f85c81abe70 con 0x7f85c80749b0 2024-03-31T23:17:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.178+0000 7f85c5ffb700 1 -- 172.21.15.42:0/181561749 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f85bc09b370 con 0x7f85c80749b0 2024-03-31T23:17:18.179 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:18.179 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-31T23:17:18.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85b80a2530 msgr2=0x7f85b80a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:18.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85b80a2530 0x7f85b80a49f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f85c8079b90 tx=0x7f85b4009590 comp rx=0 tx=0).stop 2024-03-31T23:17:18.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c80749b0 msgr2=0x7f85c819f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:18.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c80749b0 0x7f85c819f0b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00e9f0 tx=0x7f85bc00ed00 comp rx=0 tx=0).stop 2024-03-31T23:17:18.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 shutdown_connections 2024-03-31T23:17:18.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f85b80a2530 0x7f85b80a49f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c80749b0 0x7f85c819f0b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85c8112ed0 0x7f85c81a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 --2- 172.21.15.42:0/181561749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85c8076270 0x7f85c819f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.180+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 >> 172.21.15.42:0/181561749 conn(0x7f85c8079370 msgr2=0x7f85c8111bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.181+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 shutdown_connections 2024-03-31T23:17:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.181+0000 7f85cf1bf700 1 -- 172.21.15.42:0/181561749 wait complete. 2024-03-31T23:17:18.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:18 smithi042 ceph-mon[32380]: pgmap v339: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-31T23:17:18.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:18 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/181561749' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-31T23:17:18.884 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-31T23:17:18.885 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:18.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:18 smithi094 ceph-mon[36167]: pgmap v339: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-31T23:17:18.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:18 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/181561749' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-31T23:17:18.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:18 smithi188 ceph-mon[36068]: pgmap v339: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-31T23:17:18.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:18 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/181561749' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-31T23:17:18.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 -- 172.21.15.42:0/3362395208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184100670 msgr2=0x7f2184100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 --2- 172.21.15.42:0/3362395208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184100670 0x7f2184100a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f217c009900 tx=0x7f217c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 -- 172.21.15.42:0/3362395208 shutdown_connections 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 --2- 172.21.15.42:0/3362395208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184102220 0x7f2184108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 --2- 172.21.15.42:0/3362395208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2184101860 0x7f2184101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 --2- 172.21.15.42:0/3362395208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184100670 0x7f2184100a90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 -- 172.21.15.42:0/3362395208 >> 172.21.15.42:0/3362395208 conn(0x7f21840fbbe0 msgr2=0x7f21840fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 -- 172.21.15.42:0/3362395208 shutdown_connections 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 -- 172.21.15.42:0/3362395208 wait complete. 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.990+0000 7f218c69d640 1 Processor -- start 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 -- start start 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2184100670 0x7f21841045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:18.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184101860 0x7f2184102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 0x7f2184103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f218410c3c0 con 0x7f2184102220 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f218410c240 con 0x7f2184101860 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218c69d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f218410c540 con 0x7f2184100670 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 0x7f2184103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f2189c38640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184101860 0x7f2184102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 0x7f2184103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33570/0 (socket says 172.21.15.42:33570) 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 -- 172.21.15.42:0/378423612 learned_addr learned my addr 172.21.15.42:0/378423612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218a439640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2184100670 0x7f21841045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 -- 172.21.15.42:0/378423612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2184100670 msgr2=0x7f21841045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2184100670 0x7f21841045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 -- 172.21.15.42:0/378423612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184101860 msgr2=0x7f2184102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184101860 0x7f2184102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:18.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 -- 172.21.15.42:0/378423612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2184103a40 con 0x7f2184102220 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f2189c38640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184101860 0x7f2184102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f218ac3a640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 0x7f2184103180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f217400efd0 tx=0x7f217400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174003b70 con 0x7f2184102220 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.991+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2174003d10 con 0x7f2184102220 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.992+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21841a1d00 con 0x7f2184102220 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.992+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174010a90 con 0x7f2184102220 2024-03-31T23:17:18.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.992+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21841a21d0 con 0x7f2184102220 2024-03-31T23:17:18.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.993+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21841a2400 con 0x7f2184102220 2024-03-31T23:17:18.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.993+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f2174004020 con 0x7f2184102220 2024-03-31T23:17:18.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.994+0000 7f21837fe640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f216c0a24a0 0x7f216c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:18.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.994+0000 7f218a439640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f216c0a24a0 0x7f216c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:18.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.994+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f21740cee90 con 0x7f2184102220 2024-03-31T23:17:18.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.995+0000 7f218a439640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f216c0a24a0 0x7f216c0a4960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f217c000c00 tx=0x7f217c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:18.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:18.999+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f217409bcf0 con 0x7f2184102220 2024-03-31T23:17:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.182+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21841a2790 con 0x7f2184102220 2024-03-31T23:17:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.184+0000 7f21837fe640 1 -- 172.21.15.42:0/378423612 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24590 (secure 0 0 0) 0x7f217409b5f0 con 0x7f2184102220 2024-03-31T23:17:19.185 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:19.185 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":91,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:16:42.470473+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f216c0a24a0 msgr2=0x7f216c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f216c0a24a0 0x7f216c0a4960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f217c000c00 tx=0x7f217c005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 msgr2=0x7f2184103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 0x7f2184103180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f217400efd0 tx=0x7f217400c6a0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 shutdown_connections 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f216c0a24a0 0x7f216c0a4960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2184102220 0x7f2184103180 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2184101860 0x7f2184102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 --2- 172.21.15.42:0/378423612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2184100670 0x7f21841045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 >> 172.21.15.42:0/378423612 conn(0x7f21840fbbe0 msgr2=0x7f21840689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 shutdown_connections 2024-03-31T23:17:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.186+0000 7f218c69d640 1 -- 172.21.15.42:0/378423612 wait complete. 2024-03-31T23:17:19.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:19.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 -- 172.21.15.42:0/2125388542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 msgr2=0x7fab0c101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 --2- 172.21.15.42:0/2125388542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 0x7fab0c101cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab00009900 tx=0x7fab0002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 -- 172.21.15.42:0/2125388542 shutdown_connections 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 --2- 172.21.15.42:0/2125388542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab0c102200 0x7fab0c108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 --2- 172.21.15.42:0/2125388542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 0x7fab0c101cc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 --2- 172.21.15.42:0/2125388542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 -- 172.21.15.42:0/2125388542 >> 172.21.15.42:0/2125388542 conn(0x7fab0c0fbbe0 msgr2=0x7fab0c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 -- 172.21.15.42:0/2125388542 shutdown_connections 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.304+0000 7fab132cd640 1 -- 172.21.15.42:0/2125388542 wait complete. 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 Processor -- start 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 -- start start 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 0x7fab0c19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab0c102200 0x7fab0c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10c3b0 con 0x7fab0c100650 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10c230 con 0x7fab0c102200 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab132cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10c530 con 0x7fab0c101840 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c06a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33590/0 (socket says 172.21.15.42:33590) 2024-03-31T23:17:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 -- 172.21.15.42:0/3818880178 learned_addr learned my addr 172.21.15.42:0/3818880178 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab10868640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 0x7fab0c19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab1186a640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab0c102200 0x7fab0c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 -- 172.21.15.42:0/3818880178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 msgr2=0x7fab0c19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 0x7fab0c19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 -- 172.21.15.42:0/3818880178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab0c102200 msgr2=0x7fab0c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab0c102200 0x7fab0c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.305+0000 7fab11069640 1 -- 172.21.15.42:0/3818880178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c19f710 con 0x7fab0c100650 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.306+0000 7fab11069640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c06a910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e9c0 tx=0x7fab0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.306+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0800cde0 con 0x7fab0c100650 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.306+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fab08010930 con 0x7fab0c100650 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.306+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c19fa00 con 0x7fab0c100650 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.306+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08018ab0 con 0x7fab0c100650 2024-03-31T23:17:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.306+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c19ff20 con 0x7fab0c100650 2024-03-31T23:17:19.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.307+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0c107970 con 0x7fab0c100650 2024-03-31T23:17:19.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.308+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fab0801f020 con 0x7fab0c100650 2024-03-31T23:17:19.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.308+0000 7faafe7fc640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faaf80a24a0 0x7faaf80a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.308+0000 7fab10868640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faaf80a24a0 0x7faaf80a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.309+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fab080cece0 con 0x7fab0c100650 2024-03-31T23:17:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.309+0000 7fab10868640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faaf80a24a0 0x7faaf80a4960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab0002c900 tx=0x7fab00005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.313+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fab0809bae0 con 0x7fab0c100650 2024-03-31T23:17:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.496+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab0c062350 con 0x7fab0c100650 2024-03-31T23:17:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.496+0000 7faafe7fc640 1 -- 172.21.15.42:0/3818880178 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fab0809b3e0 con 0x7fab0c100650 2024-03-31T23:17:19.497 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faaf80a24a0 msgr2=0x7faaf80a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faaf80a24a0 0x7faaf80a4960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab0002c900 tx=0x7fab00005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 msgr2=0x7fab0c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c06a910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e9c0 tx=0x7fab0800ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 shutdown_connections 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab0c102200 0x7fab0c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab0c101840 0x7fab0c19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faaf80a24a0 0x7faaf80a4960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 --2- 172.21.15.42:0/3818880178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab0c100650 0x7fab0c06a910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 >> 172.21.15.42:0/3818880178 conn(0x7fab0c0fbbe0 msgr2=0x7fab0c104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.498+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 shutdown_connections 2024-03-31T23:17:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.499+0000 7fab132cd640 1 -- 172.21.15.42:0/3818880178 wait complete. 2024-03-31T23:17:19.510 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 -- 172.21.15.42:0/2015655604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1006f0 msgr2=0x7fcf5c100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/2015655604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1006f0 0x7fcf5c100b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009ca0 tx=0x7fcf5802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 -- 172.21.15.42:0/2015655604 shutdown_connections 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/2015655604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/2015655604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf5c1018e0 0x7fcf5c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/2015655604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1006f0 0x7fcf5c100b10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 -- 172.21.15.42:0/2015655604 >> 172.21.15.42:0/2015655604 conn(0x7fcf5c0fbc60 msgr2=0x7fcf5c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 -- 172.21.15.42:0/2015655604 shutdown_connections 2024-03-31T23:17:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.616+0000 7fcf63cf4640 1 -- 172.21.15.42:0/2015655604 wait complete. 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 Processor -- start 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 -- start start 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf5c1006f0 0x7fcf5c06a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf5c1018e0 0x7fcf5c19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c10c430 con 0x7fcf5c1022a0 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c10c2b0 con 0x7fcf5c1006f0 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf63cf4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c10c5b0 con 0x7fcf5c1018e0 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33602/0 (socket says 172.21.15.42:33602) 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 -- 172.21.15.42:0/1156615546 learned_addr learned my addr 172.21.15.42:0/1156615546 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf6128f640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf5c1018e0 0x7fcf5c19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf61a90640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf5c1006f0 0x7fcf5c06a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 -- 172.21.15.42:0/1156615546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf5c1018e0 msgr2=0x7fcf5c19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf5c1018e0 0x7fcf5c19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 -- 172.21.15.42:0/1156615546 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf5c1006f0 msgr2=0x7fcf5c06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf5c1006f0 0x7fcf5c06a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.617+0000 7fcf62291640 1 -- 172.21.15.42:0/1156615546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c19f850 con 0x7fcf5c1022a0 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.618+0000 7fcf62291640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c19ef40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e970 tx=0x7fcf5400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.618+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400ccc0 con 0x7fcf5c1022a0 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.618+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcf5400ce60 con 0x7fcf5c1022a0 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.618+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c19fae0 con 0x7fcf5c1022a0 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.618+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54010690 con 0x7fcf5c1022a0 2024-03-31T23:17:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.618+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1a0030 con 0x7fcf5c1022a0 2024-03-31T23:17:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.619+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c107a10 con 0x7fcf5c1022a0 2024-03-31T23:17:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.620+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fcf540046c0 con 0x7fcf5c1022a0 2024-03-31T23:17:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.621+0000 7fcf52ffd640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf480a24a0 0x7fcf480a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.621+0000 7fcf61a90640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf480a24a0 0x7fcf480a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.621+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcf540cf000 con 0x7fcf5c1022a0 2024-03-31T23:17:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.621+0000 7fcf61a90640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf480a24a0 0x7fcf480a4960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcf5802c700 tx=0x7fcf58032670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:19.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.625+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcf54053280 con 0x7fcf5c1022a0 2024-03-31T23:17:19.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.806+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcf5c02d3c0 con 0x7fcf5c1022a0 2024-03-31T23:17:19.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.806+0000 7fcf52ffd640 1 -- 172.21.15.42:0/1156615546 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fcf5409be60 con 0x7fcf5c1022a0 2024-03-31T23:17:19.807 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:19.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf480a24a0 msgr2=0x7fcf480a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf480a24a0 0x7fcf480a4960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcf5802c700 tx=0x7fcf58032670 comp rx=0 tx=0).stop 2024-03-31T23:17:19.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 msgr2=0x7fcf5c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c19ef40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e970 tx=0x7fcf5400ed70 comp rx=0 tx=0).stop 2024-03-31T23:17:19.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 shutdown_connections 2024-03-31T23:17:19.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcf480a24a0 0x7fcf480a4960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf5c1022a0 0x7fcf5c19ef40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf5c1018e0 0x7fcf5c19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 --2- 172.21.15.42:0/1156615546 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf5c1006f0 0x7fcf5c06a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 >> 172.21.15.42:0/1156615546 conn(0x7fcf5c0fbc60 msgr2=0x7fcf5c104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 shutdown_connections 2024-03-31T23:17:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.808+0000 7fcf63cf4640 1 -- 172.21.15.42:0/1156615546 wait complete. 2024-03-31T23:17:19.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:19 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/378423612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:19.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:19 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3818880178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:19.820 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:17:19.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:19 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/378423612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:19.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:19 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3818880178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:19.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/1202093891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94101750 msgr2=0x7f6e94101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/1202093891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94101750 0x7f6e94101b70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009900 tx=0x7f6e9002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:19.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/1202093891 shutdown_connections 2024-03-31T23:17:19.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/1202093891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94103300 0x7f6e94109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/1202093891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94102940 0x7f6e94102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/1202093891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94101750 0x7f6e94101b70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/1202093891 >> 172.21.15.42:0/1202093891 conn(0x7f6e940fccc0 msgr2=0x7f6e940ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/1202093891 shutdown_connections 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.925+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/1202093891 wait complete. 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 Processor -- start 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 -- start start 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94101750 0x7f6e94197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94102940 0x7f6e94198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 0x7f6e9419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9410d4b0 con 0x7f6e94103300 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9410d330 con 0x7f6e94101750 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9c5ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9410d630 con 0x7f6e94102940 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9ab49640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 0x7f6e9419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e99b47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94102940 0x7f6e94198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9a348640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94101750 0x7f6e94197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9ab49640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 0x7f6e9419f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33628/0 (socket says 172.21.15.42:33628) 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.926+0000 7f6e9ab49640 1 -- 172.21.15.42:0/2341708292 learned_addr learned my addr 172.21.15.42:0/2341708292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e99b47640 1 -- 172.21.15.42:0/2341708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94101750 msgr2=0x7f6e94197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e99b47640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94101750 0x7f6e94197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e99b47640 1 -- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 msgr2=0x7f6e9419f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e99b47640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 0x7f6e9419f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e99b47640 1 -- 172.21.15.42:0/2341708292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9419f750 con 0x7f6e94102940 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e9a348640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94101750 0x7f6e94197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e9ab49640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 0x7f6e9419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e99b47640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94102940 0x7f6e94198070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400e9f0 tx=0x7f6e8400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400cd80 con 0x7f6e94102940 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9419fa40 con 0x7f6e94102940 2024-03-31T23:17:19.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e840035f0 con 0x7f6e94102940 2024-03-31T23:17:19.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84010650 con 0x7f6e94102940 2024-03-31T23:17:19.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.927+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9419ff90 con 0x7f6e94102940 2024-03-31T23:17:19.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.928+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e94108a70 con 0x7f6e94102940 2024-03-31T23:17:19.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.929+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f6e840037a0 con 0x7f6e94102940 2024-03-31T23:17:19.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.930+0000 7f6e8b7fe640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e800a24a0 0x7f6e800a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:19.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.930+0000 7f6e9a348640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e800a24a0 0x7f6e800a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:19.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.930+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6e840ced80 con 0x7f6e94102940 2024-03-31T23:17:19.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.930+0000 7f6e9a348640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e800a24a0 0x7f6e800a4960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e90005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:19.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:19.938+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6e8409bb80 con 0x7f6e94102940 2024-03-31T23:17:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:19 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/378423612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:19 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3818880178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.120+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e9402d3c0 con 0x7f6e94102940 2024-03-31T23:17:20.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.121+0000 7f6e8b7fe640 1 -- 172.21.15.42:0/2341708292 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f6e8409b480 con 0x7f6e94102940 2024-03-31T23:17:20.121 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e800a24a0 msgr2=0x7f6e800a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e800a24a0 0x7f6e800a4960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e90005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94102940 msgr2=0x7f6e94198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94102940 0x7f6e94198070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400e9f0 tx=0x7f6e8400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 shutdown_connections 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f6e800a24a0 0x7f6e800a4960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e94103300 0x7f6e9419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e94102940 0x7f6e94198070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 --2- 172.21.15.42:0/2341708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e94101750 0x7f6e94197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 >> 172.21.15.42:0/2341708292 conn(0x7f6e940fccc0 msgr2=0x7f6e94105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:20.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 shutdown_connections 2024-03-31T23:17:20.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.123+0000 7f6e9c5ac640 1 -- 172.21.15.42:0/2341708292 wait complete. 2024-03-31T23:17:20.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 -- 172.21.15.42:0/1802603857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 msgr2=0x7f29f8104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 --2- 172.21.15.42:0/1802603857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8104680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009900 tx=0x7f29ec02bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 -- 172.21.15.42:0/1802603857 shutdown_connections 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 --2- 172.21.15.42:0/1802603857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f81074f0 0x7f29f81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 --2- 172.21.15.42:0/1802603857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f8104bc0 0x7f29f8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 --2- 172.21.15.42:0/1802603857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8104680 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 -- 172.21.15.42:0/1802603857 >> 172.21.15.42:0/1802603857 conn(0x7f29f80fbc00 msgr2=0x7f29f80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 -- 172.21.15.42:0/1802603857 shutdown_connections 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.240+0000 7f29fec88640 1 -- 172.21.15.42:0/1802603857 wait complete. 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 Processor -- start 2024-03-31T23:17:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 -- start start 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f8104bc0 0x7f29f819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f81074f0 0x7f29f81a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f29f810d4f0 con 0x7f29f8102290 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29f810d370 con 0x7f29f81074f0 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fec88640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f29f810d670 con 0x7f29f8104bc0 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33656/0 (socket says 172.21.15.42:33656) 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 -- 172.21.15.42:0/1341882377 learned_addr learned my addr 172.21.15.42:0/1341882377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29f7fff640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f8104bc0 0x7f29f819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fd225640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f81074f0 0x7f29f81a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 -- 172.21.15.42:0/1341882377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f8104bc0 msgr2=0x7f29f819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f8104bc0 0x7f29f819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 -- 172.21.15.42:0/1341882377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f81074f0 msgr2=0x7f29f81a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f81074f0 0x7f29f81a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 -- 172.21.15.42:0/1341882377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f81a1a10 con 0x7f29f8102290 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.241+0000 7f29fca24640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8199df0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009230 tx=0x7f29ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.242+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec043020 con 0x7f29f8102290 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.242+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29ec004250 con 0x7f29f8102290 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.242+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f81a1ca0 con 0x7f29f8102290 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.242+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec003b50 con 0x7f29f8102290 2024-03-31T23:17:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.242+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f81a2190 con 0x7f29f8102290 2024-03-31T23:17:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.243+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f8108fe0 con 0x7f29f8102290 2024-03-31T23:17:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.244+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f29ec046020 con 0x7f29f8102290 2024-03-31T23:17:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.244+0000 7f29f5ffb640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29e80a2520 0x7f29e80a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.244+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f29ec0f0ed0 con 0x7f29f8102290 2024-03-31T23:17:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.244+0000 7f29f7fff640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29e80a2520 0x7f29e80a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.245+0000 7f29f7fff640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29e80a2520 0x7f29e80a49e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29f819b300 tx=0x7f29e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.248+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f29ec04d020 con 0x7f29f8102290 2024-03-31T23:17:20.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.430+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f29f802d170 con 0x7f29f8102290 2024-03-31T23:17:20.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.431+0000 7f29f5ffb640 1 -- 172.21.15.42:0/1341882377 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f29ec0bdd30 con 0x7f29f8102290 2024-03-31T23:17:20.431 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:20.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29e80a2520 msgr2=0x7f29e80a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29e80a2520 0x7f29e80a49e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29f819b300 tx=0x7f29e4005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 msgr2=0x7f29f8199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8199df0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009230 tx=0x7f29ec004ab0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 shutdown_connections 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f81074f0 0x7f29f81a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f8104bc0 0x7f29f819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29e80a2520 0x7f29e80a49e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 --2- 172.21.15.42:0/1341882377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8102290 0x7f29f8199df0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 >> 172.21.15.42:0/1341882377 conn(0x7f29f80fbc00 msgr2=0x7f29f8101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 shutdown_connections 2024-03-31T23:17:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.433+0000 7f29fec88640 1 -- 172.21.15.42:0/1341882377 wait complete. 2024-03-31T23:17:20.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:17:20.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 -- 172.21.15.42:0/1431212626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8102220 msgr2=0x7fb3c8108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/1431212626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8102220 0x7fb3c8108ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009ca0 tx=0x7fb3b802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 -- 172.21.15.42:0/1431212626 shutdown_connections 2024-03-31T23:17:20.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/1431212626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8102220 0x7fb3c8108ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/1431212626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8101860 0x7fb3c8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/1431212626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8100670 0x7fb3c8100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 -- 172.21.15.42:0/1431212626 >> 172.21.15.42:0/1431212626 conn(0x7fb3c80fbbe0 msgr2=0x7fb3c80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:20.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 -- 172.21.15.42:0/1431212626 shutdown_connections 2024-03-31T23:17:20.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.546+0000 7fb3ccb99640 1 -- 172.21.15.42:0/1431212626 wait complete. 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 Processor -- start 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 -- start start 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8100670 0x7fb3c8197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8101860 0x7fb3c8198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 0x7fb3c819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810c420 con 0x7fb3c8102220 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810c2a0 con 0x7fb3c8101860 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3ccb99640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810c5a0 con 0x7fb3c8100670 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c6d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 0x7fb3c819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c6d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 0x7fb3c819f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33672/0 (socket says 172.21.15.42:33672) 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c659c640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8100670 0x7fb3c8197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c6d9d640 1 -- 172.21.15.42:0/4004407730 learned_addr learned my addr 172.21.15.42:0/4004407730 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c5d9b640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8101860 0x7fb3c8198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c659c640 1 -- 172.21.15.42:0/4004407730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8101860 msgr2=0x7fb3c8198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c659c640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8101860 0x7fb3c8198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c659c640 1 -- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 msgr2=0x7fb3c819f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c659c640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 0x7fb3c819f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.547+0000 7fb3c659c640 1 -- 172.21.15.42:0/4004407730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c819f720 con 0x7fb3c8100670 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3c6d9d640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 0x7fb3c819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3c5d9b640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8101860 0x7fb3c8198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3c659c640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8100670 0x7fb3c8197b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000e9c0 tx=0x7fb3c000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000cd80 con 0x7fb3c8100670 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c819fa10 con 0x7fb3c8100670 2024-03-31T23:17:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3c0010930 con 0x7fb3c8100670 2024-03-31T23:17:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0018a30 con 0x7fb3c8100670 2024-03-31T23:17:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.548+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c819ff60 con 0x7fb3c8100670 2024-03-31T23:17:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.549+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c81a0190 con 0x7fb3c8100670 2024-03-31T23:17:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.550+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fb3c001f020 con 0x7fb3c8100670 2024-03-31T23:17:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.550+0000 7fb3bf7fe640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb3b40a24a0 0x7fb3b40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.551+0000 7fb3c5d9b640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb3b40a24a0 0x7fb3b40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.551+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb3c00cf0a0 con 0x7fb3c8100670 2024-03-31T23:17:20.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.551+0000 7fb3c5d9b640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb3b40a24a0 0x7fb3b40a4960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8199010 tx=0x7fb3b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:20.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.558+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb3c009bea0 con 0x7fb3c8100670 2024-03-31T23:17:20.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.781+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3c81a0360 con 0x7fb3c8100670 2024-03-31T23:17:20.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.782+0000 7fb3bf7fe640 1 -- 172.21.15.42:0/4004407730 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7fb3c009b7a0 con 0x7fb3c8100670 2024-03-31T23:17:20.783 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:20.783 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:16:02.248954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24472,24497,24464,24454,24442]},"id":1}]} 2024-03-31T23:17:20.784 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:17:20.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb3b40a24a0 msgr2=0x7fb3b40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb3b40a24a0 0x7fb3b40a4960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8199010 tx=0x7fb3b0005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:20.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8100670 msgr2=0x7fb3c8197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8100670 0x7fb3c8197b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000e9c0 tx=0x7fb3c000ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 shutdown_connections 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb3b40a24a0 0x7fb3b40a4960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3c8102220 0x7fb3c819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3c8101860 0x7fb3c8198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 --2- 172.21.15.42:0/4004407730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c8100670 0x7fb3c8197b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 >> 172.21.15.42:0/4004407730 conn(0x7fb3c80fbbe0 msgr2=0x7fb3c80fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 shutdown_connections 2024-03-31T23:17:20.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.784+0000 7fb3ccb99640 1 -- 172.21.15.42:0/4004407730 wait complete. 2024-03-31T23:17:20.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:20 smithi042 ceph-mon[32380]: pgmap v340: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-31T23:17:20.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:20 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1156615546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:20 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2341708292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:20 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1341882377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:20.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:20 smithi188 ceph-mon[36068]: pgmap v340: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-31T23:17:20.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:20 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1156615546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:20 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2341708292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:20 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1341882377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- 172.21.15.42:0/4042957274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 msgr2=0x7f1138108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- 172.21.15.42:0/4042957274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138108ba0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1130009ca0 tx=0x7f113002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- 172.21.15.42:0/4042957274 shutdown_connections 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- 172.21.15.42:0/4042957274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138108ba0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- 172.21.15.42:0/4042957274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 0x7f1138100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- 172.21.15.42:0/4042957274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1138101c10 0x7f1138102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- 172.21.15.42:0/4042957274 >> 172.21.15.42:0/4042957274 conn(0x7f11380fb370 msgr2=0x7f11380fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- 172.21.15.42:0/4042957274 shutdown_connections 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- 172.21.15.42:0/4042957274 wait complete. 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 Processor -- start 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- start start 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 0x7f1138197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1138101c10 0x7f113819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f113810d540 con 0x7f1138101300 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f113810d3c0 con 0x7f1138100940 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f113f0c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f113810d6c0 con 0x7f1138101c10 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.899+0000 7f1137fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f113ce5c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 0x7f1138197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33692/0 (socket says 172.21.15.42:33692) 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 -- 172.21.15.42:0/708379035 learned_addr learned my addr 172.21.15.42:0/708379035 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f113d65d640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1138101c10 0x7f113819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 -- 172.21.15.42:0/708379035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1138101c10 msgr2=0x7f113819f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1138101c10 0x7f113819f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 -- 172.21.15.42:0/708379035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 msgr2=0x7f1138197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 0x7f1138197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 -- 172.21.15.42:0/708379035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113819f710 con 0x7f1138101300 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f113ce5c640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 0x7f1138197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1137fff640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138198030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f112400ea60 tx=0x7f112400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112400cde0 con 0x7f1138101300 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11240035f0 con 0x7f1138101300 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113819fa00 con 0x7f1138101300 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124010720 con 0x7f1138101300 2024-03-31T23:17:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.900+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113819ffa0 con 0x7f1138101300 2024-03-31T23:17:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.901+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1138107a20 con 0x7f1138101300 2024-03-31T23:17:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.902+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f11240037a0 con 0x7f1138101300 2024-03-31T23:17:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.903+0000 7f1135ffb640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11280a2520 0x7f11280a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.903+0000 7f113ce5c640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11280a2520 0x7f11280a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.903+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f11240ced90 con 0x7f1138101300 2024-03-31T23:17:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.904+0000 7f113ce5c640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11280a2520 0x7f11280a49e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1138069b80 tx=0x7f112c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:20.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:20.908+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f112409bbf0 con 0x7f1138101300 2024-03-31T23:17:20.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:20 smithi094 ceph-mon[36167]: pgmap v340: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-31T23:17:20.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:20 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1156615546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:20 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2341708292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:20.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:20 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1341882377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.091+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1138062350 con 0x7f1138101300 2024-03-31T23:17:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.093+0000 7f1135ffb640 1 -- 172.21.15.42:0/708379035 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24590 (secure 0 0 0) 0x7f112409b4f0 con 0x7f1138101300 2024-03-31T23:17:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:21.094 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":91,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:16:42.470473+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11280a2520 msgr2=0x7f11280a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11280a2520 0x7f11280a49e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1138069b80 tx=0x7f112c005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 msgr2=0x7f1138198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138198030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f112400ea60 tx=0x7f112400ef20 comp rx=0 tx=0).stop 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 shutdown_connections 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1138101c10 0x7f113819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f11280a2520 0x7f11280a49e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138101300 0x7f1138198030 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 --2- 172.21.15.42:0/708379035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1138100940 0x7f1138197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 >> 172.21.15.42:0/708379035 conn(0x7f11380fb370 msgr2=0x7f1138104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 shutdown_connections 2024-03-31T23:17:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.095+0000 7f113f0c0640 1 -- 172.21.15.42:0/708379035 wait complete. 2024-03-31T23:17:21.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:21.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 -- 172.21.15.42:0/846593527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120101750 msgr2=0x7f3120101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 --2- 172.21.15.42:0/846593527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120101750 0x7f3120101b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3114009900 tx=0x7f311402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 -- 172.21.15.42:0/846593527 shutdown_connections 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 --2- 172.21.15.42:0/846593527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3120103300 0x7f3120109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 --2- 172.21.15.42:0/846593527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120102940 0x7f3120102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 --2- 172.21.15.42:0/846593527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120101750 0x7f3120101b70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 -- 172.21.15.42:0/846593527 >> 172.21.15.42:0/846593527 conn(0x7f31200fccc0 msgr2=0x7f31200ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 -- 172.21.15.42:0/846593527 shutdown_connections 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.214+0000 7f3126f13640 1 -- 172.21.15.42:0/846593527 wait complete. 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 Processor -- start 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 -- start start 2024-03-31T23:17:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120101750 0x7f3120075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 0x7f3120073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3120103300 0x7f3120074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f312010d4b0 con 0x7f3120102940 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f312010d330 con 0x7f3120101750 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3126f13640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f312010d630 con 0x7f3120103300 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 0x7f3120073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3124caf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120101750 0x7f3120075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 0x7f3120073b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33718/0 (socket says 172.21.15.42:33718) 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 -- 172.21.15.42:0/1287000124 learned_addr learned my addr 172.21.15.42:0/1287000124 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f31254b0640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3120103300 0x7f3120074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 -- 172.21.15.42:0/1287000124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3120103300 msgr2=0x7f3120074080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3120103300 0x7f3120074080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 -- 172.21.15.42:0/1287000124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120101750 msgr2=0x7f3120075500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120101750 0x7f3120075500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 -- 172.21.15.42:0/1287000124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3120074910 con 0x7f3120102940 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f3124caf640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120101750 0x7f3120075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.215+0000 7f311ffff640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 0x7f3120073b40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f310c00ea60 tx=0x7f310c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.216+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c00cde0 con 0x7f3120102940 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.216+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31201a1c40 con 0x7f3120102940 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.216+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f310c0035f0 con 0x7f3120102940 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.216+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c010720 con 0x7f3120102940 2024-03-31T23:17:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.216+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31201a2190 con 0x7f3120102940 2024-03-31T23:17:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.217+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3120108af0 con 0x7f3120102940 2024-03-31T23:17:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.218+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f310c0037a0 con 0x7f3120102940 2024-03-31T23:17:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.218+0000 7f311dffb640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f31100a24a0 0x7f31100a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.219+0000 7f3124caf640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f31100a24a0 0x7f31100a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.219+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f310c0cef00 con 0x7f3120102940 2024-03-31T23:17:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.219+0000 7f3124caf640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f31100a24a0 0x7f31100a4960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3114000c00 tx=0x7f3114005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.223+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f310c09bd00 con 0x7f3120102940 2024-03-31T23:17:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.405+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3120062350 con 0x7f3120102940 2024-03-31T23:17:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.405+0000 7f311dffb640 1 -- 172.21.15.42:0/1287000124 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f310c09b600 con 0x7f3120102940 2024-03-31T23:17:21.406 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f31100a24a0 msgr2=0x7f31100a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f31100a24a0 0x7f31100a4960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3114000c00 tx=0x7f3114005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 msgr2=0x7f3120073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 0x7f3120073b40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f310c00ea60 tx=0x7f310c00ef20 comp rx=0 tx=0).stop 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 shutdown_connections 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3120103300 0x7f3120074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f31100a24a0 0x7f31100a4960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3120102940 0x7f3120073b40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 --2- 172.21.15.42:0/1287000124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3120101750 0x7f3120075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 >> 172.21.15.42:0/1287000124 conn(0x7f31200fccc0 msgr2=0x7f3120105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 shutdown_connections 2024-03-31T23:17:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.407+0000 7f3126f13640 1 -- 172.21.15.42:0/1287000124 wait complete. 2024-03-31T23:17:21.419 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:17:21.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/2641690503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 msgr2=0x7f5fbc106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/2641690503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc106ef0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009900 tx=0x7f5fb002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:21.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/2641690503 shutdown_connections 2024-03-31T23:17:21.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/2641690503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fbc107430 0x7f5fbc109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/2641690503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc106ef0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/2641690503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fbc1021d0 0x7f5fbc1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/2641690503 >> 172.21.15.42:0/2641690503 conn(0x7f5fbc0fbbe0 msgr2=0x7f5fbc0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:21.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/2641690503 shutdown_connections 2024-03-31T23:17:21.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.524+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/2641690503 wait complete. 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 Processor -- start 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 -- start start 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fbc1021d0 0x7f5fbc197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fbc107430 0x7f5fbc19f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10d4b0 con 0x7f5fbc104b00 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10d330 con 0x7f5fbc1021d0 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc3cc2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10d630 con 0x7f5fbc107430 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc125d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc125d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc1980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33732/0 (socket says 172.21.15.42:33732) 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc125d640 1 -- 172.21.15.42:0/697491006 learned_addr learned my addr 172.21.15.42:0/697491006 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc1a5e640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fbc1021d0 0x7f5fbc197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.525+0000 7f5fc225f640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fbc107430 0x7f5fbc19f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc125d640 1 -- 172.21.15.42:0/697491006 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fbc107430 msgr2=0x7f5fbc19f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc125d640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fbc107430 0x7f5fbc19f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc125d640 1 -- 172.21.15.42:0/697491006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fbc1021d0 msgr2=0x7f5fbc197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc125d640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fbc1021d0 0x7f5fbc197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc125d640 1 -- 172.21.15.42:0/697491006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc19f7d0 con 0x7f5fbc104b00 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc125d640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc1980f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0000c00 tx=0x7f5fb0004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0043020 con 0x7f5fbc104b00 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fb0004250 con 0x7f5fbc104b00 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc19fa60 con 0x7f5fbc104b00 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0003b90 con 0x7f5fbc104b00 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.526+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc19ffb0 con 0x7f5fbc104b00 2024-03-31T23:17:21.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.527+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc0fd6d0 con 0x7f5fbc104b00 2024-03-31T23:17:21.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.528+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f5fb0046020 con 0x7f5fbc104b00 2024-03-31T23:17:21.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.529+0000 7f5fbaffd640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fa40a24a0 0x7f5fa40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.529+0000 7f5fc1a5e640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fa40a24a0 0x7f5fa40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.529+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5fb00f0b40 con 0x7f5fbc104b00 2024-03-31T23:17:21.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.529+0000 7f5fc1a5e640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fa40a24a0 0x7f5fa40a4960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009bd0 tx=0x7f5fb4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.533+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5fb004d020 con 0x7f5fbc104b00 2024-03-31T23:17:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.719+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5fbc062350 con 0x7f5fbc104b00 2024-03-31T23:17:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.720+0000 7f5fbaffd640 1 -- 172.21.15.42:0/697491006 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f5fb00bd9a0 con 0x7f5fbc104b00 2024-03-31T23:17:21.721 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fa40a24a0 msgr2=0x7f5fa40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fa40a24a0 0x7f5fa40a4960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009bd0 tx=0x7f5fb4005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 msgr2=0x7f5fbc1980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc1980f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0000c00 tx=0x7f5fb0004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 shutdown_connections 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5fbc107430 0x7f5fbc19f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5fa40a24a0 0x7f5fa40a4960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fbc104b00 0x7f5fbc1980f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 --2- 172.21.15.42:0/697491006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fbc1021d0 0x7f5fbc197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 >> 172.21.15.42:0/697491006 conn(0x7f5fbc0fbbe0 msgr2=0x7f5fbc102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:21.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 shutdown_connections 2024-03-31T23:17:21.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.722+0000 7f5fc3cc2640 1 -- 172.21.15.42:0/697491006 wait complete. 2024-03-31T23:17:21.733 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:21 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4004407730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:21.733 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:21 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/708379035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:21.733 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:21 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1287000124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:21.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 -- 172.21.15.42:0/2383408484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f700ffdf0 msgr2=0x7f8f70100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 --2- 172.21.15.42:0/2383408484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f700ffdf0 0x7f8f70100210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009ca0 tx=0x7f8f6002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 -- 172.21.15.42:0/2383408484 shutdown_connections 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 --2- 172.21.15.42:0/2383408484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f701019a0 0x7f8f70108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 --2- 172.21.15.42:0/2383408484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f70100fe0 0x7f8f70101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 --2- 172.21.15.42:0/2383408484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f700ffdf0 0x7f8f70100210 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 -- 172.21.15.42:0/2383408484 >> 172.21.15.42:0/2383408484 conn(0x7f8f700fb360 msgr2=0x7f8f700fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 -- 172.21.15.42:0/2383408484 shutdown_connections 2024-03-31T23:17:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 -- 172.21.15.42:0/2383408484 wait complete. 2024-03-31T23:17:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.839+0000 7f8f7503b640 1 Processor -- start 2024-03-31T23:17:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 -- start start 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f700ffdf0 0x7f8f70199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 0x7f8f7019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f701019a0 0x7f8f701a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7010c430 con 0x7f8f70100fe0 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7010c2b0 con 0x7f8f700ffdf0 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f7503b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7010c5b0 con 0x7f8f701019a0 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 0x7f8f7019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 0x7f8f7019a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33752/0 (socket says 172.21.15.42:33752) 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 -- 172.21.15.42:0/3833186835 learned_addr learned my addr 172.21.15.42:0/3833186835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6ed9d640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f700ffdf0 0x7f8f70199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6f59e640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f701019a0 0x7f8f701a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 -- 172.21.15.42:0/3833186835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f701019a0 msgr2=0x7f8f701a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f701019a0 0x7f8f701a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 -- 172.21.15.42:0/3833186835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f700ffdf0 msgr2=0x7f8f70199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f700ffdf0 0x7f8f70199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 -- 172.21.15.42:0/3833186835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f701a19d0 con 0x7f8f70100fe0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6ed9d640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f700ffdf0 0x7f8f70199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.840+0000 7f8f6e59c640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 0x7f8f7019a300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9f0 tx=0x7f8f5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.841+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800ccc0 con 0x7f8f70100fe0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.841+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f701a1cc0 con 0x7f8f70100fe0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.841+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f5800ce60 con 0x7f8f70100fe0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.841+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58010690 con 0x7f8f70100fe0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.841+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f701a2190 con 0x7f8f70100fe0 2024-03-31T23:17:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.842+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f701a2360 con 0x7f8f70100fe0 2024-03-31T23:17:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.843+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f8f580046c0 con 0x7f8f70100fe0 2024-03-31T23:17:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.843+0000 7f8f67fff640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f5c0a24a0 0x7f8f5c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.843+0000 7f8f6ed9d640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f5c0a24a0 0x7f8f5c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.843+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8f580ceef0 con 0x7f8f70100fe0 2024-03-31T23:17:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.844+0000 7f8f6ed9d640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f5c0a24a0 0x7f8f5c0a4960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f6002c630 tx=0x7f8f60009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:21.848+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8f5809bd50 con 0x7f8f70100fe0 2024-03-31T23:17:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:21 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/4004407730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:21 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/708379035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:21 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1287000124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:21 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/4004407730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:21 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/708379035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:21 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1287000124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.030+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8f701a2530 con 0x7f8f70100fe0 2024-03-31T23:17:22.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.030+0000 7f8f67fff640 1 -- 172.21.15.42:0/3833186835 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f8f5809b650 con 0x7f8f70100fe0 2024-03-31T23:17:22.031 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f5c0a24a0 msgr2=0x7f8f5c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f5c0a24a0 0x7f8f5c0a4960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f6002c630 tx=0x7f8f60009360 comp rx=0 tx=0).stop 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 msgr2=0x7f8f7019a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 0x7f8f7019a300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9f0 tx=0x7f8f5800edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 shutdown_connections 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f701019a0 0x7f8f701a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8f5c0a24a0 0x7f8f5c0a4960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f70100fe0 0x7f8f7019a300 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 --2- 172.21.15.42:0/3833186835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f700ffdf0 0x7f8f70199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 >> 172.21.15.42:0/3833186835 conn(0x7f8f700fb360 msgr2=0x7f8f700fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:22.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 shutdown_connections 2024-03-31T23:17:22.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.032+0000 7f8f7503b640 1 -- 172.21.15.42:0/3833186835 wait complete. 2024-03-31T23:17:22.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:17:22.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 -- 172.21.15.42:0/2206185178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230101770 msgr2=0x7f7230101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 --2- 172.21.15.42:0/2206185178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230101770 0x7f7230101b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7220009900 tx=0x7f722002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 -- 172.21.15.42:0/2206185178 shutdown_connections 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 --2- 172.21.15.42:0/2206185178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230103320 0x7f7230109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 --2- 172.21.15.42:0/2206185178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 0x7f7230102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 --2- 172.21.15.42:0/2206185178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230101770 0x7f7230101b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 -- 172.21.15.42:0/2206185178 >> 172.21.15.42:0/2206185178 conn(0x7f72300fcce0 msgr2=0x7f72300ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 -- 172.21.15.42:0/2206185178 shutdown_connections 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 -- 172.21.15.42:0/2206185178 wait complete. 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 Processor -- start 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.149+0000 7f72365e2640 1 -- start start 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230101770 0x7f7230075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 0x7f7230073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 0x7f7230074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f723010d4d0 con 0x7f7230103320 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f723010d350 con 0x7f7230101770 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f723010d650 con 0x7f7230102960 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 0x7f7230074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230101770 0x7f7230075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 0x7f7230073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 0x7f7230074080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33762/0 (socket says 172.21.15.42:33762) 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 -- 172.21.15.42:0/3722418283 learned_addr learned my addr 172.21.15.42:0/3722418283 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 -- 172.21.15.42:0/3722418283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 msgr2=0x7f7230073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 0x7f7230073b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 -- 172.21.15.42:0/3722418283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230101770 msgr2=0x7f7230075500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230101770 0x7f7230075500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 -- 172.21.15.42:0/3722418283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7230074910 con 0x7f7230103320 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722f7fe640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 0x7f7230073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722ffff640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230101770 0x7f7230075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f7234b7f640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 0x7f7230074080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f722800efd0 tx=0x7f722800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228003b70 con 0x7f7230103320 2024-03-31T23:17:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72301a1cb0 con 0x7f7230103320 2024-03-31T23:17:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7228003d10 con 0x7f7230103320 2024-03-31T23:17:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.150+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228010a90 con 0x7f7230103320 2024-03-31T23:17:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.151+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301a21b0 con 0x7f7230103320 2024-03-31T23:17:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.151+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7230108a90 con 0x7f7230103320 2024-03-31T23:17:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.153+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f7228004020 con 0x7f7230103320 2024-03-31T23:17:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.153+0000 7f722d7fa640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f721c0a24a0 0x7f721c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.153+0000 7f722ffff640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f721c0a24a0 0x7f721c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.153+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f72280ceed0 con 0x7f7230103320 2024-03-31T23:17:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.154+0000 7f722ffff640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f721c0a24a0 0x7f721c0a4960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7220000c00 tx=0x7f7220005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.158+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f722809bd30 con 0x7f7230103320 2024-03-31T23:17:22.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.343+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f72300623f0 con 0x7f7230103320 2024-03-31T23:17:22.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.343+0000 7f722d7fa640 1 -- 172.21.15.42:0/3722418283 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f722809b630 con 0x7f7230103320 2024-03-31T23:17:22.344 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f721c0a24a0 msgr2=0x7f721c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f721c0a24a0 0x7f721c0a4960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7220000c00 tx=0x7f7220005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 msgr2=0x7f7230074080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 0x7f7230074080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f722800efd0 tx=0x7f722800c6a0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 shutdown_connections 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f721c0a24a0 0x7f721c0a4960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230103320 0x7f7230074080 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7230102960 0x7f7230073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 --2- 172.21.15.42:0/3722418283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7230101770 0x7f7230075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 >> 172.21.15.42:0/3722418283 conn(0x7f72300fcce0 msgr2=0x7f7230105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 shutdown_connections 2024-03-31T23:17:22.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.346+0000 7f72365e2640 1 -- 172.21.15.42:0/3722418283 wait complete. 2024-03-31T23:17:22.358 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.460+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2321640947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8102980 msgr2=0x7f78f8102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.460+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2321640947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8102980 0x7f78f8102e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009900 tx=0x7f78e002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2321640947 shutdown_connections 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2321640947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78f8103340 0x7f78f8109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2321640947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8102980 0x7f78f8102e00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2321640947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f8101790 0x7f78f8101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2321640947 >> 172.21.15.42:0/2321640947 conn(0x7f78f80fcd00 msgr2=0x7f78f80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2321640947 shutdown_connections 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2321640947 wait complete. 2024-03-31T23:17:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 Processor -- start 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- start start 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 0x7f78f8197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f8102980 0x7f78f81980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78f8103340 0x7f78f819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810d4f0 con 0x7f78f8101790 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810d370 con 0x7f78f8102980 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.461+0000 7f78fc8cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810d670 con 0x7f78f8103340 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 0x7f78f8197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 0x7f78f8197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33774/0 (socket says 172.21.15.42:33774) 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 -- 172.21.15.42:0/2674658953 learned_addr learned my addr 172.21.15.42:0/2674658953 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f8102980 0x7f78f81980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f6d9d640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78f8103340 0x7f78f819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 -- 172.21.15.42:0/2674658953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78f8103340 msgr2=0x7f78f819f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78f8103340 0x7f78f819f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 -- 172.21.15.42:0/2674658953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f8102980 msgr2=0x7f78f81980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f8102980 0x7f78f81980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 -- 172.21.15.42:0/2674658953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f819f7b0 con 0x7f78f8101790 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78f659c640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 0x7f78f8197b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f78f000e9c0 tx=0x7f78f000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f000cde0 con 0x7f78f8101790 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f819faa0 con 0x7f78f8101790 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78f0010930 con 0x7f78f8101790 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0018a60 con 0x7f78f8101790 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.462+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f81a0010 con 0x7f78f8101790 2024-03-31T23:17:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.463+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f8108ab0 con 0x7f78f8101790 2024-03-31T23:17:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.464+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f78f001f020 con 0x7f78f8101790 2024-03-31T23:17:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.465+0000 7f78ef7fe640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78e40a24a0 0x7f78e40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.465+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78e40a24a0 0x7f78e40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.465+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f78f00cf1e0 con 0x7f78f8101790 2024-03-31T23:17:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.465+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78e40a24a0 0x7f78e40a4960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78e002c900 tx=0x7f78e0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:22.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.468+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f78f009c040 con 0x7f78f8101790 2024-03-31T23:17:22.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.692+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78f802d170 con 0x7f78f8101790 2024-03-31T23:17:22.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.693+0000 7f78ef7fe640 1 -- 172.21.15.42:0/2674658953 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f78f009b940 con 0x7f78f8101790 2024-03-31T23:17:22.694 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:22.694 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:16:02.248954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24472,24497,24464,24454,24442]},"id":1}]} 2024-03-31T23:17:22.694 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78e40a24a0 msgr2=0x7f78e40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78e40a24a0 0x7f78e40a4960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78e002c900 tx=0x7f78e0005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 msgr2=0x7f78f8197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 0x7f78f8197b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f78f000e9c0 tx=0x7f78f000ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 shutdown_connections 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78f8103340 0x7f78f819f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f8102980 0x7f78f81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78e40a24a0 0x7f78e40a4960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 --2- 172.21.15.42:0/2674658953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f8101790 0x7f78f8197b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 >> 172.21.15.42:0/2674658953 conn(0x7f78f80fcd00 msgr2=0x7f78f8105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 shutdown_connections 2024-03-31T23:17:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.695+0000 7f78fc8cd640 1 -- 172.21.15.42:0/2674658953 wait complete. 2024-03-31T23:17:22.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:22 smithi042 ceph-mon[32380]: pgmap v341: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-31T23:17:22.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:22 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/697491006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:22 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3833186835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:22 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3722418283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.707 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3279297522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 msgr2=0x7f0a14100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3279297522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a14100aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009900 tx=0x7f09fc02bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3279297522 shutdown_connections 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3279297522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a14102230 0x7f0a14108ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3279297522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a14101870 0x7f0a14101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3279297522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a14100aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3279297522 >> 172.21.15.42:0/3279297522 conn(0x7f0a140fbc30 msgr2=0x7f0a140fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3279297522 shutdown_connections 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3279297522 wait complete. 2024-03-31T23:17:22.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.810+0000 7f0a1a0cd640 1 Processor -- start 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 -- start start 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a1406a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a14101870 0x7f0a1419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a14102230 0x7f0a1419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1410c3e0 con 0x7f0a14100680 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1410c260 con 0x7f0a14102230 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a1a0cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1410c560 con 0x7f0a14101870 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a1406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a1406a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33802/0 (socket says 172.21.15.42:33802) 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 -- 172.21.15.42:0/3520459034 learned_addr learned my addr 172.21.15.42:0/3520459034 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a12ffd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a14101870 0x7f0a1419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a13fff640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a14102230 0x7f0a1419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 -- 172.21.15.42:0/3520459034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a14101870 msgr2=0x7f0a1419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a14101870 0x7f0a1419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 -- 172.21.15.42:0/3520459034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a14102230 msgr2=0x7f0a1419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a14102230 0x7f0a1419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 -- 172.21.15.42:0/3520459034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1419f800 con 0x7f0a14100680 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.811+0000 7f0a137fe640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a1406a930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f09fc000c00 tx=0x7f09fc004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.812+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc043020 con 0x7f0a14100680 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.812+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1419fa30 con 0x7f0a14100680 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.812+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f09fc004250 con 0x7f0a14100680 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.812+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc003b20 con 0x7f0a14100680 2024-03-31T23:17:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.812+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1419ff80 con 0x7f0a14100680 2024-03-31T23:17:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.813+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a14068990 con 0x7f0a14100680 2024-03-31T23:17:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.814+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f09fc046020 con 0x7f0a14100680 2024-03-31T23:17:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.814+0000 7f0a10ff9640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0a000a24a0 0x7f0a000a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.814+0000 7f0a12ffd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0a000a24a0 0x7f0a000a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.814+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f09fc0f11b0 con 0x7f0a14100680 2024-03-31T23:17:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.815+0000 7f0a12ffd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0a000a24a0 0x7f0a000a4960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a1406a6a0 tx=0x7f0a04005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:22.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:22.818+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f09fc04d020 con 0x7f0a14100680 2024-03-31T23:17:22.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:22 smithi094 ceph-mon[36167]: pgmap v341: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-31T23:17:22.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:22 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/697491006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:22 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3833186835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:22 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3722418283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:22 smithi188 ceph-mon[36068]: pgmap v341: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-31T23:17:22.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:22 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/697491006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:22 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3833186835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:22.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:22 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3722418283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:23.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.001+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a141079a0 con 0x7f0a14100680 2024-03-31T23:17:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.002+0000 7f0a10ff9640 1 -- 172.21.15.42:0/3520459034 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24590 (secure 0 0 0) 0x7f0a141079a0 con 0x7f0a14100680 2024-03-31T23:17:23.003 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:23.004 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":91,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:16:42.470473+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0a000a24a0 msgr2=0x7f0a000a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0a000a24a0 0x7f0a000a4960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a1406a6a0 tx=0x7f0a04005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 msgr2=0x7f0a1406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a1406a930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f09fc000c00 tx=0x7f09fc004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 shutdown_connections 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a14102230 0x7f0a1419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a14101870 0x7f0a1419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0a000a24a0 0x7f0a000a4960 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 --2- 172.21.15.42:0/3520459034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a14100680 0x7f0a1406a930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 >> 172.21.15.42:0/3520459034 conn(0x7f0a140fbc30 msgr2=0x7f0a14104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 shutdown_connections 2024-03-31T23:17:23.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.005+0000 7f0a1a0cd640 1 -- 172.21.15.42:0/3520459034 wait complete. 2024-03-31T23:17:23.018 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:17:23.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 -- 172.21.15.42:0/3702087653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0150104b20 msgr2=0x7f0150106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 --2- 172.21.15.42:0/3702087653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0150104b20 0x7f0150106f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0140009900 tx=0x7f014002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:23.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 -- 172.21.15.42:0/3702087653 shutdown_connections 2024-03-31T23:17:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 --2- 172.21.15.42:0/3702087653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0150107450 0x7f01501098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 --2- 172.21.15.42:0/3702087653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0150104b20 0x7f0150106f10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 --2- 172.21.15.42:0/3702087653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01501021f0 0x7f01501045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 -- 172.21.15.42:0/3702087653 >> 172.21.15.42:0/3702087653 conn(0x7f01500fbbe0 msgr2=0x7f01500fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 -- 172.21.15.42:0/3702087653 shutdown_connections 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.120+0000 7f0157548640 1 -- 172.21.15.42:0/3702087653 wait complete. 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 Processor -- start 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 -- start start 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01501021f0 0x7f0150197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 0x7f0150198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0150107450 0x7f015019f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f015010d4d0 con 0x7f0150104b20 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f015010d350 con 0x7f01501021f0 2024-03-31T23:17:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0157548640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f015010d650 con 0x7f0150107450 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 0x7f0150198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 0x7f0150198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33812/0 (socket says 172.21.15.42:33812) 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 -- 172.21.15.42:0/3232477303 learned_addr learned my addr 172.21.15.42:0/3232477303 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f01552e4640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01501021f0 0x7f0150197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0155ae5640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0150107450 0x7f015019f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 -- 172.21.15.42:0/3232477303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0150107450 msgr2=0x7f015019f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0150107450 0x7f015019f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 -- 172.21.15.42:0/3232477303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01501021f0 msgr2=0x7f0150197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01501021f0 0x7f0150197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f0154ae3640 1 -- 172.21.15.42:0/3232477303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015019f760 con 0x7f0150104b20 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.121+0000 7f01552e4640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01501021f0 0x7f0150197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.122+0000 7f0154ae3640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 0x7f0150198080 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0140000c00 tx=0x7f0140004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.122+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140043020 con 0x7f0150104b20 2024-03-31T23:17:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.122+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015019f9f0 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.122+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0140004250 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.122+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140003b90 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.122+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015019ff40 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.123+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01500fd6d0 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.124+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f0140046020 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.124+0000 7f01467fc640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f013c0a24a0 0x7f013c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.124+0000 7f01552e4640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f013c0a24a0 0x7f013c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.124+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f01400f0b40 con 0x7f0150104b20 2024-03-31T23:17:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.125+0000 7f01552e4640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f013c0a24a0 0x7f013c0a4960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f014c009fc0 tx=0x7f014c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.129+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f014004d020 con 0x7f0150104b20 2024-03-31T23:17:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.351+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f015002d170 con 0x7f0150104b20 2024-03-31T23:17:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.352+0000 7f01467fc640 1 -- 172.21.15.42:0/3232477303 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f01400bd9a0 con 0x7f0150104b20 2024-03-31T23:17:23.353 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:23.353 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:16:02.248954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24472,24497,24464,24454,24442]},"id":1}]} 2024-03-31T23:17:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:17:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f013c0a24a0 msgr2=0x7f013c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f013c0a24a0 0x7f013c0a4960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f014c009fc0 tx=0x7f014c005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 msgr2=0x7f0150198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 0x7f0150198080 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0140000c00 tx=0x7f0140004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 shutdown_connections 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0150107450 0x7f015019f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f013c0a24a0 0x7f013c0a4960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0150104b20 0x7f0150198080 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 --2- 172.21.15.42:0/3232477303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01501021f0 0x7f0150197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 >> 172.21.15.42:0/3232477303 conn(0x7f01500fbbe0 msgr2=0x7f0150102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 shutdown_connections 2024-03-31T23:17:23.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.354+0000 7f0157548640 1 -- 172.21.15.42:0/3232477303 wait complete. 2024-03-31T23:17:23.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-31T23:15:33.212486+0000', 'modified': '2024-03-31T23:16:02.248954+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24472, 'mds_2': 24464, 'mds_3': 24454, 'mds_4': 24442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14634': {'gid': 14634, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6839/2174921226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 2174921226}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 2174921226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14646': {'gid': 14646, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6841/1878678856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6840', 'nonce': 1878678856}, {'type': 'v1', 'addr': '172.21.15.42:6841', 'nonce': 1878678856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24397': {'gid': 24397, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.188:6833/524584837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6832', 'nonce': 524584837}, {'type': 'v1', 'addr': '172.21.15.188:6833', 'nonce': 524584837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.94:6833/2977205291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6832', 'nonce': 2977205291}, {'type': 'v1', 'addr': '172.21.15.94:6833', 'nonce': 2977205291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.94:6835/1301341988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 1301341988}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 1301341988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.188:6835/2839339934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6834', 'nonce': 2839339934}, {'type': 'v1', 'addr': '172.21.15.188:6835', 'nonce': 2839339934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.188:6837/67113861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6836', 'nonce': 67113861}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 67113861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.94:6837/2576498268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 2576498268}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 2576498268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.188:6839/2041061045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6838', 'nonce': 2041061045}, {'type': 'v1', 'addr': '172.21.15.188:6839', 'nonce': 2041061045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6839/1375958649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 1375958649}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 1375958649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24472, 24497, 24464, 24454, 24442]} 2024-03-31T23:17:23.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-31T23:17:23.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-31T23:17:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 -- 172.21.15.42:0/2046627096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30101850 msgr2=0x7f2e30101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 --2- 172.21.15.42:0/2046627096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30101850 0x7f2e30101cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009900 tx=0x7f2e2002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 -- 172.21.15.42:0/2046627096 shutdown_connections 2024-03-31T23:17:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 --2- 172.21.15.42:0/2046627096 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30102210 0x7f2e30108aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 --2- 172.21.15.42:0/2046627096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30101850 0x7f2e30101cd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 --2- 172.21.15.42:0/2046627096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e30100660 0x7f2e30100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 -- 172.21.15.42:0/2046627096 >> 172.21.15.42:0/2046627096 conn(0x7f2e300fbbf0 msgr2=0x7f2e300fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 -- 172.21.15.42:0/2046627096 shutdown_connections 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.472+0000 7f2e3847c640 1 -- 172.21.15.42:0/2046627096 wait complete. 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 Processor -- start 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 -- start start 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 0x7f2e3006a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e30101850 0x7f2e3019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 0x7f2e3019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3010c3c0 con 0x7f2e30102210 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3010c240 con 0x7f2e30100660 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e3847c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3010c540 con 0x7f2e30101850 2024-03-31T23:17:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 0x7f2e3019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36218640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 0x7f2e3006a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 0x7f2e3019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33828/0 (socket says 172.21.15.42:33828) 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 -- 172.21.15.42:0/4240220760 learned_addr learned my addr 172.21.15.42:0/4240220760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36218640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 0x7f2e3006a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33562/0 (socket says 172.21.15.42:33562) 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e35a17640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e30101850 0x7f2e3019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 -- 172.21.15.42:0/4240220760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e30101850 msgr2=0x7f2e3019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e30101850 0x7f2e3019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 -- 172.21.15.42:0/4240220760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 msgr2=0x7f2e3006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 0x7f2e3006a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 -- 172.21.15.42:0/4240220760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3019f810 con 0x7f2e30102210 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36218640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 0x7f2e3006a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.473+0000 7f2e36a19640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 0x7f2e3019ef00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800efd0 tx=0x7f2e2800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.474+0000 7f2e277fe640 1 -- 172.21.15.42:0/4240220760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28003b70 con 0x7f2e30102210 2024-03-31T23:17:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.474+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3019faa0 con 0x7f2e30102210 2024-03-31T23:17:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.474+0000 7f2e277fe640 1 -- 172.21.15.42:0/4240220760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e28003d10 con 0x7f2e30102210 2024-03-31T23:17:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.474+0000 7f2e277fe640 1 -- 172.21.15.42:0/4240220760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28010a90 con 0x7f2e30102210 2024-03-31T23:17:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.474+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3019ff70 con 0x7f2e30102210 2024-03-31T23:17:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.476+0000 7f2e277fe640 1 -- 172.21.15.42:0/4240220760 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f2e28004000 con 0x7f2e30102210 2024-03-31T23:17:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.476+0000 7f2e3b05c740 1 Processor -- start 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 -- start start 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca26317a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e277fe640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2e1c0a24a0 0x7f2e1c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26318c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca2631fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca2627baf0 con 0x55ca263187e0 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55ca262249d0 con 0x55ca263191a0 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ca26277b90 con 0x55ca26317610 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e35a17640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26318c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e35a17640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26318c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33832/0 (socket says 172.21.15.42:33832) 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36218640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2e1c0a24a0 0x7f2e1c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e35a17640 1 -- 172.21.15.42:0/1849695186 learned_addr learned my addr 172.21.15.42:0/1849695186 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca2631fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e277fe640 1 -- 172.21.15.42:0/4240220760 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2e280cef00 con 0x7f2e30102210 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e35a17640 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca26317a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 -- 172.21.15.42:0/1849695186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 msgr2=0x55ca26317a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca26317a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 -- 172.21.15.42:0/1849695186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 msgr2=0x55ca26318c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26318c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 -- 172.21.15.42:0/1849695186 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca25f902d0 con 0x55ca263191a0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36218640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2e1c0a24a0 0x7f2e1c0a4960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2e301016b0 tx=0x7f2e2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.477+0000 7f2e36a19640 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca2631fa30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e2809b360 tx=0x7f2e2801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea6d7187c4f8ded server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e24bfe640 1 -- 172.21.15.42:0/1849695186 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e280a0f40 con 0x55ca263191a0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e24bfe640 1 -- 172.21.15.42:0/1849695186 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e28009820 con 0x55ca263191a0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e24bfe640 1 -- 172.21.15.42:0/1849695186 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e280a1d50 con 0x55ca263191a0 2024-03-31T23:17:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1849695186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 msgr2=0x55ca2631fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca2631fa30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e2809b360 tx=0x7f2e2801c000 comp rx=0 tx=0).stop 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1849695186 shutdown_connections 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca2631fa30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26318c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1849695186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca26317a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.478+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1849695186 >> 172.21.15.42:0/1849695186 conn(0x55ca26312a00 msgr2=0x55ca26312e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1849695186 shutdown_connections 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1849695186 wait complete. 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 -- start start 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 Processor -- start 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26321940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263187e0 0x55ca26321e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26328ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca263201b0 con 0x55ca26317610 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55ca26237f70 con 0x55ca263191a0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ca26320330 con 0x55ca263187e0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e3b05c740 10 client.0 _ll_register_callbacks cb 0x55ca25f8fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e36218640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26321940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e35a17640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263187e0 0x55ca26321e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e36218640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26321940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33848/0 (socket says 172.21.15.42:33848) 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e36a19640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26328ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e36218640 1 -- 172.21.15.42:0/662069097 learned_addr learned my addr 172.21.15.42:0/662069097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e35a17640 1 -- 172.21.15.42:0/662069097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 msgr2=0x55ca26328ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e35a17640 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26328ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e35a17640 1 -- 172.21.15.42:0/662069097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 msgr2=0x55ca26321940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e35a17640 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26321940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e35a17640 1 -- 172.21.15.42:0/662069097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2605a6b0 con 0x55ca263187e0 2024-03-31T23:17:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.479+0000 7f2e36a19640 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26328ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e35a17640 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263187e0 0x55ca26321e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e2002ca30 tx=0x7f2e20003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66235ed59ff9bf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e19ffb640 1 -- 172.21.15.42:0/662069097 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2002cce0 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e28009820 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e19ffb640 1 -- 172.21.15.42:0/662069097 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2e20003990 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e19ffb640 1 -- 172.21.15.42:0/662069097 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e20051050 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e3b05c740 10 client.25021 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca2632bf60 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e19ffb640 1 -- 172.21.15.42:0/662069097 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e28009820 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e19ffb640 1 -- 172.21.15.42:0/662069097 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2e20034c80 con 0x55ca263187e0 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.480+0000 7f2e3b05c740 10 client.25021 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e3b05c740 10 client.25021 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e3b05c740 20 client.25021 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca2632e630 0x55ca2632faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e3b05c740 4 client.25021 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca26289030 con 0x55ca2632e630 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e36218640 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca2632e630 0x55ca2632faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e19ffb640 10 client.25021 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.481+0000 7f2e36218640 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca2632e630 0x55ca2632faa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5ae6a30c4c1beaf4 server_cookie=17ca7d6d7eb7a435 in_seq=0 out_seq=0 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e19ffb640 1 -- 172.21.15.42:0/662069097 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ca26289030 con 0x55ca2632e630 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e19ffb640 10 client.25021 handle_command_reply: tid=0 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 client.25021 shutdown 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263187e0 msgr2=0x55ca26321e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263187e0 0x55ca26321e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e2002ca30 tx=0x7f2e20003820 comp rx=0 tx=0).stop 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 shutdown_connections 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26328ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263187e0 0x55ca26321e80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca2632e630 0x55ca2632faa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/662069097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26321940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e19ffb640 0 client.25021 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 >> 172.21.15.42:0/662069097 conn(0x55ca26312a00 msgr2=0x55ca26311b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 shutdown_connections 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 1 -- 172.21.15.42:0/662069097 wait complete. 2024-03-31T23:17:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.482+0000 7f2e3b05c740 20 client.25021 trim_cache size 0 max 16384 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 Processor -- start 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 -- start start 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26312de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263187e0 0x55ca26328e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263191a0 0x55ca263112b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca2632dde0 con 0x55ca26317610 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55ca2632e4b0 con 0x55ca263187e0 2024-03-31T23:17:23.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.500+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ca2632eb80 con 0x55ca263191a0 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26312de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26312de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33856/0 (socket says 172.21.15.42:33856) 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 -- 172.21.15.42:0/1188872312 learned_addr learned my addr 172.21.15.42:0/1188872312 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e35a17640 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263187e0 0x55ca26328e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36a19640 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263191a0 0x55ca263112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 -- 172.21.15.42:0/1188872312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263191a0 msgr2=0x55ca263112b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263191a0 0x55ca263112b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 -- 172.21.15.42:0/1188872312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263187e0 msgr2=0x55ca26328e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263187e0 0x55ca26328e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 -- 172.21.15.42:0/1188872312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca26313770 con 0x55ca26317610 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e36218640 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26312de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55ca263301e0 tx=0x7f2e2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27480e2cba1589f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e1bfff640 1 -- 172.21.15.42:0/1188872312 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c02a670 con 0x55ca26317610 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e1bfff640 1 -- 172.21.15.42:0/1188872312 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e2c02a810 con 0x55ca26317610 2024-03-31T23:17:23.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.501+0000 7f2e1bfff640 1 -- 172.21.15.42:0/1188872312 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c027c40 con 0x55ca26317610 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1188872312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 msgr2=0x55ca26312de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26312de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55ca263301e0 tx=0x7f2e2c014000 comp rx=0 tx=0).stop 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1188872312 shutdown_connections 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca263191a0 0x55ca263112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263187e0 0x55ca26328e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/1188872312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca26317610 0x55ca26312de0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1188872312 >> 172.21.15.42:0/1188872312 conn(0x55ca26312a00 msgr2=0x55ca2631f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1188872312 shutdown_connections 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- 172.21.15.42:0/1188872312 wait complete. 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- start start 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 Processor -- start 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca263247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26324d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26327c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca2632f920 con 0x55ca263187e0 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55ca2632f250 con 0x55ca263191a0 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ca2632fff0 con 0x55ca26317610 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e3b05c740 10 client.0 _ll_register_callbacks cb 0x7f2e20004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e35a17640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26324d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e36218640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca263247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e36a19640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26327c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e36218640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca263247d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:54280/0 (socket says 172.21.15.42:54280) 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.502+0000 7f2e36218640 1 -- 172.21.15.42:0/3868607710 learned_addr learned my addr 172.21.15.42:0/3868607710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e36218640 1 -- 172.21.15.42:0/3868607710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 msgr2=0x55ca26327c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e36218640 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26327c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e36218640 1 -- 172.21.15.42:0/3868607710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 msgr2=0x55ca26324d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e36218640 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26324d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e36218640 1 -- 172.21.15.42:0/3868607710 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca26328260 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e35a17640 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26324d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e36218640 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca263247d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c02c040 tx=0x7f2e2c0056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6408b027dca8d0c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e19ffb640 1 -- 172.21.15.42:0/3868607710 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c02a670 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e2c02a810 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e19ffb640 1 -- 172.21.15.42:0/3868607710 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2e2c0279c0 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e19ffb640 1 -- 172.21.15.42:0/3868607710 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e2c042050 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e3b05c740 10 client.25027 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca26394520 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e19ffb640 1 -- 172.21.15.42:0/3868607710 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e2c02a810 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.503+0000 7f2e19ffb640 1 -- 172.21.15.42:0/3868607710 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2e2c034690 con 0x55ca26317610 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 10 client.25027 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 10 client.25027 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 20 client.25027 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca26398dc0 0x55ca26397ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 4 client.25027 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "status"}) -- 0x55ca26283380 con 0x55ca26398dc0 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e35a17640 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca26398dc0 0x55ca26397ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e19ffb640 10 client.25027 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e35a17640 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca26398dc0 0x55ca26397ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9c4ad3b5f7f9c078 server_cookie=32863beecb795736 in_seq=0 out_seq=0 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e19ffb640 1 -- 172.21.15.42:0/3868607710 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ca26283380 con 0x55ca26398dc0 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e19ffb640 10 client.25027 handle_command_reply: tid=0 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 client.25027 shutdown 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 msgr2=0x55ca263247d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca263247d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c02c040 tx=0x7f2e2c0056d0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 shutdown_connections 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ca263191a0 0x55ca26327c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55ca26398dc0 0x55ca26397ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca263187e0 0x55ca26324d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 --2- 172.21.15.42:0/3868607710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ca26317610 0x55ca263247d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e19ffb640 0 client.25027 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 >> 172.21.15.42:0/3868607710 conn(0x55ca26312a00 msgr2=0x55ca26315c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 shutdown_connections 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.504+0000 7f2e3b05c740 1 -- 172.21.15.42:0/3868607710 wait complete. 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3b05c740 20 client.25027 trim_cache size 0 max 16384 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24442, 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 82.258598722000002, 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 91, 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 132.02261277299999 2024-03-31T23:17:23.513 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2e1c0a24a0 msgr2=0x7f2e1c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2e1c0a24a0 0x7f2e1c0a4960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2e301016b0 tx=0x7f2e2c005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 msgr2=0x7f2e3019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 0x7f2e3019ef00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800efd0 tx=0x7f2e2800c6a0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 shutdown_connections 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f2e1c0a24a0 0x7f2e1c0a4960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e30102210 0x7f2e3019ef00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e30101850 0x7f2e3019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 --2- 172.21.15.42:0/4240220760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e30100660 0x7f2e3006a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 >> 172.21.15.42:0/4240220760 conn(0x7f2e300fbbf0 msgr2=0x7f2e30104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 shutdown_connections 2024-03-31T23:17:23.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.505+0000 7f2e3847c640 1 -- 172.21.15.42:0/4240220760 wait complete. 2024-03-31T23:17:23.517 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-31T23:17:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 -- 172.21.15.42:0/3974621456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268104a60 msgr2=0x7f7268106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- 172.21.15.42:0/3974621456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268104a60 0x7f7268106e50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7258009be0 tx=0x7f725802bef0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 -- 172.21.15.42:0/3974621456 shutdown_connections 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- 172.21.15.42:0/3974621456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7268107390 0x7f7268109780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- 172.21.15.42:0/3974621456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268104a60 0x7f7268106e50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- 172.21.15.42:0/3974621456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7268102130 0x7f7268104520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 -- 172.21.15.42:0/3974621456 >> 172.21.15.42:0/3974621456 conn(0x7f72680fbac0 msgr2=0x7f72680fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 -- 172.21.15.42:0/3974621456 shutdown_connections 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 -- 172.21.15.42:0/3974621456 wait complete. 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 Processor -- start 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 -- start start 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 0x7f7268197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7268104a60 0x7f7268197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.622+0000 7f726dba0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7268107390 0x7f726819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726dba0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f726810d400 con 0x7f7268102130 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726dba0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f726810d280 con 0x7f7268107390 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726dba0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f726810d580 con 0x7f7268104a60 2024-03-31T23:17:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 0x7f7268197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 0x7f7268197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49650/0 (socket says 172.21.15.42:49650) 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 -- 172.21.15.42:0/1711347370 learned_addr learned my addr 172.21.15.42:0/1711347370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f7267fff640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7268104a60 0x7f7268197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726d39f640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7268107390 0x7f726819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 -- 172.21.15.42:0/1711347370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7268104a60 msgr2=0x7f7268197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7268104a60 0x7f7268197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 -- 172.21.15.42:0/1711347370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7268107390 msgr2=0x7f726819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7268107390 0x7f726819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 -- 172.21.15.42:0/1711347370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726819f640 con 0x7f7268102130 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 0x7f7268197a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f726000e9c0 tx=0x7f726000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f7265ffb640 1 -- 172.21.15.42:0/1711347370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726000cd80 con 0x7f7268102130 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f7265ffb640 1 -- 172.21.15.42:0/1711347370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72600035f0 con 0x7f7268102130 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f7265ffb640 1 -- 172.21.15.42:0/1711347370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260010690 con 0x7f7268102130 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726819f930 con 0x7f7268102130 2024-03-31T23:17:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.623+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726819fe50 con 0x7f7268102130 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.626+0000 7f7265ffb640 1 -- 172.21.15.42:0/1711347370 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f72600037a0 con 0x7f7268102130 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.626+0000 7f72719e4740 1 Processor -- start 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.626+0000 7f72719e4740 1 -- start start 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f72719e4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b515fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f72719e4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fcdd0 0x558b515fd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f72719e4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fd790 0x558b51604020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f72719e4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b5155baf0 con 0x558b515fbc00 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f72719e4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x558b515049d0 con 0x558b515fcdd0 2024-03-31T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f72719e4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558b51557b90 con 0x558b515fd790 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f726d39f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b515fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f726cb9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fcdd0 0x558b515fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f726d39f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b515fc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49654/0 (socket says 172.21.15.42:49654) 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f726d39f640 1 -- 172.21.15.42:0/95010141 learned_addr learned my addr 172.21.15.42:0/95010141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7265ffb640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f72540a24a0 0x7f72540a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fd790 0x558b51604020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 -- 172.21.15.42:0/95010141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fcdd0 msgr2=0x558b515fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f726d39f640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f72540a24a0 0x7f72540a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fcdd0 0x558b515fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 -- 172.21.15.42:0/95010141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 msgr2=0x558b515fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b515fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7265ffb640 1 -- 172.21.15.42:0/1711347370 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f72600ced90 con 0x7f7268102130 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 -- 172.21.15.42:0/95010141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b512702d0 con 0x558b515fd790 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f7267fff640 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fd790 0x558b51604020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7258036040 tx=0x7f7258005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6c2841cddec125 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f725effd640 1 -- 172.21.15.42:0/95010141 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258043030 con 0x558b515fd790 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.627+0000 7f726d39f640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f72540a24a0 0x7f72540a4960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7250009fd0 tx=0x7f7250004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f725effd640 1 -- 172.21.15.42:0/95010141 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7258033c40 con 0x558b515fd790 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f725effd640 1 -- 172.21.15.42:0/95010141 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725802c960 con 0x558b515fd790 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 -- 172.21.15.42:0/95010141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fd790 msgr2=0x558b51604020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fd790 0x558b51604020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7258036040 tx=0x7f7258005ec0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 -- 172.21.15.42:0/95010141 shutdown_connections 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fd790 0x558b51604020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fcdd0 0x558b515fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 --2- 172.21.15.42:0/95010141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b515fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 -- 172.21.15.42:0/95010141 >> 172.21.15.42:0/95010141 conn(0x558b515f2be0 msgr2=0x558b515f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 -- 172.21.15.42:0/95010141 shutdown_connections 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 -- 172.21.15.42:0/95010141 wait complete. 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.628+0000 7f72719e4740 1 -- start start 2024-03-31T23:17:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 Processor -- start 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b51605e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b51606380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b51604740 con 0x558b515fbc00 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x558b51517f70 con 0x558b515fd790 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558b516048c0 con 0x558b515fcdd0 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f72719e4740 10 client.0 _ll_register_callbacks cb 0x558b5126fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b51605e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b51605e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49666/0 (socket says 172.21.15.42:49666) 2024-03-31T23:17:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 -- 172.21.15.42:0/1339226706 learned_addr learned my addr 172.21.15.42:0/1339226706 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f7267fff640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b51606380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726d39f640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 -- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 msgr2=0x558b51606380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b51606380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 -- 172.21.15.42:0/1339226706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 msgr2=0x558b5160d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.629+0000 7f726cb9e640 1 -- 172.21.15.42:0/1339226706 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b5133a6b0 con 0x558b515fbc00 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b51605e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f726000f010 tx=0x7f72600970b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba5e6eaa320c802 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f7247fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f7247fff640 1 -- 172.21.15.42:0/1339226706 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726009bb90 con 0x558b515fbc00 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f7247fff640 1 -- 172.21.15.42:0/1339226706 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f726009f170 con 0x558b515fbc00 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7258033c40 con 0x558b515fbc00 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f7247fff640 1 -- 172.21.15.42:0/1339226706 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f72600b4200 con 0x558b515fbc00 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 10 client.15246 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b51610410 con 0x558b515fbc00 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f7247fff640 1 -- 172.21.15.42:0/1339226706 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7258033c40 con 0x558b515fbc00 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f7247fff640 1 -- 172.21.15.42:0/1339226706 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f726009a8e0 con 0x558b515fbc00 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 10 client.15246 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 10 client.15246 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 20 client.15246 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b51612a60 0x558b51613ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 4 client.15246 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.630+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b51569030 con 0x558b51612a60 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.631+0000 7f7267fff640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b51612a60 0x558b51613ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.631+0000 7f7267fff640 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b51612a60 0x558b51613ed0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ed7920322080aa2d server_cookie=21c2aabe5fa53ad9 in_seq=0 out_seq=0 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.631+0000 7f7247fff640 10 client.15246 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f7247fff640 1 -- 172.21.15.42:0/1339226706 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558b51569030 con 0x558b51612a60 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f7247fff640 10 client.15246 handle_command_reply: tid=0 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 client.15246 shutdown 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 msgr2=0x558b51605e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b51605e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f726000f010 tx=0x7f72600970b0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 shutdown_connections 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b51612a60 0x558b51613ed0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b51606380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 --2- 172.21.15.42:0/1339226706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fbc00 0x558b51605e40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f7247fff640 0 client.15246 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 >> 172.21.15.42:0/1339226706 conn(0x558b515f2be0 msgr2=0x558b515f1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 shutdown_connections 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 1 -- 172.21.15.42:0/1339226706 wait complete. 2024-03-31T23:17:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.632+0000 7f72719e4740 20 client.15246 trim_cache size 0 max 16384 2024-03-31T23:17:23.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 Processor -- start 2024-03-31T23:17:23.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 -- start start 2024-03-31T23:17:23.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fbc00 0x558b51605a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b5160d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 0x558b51605f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b51612210 con 0x558b515fd790 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x558b516128e0 con 0x558b515fbc00 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f72719e4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558b51612fb0 con 0x558b515fcdd0 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 0x558b51605f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f7267fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b5160d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 0x558b51605f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49678/0 (socket says 172.21.15.42:49678) 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 -- 172.21.15.42:0/2364054218 learned_addr learned my addr 172.21.15.42:0/2364054218 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726cb9e640 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fbc00 0x558b51605a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 -- 172.21.15.42:0/2364054218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 msgr2=0x558b5160d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b5160d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 -- 172.21.15.42:0/2364054218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fbc00 msgr2=0x558b51605a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fbc00 0x558b51605a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.650+0000 7f726d39f640 1 -- 172.21.15.42:0/2364054218 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b515fc850 con 0x558b515fd790 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f726d39f640 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 0x558b51605f90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7250003ea0 tx=0x7f7250009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1974d87a2859ac server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f725e7fc640 1 -- 172.21.15.42:0/2364054218 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250027020 con 0x558b515fd790 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f725e7fc640 1 -- 172.21.15.42:0/2364054218 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7250010b30 con 0x558b515fd790 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f725e7fc640 1 -- 172.21.15.42:0/2364054218 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250023c10 con 0x558b515fd790 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 -- 172.21.15.42:0/2364054218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 msgr2=0x558b51605f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 0x558b51605f90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7250003ea0 tx=0x7f7250009880 comp rx=0 tx=0).stop 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 -- 172.21.15.42:0/2364054218 shutdown_connections 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fd790 0x558b51605f90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fcdd0 0x558b5160d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 --2- 172.21.15.42:0/2364054218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fbc00 0x558b51605a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 -- 172.21.15.42:0/2364054218 >> 172.21.15.42:0/2364054218 conn(0x558b515f2be0 msgr2=0x558b515f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 -- 172.21.15.42:0/2364054218 shutdown_connections 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.651+0000 7f72719e4740 1 -- 172.21.15.42:0/2364054218 wait complete. 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 -- start start 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 Processor -- start 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fbc00 0x558b516093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 0x558b516098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b51613d50 con 0x558b515fcdd0 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x558b51613680 con 0x558b515fd790 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558b51614420 con 0x558b515fbc00 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f72719e4740 10 client.0 _ll_register_callbacks cb 0x7f72600046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 0x558b516098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f726cb9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fbc00 0x558b516093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 0x558b516098f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49690/0 (socket says 172.21.15.42:49690) 2024-03-31T23:17:23.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 -- 172.21.15.42:0/1694751292 learned_addr learned my addr 172.21.15.42:0/1694751292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f726d39f640 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 -- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fbc00 msgr2=0x558b516093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fbc00 0x558b516093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 -- 172.21.15.42:0/1694751292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 msgr2=0x558b5160c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.652+0000 7f7267fff640 1 -- 172.21.15.42:0/1694751292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b5160cf00 con 0x558b515fcdd0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7267fff640 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 0x558b516098f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x558b515f3b50 tx=0x7f7258009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa635f301a71cfd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7247fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7247fff640 1 -- 172.21.15.42:0/1694751292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258043040 con 0x558b515fcdd0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7250010b30 con 0x558b515fcdd0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7247fff640 1 -- 172.21.15.42:0/1694751292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f72580335f0 con 0x558b515fcdd0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7247fff640 1 -- 172.21.15.42:0/1694751292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f725805e050 con 0x558b515fcdd0 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 10 client.15252 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b51679150 con 0x558b515fcdd0 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7247fff640 1 -- 172.21.15.42:0/1694751292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7250010b30 con 0x558b515fcdd0 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f7247fff640 1 -- 172.21.15.42:0/1694751292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7258052070 con 0x558b515fcdd0 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 10 client.15252 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 10 client.15252 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 20 client.15252 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b5167d910 0x558b5167c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 4 client.15252 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.653+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "status"}) -- 0x558b51563380 con 0x558b5167d910 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b5167d910 0x558b5167c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f726cb9e640 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b5167d910 0x558b5167c620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e23fec659c76000d server_cookie=70c681da2dd5d2f0 in_seq=0 out_seq=0 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f7247fff640 10 client.15252 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f7247fff640 1 -- 172.21.15.42:0/1694751292 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558b51563380 con 0x558b5167d910 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f7247fff640 10 client.15252 handle_command_reply: tid=0 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 client.15252 shutdown 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 msgr2=0x558b516098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 0x558b516098f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x558b515f3b50 tx=0x7f7258009840 comp rx=0 tx=0).stop 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 shutdown_connections 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x558b5167d910 0x558b5167c620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558b515fd790 0x558b5160c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b515fcdd0 0x558b516098f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f7247fff640 0 client.15252 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 --2- 172.21.15.42:0/1694751292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558b515fbc00 0x558b516093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 >> 172.21.15.42:0/1694751292 conn(0x558b515f2be0 msgr2=0x558b51605a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 shutdown_connections 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 1 -- 172.21.15.42:0/1694751292 wait complete. 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.654+0000 7f72719e4740 20 client.15252 trim_cache size 0 max 16384 2024-03-31T23:17:23.661 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24454, 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 83.417969006999996, 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 91, 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 129.29982314099999 2024-03-31T23:17:23.662 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f72540a24a0 msgr2=0x7f72540a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f72540a24a0 0x7f72540a4960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7250009fd0 tx=0x7f7250004730 comp rx=0 tx=0).stop 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 msgr2=0x7f7268197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 0x7f7268197a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f726000e9c0 tx=0x7f726000edc0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 shutdown_connections 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7268107390 0x7f726819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7268104a60 0x7f7268197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f72540a24a0 0x7f72540a4960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 --2- 172.21.15.42:0/1711347370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7268102130 0x7f7268197a20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 >> 172.21.15.42:0/1711347370 conn(0x7f72680fbac0 msgr2=0x7f7268102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 shutdown_connections 2024-03-31T23:17:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.655+0000 7f726dba0640 1 -- 172.21.15.42:0/1711347370 wait complete. 2024-03-31T23:17:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:23 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2674658953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:23 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3520459034' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:23 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3232477303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.666 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-31T23:17:23.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 -- 172.21.15.42:0/125978776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0100650 msgr2=0x7fc8b0100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/125978776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0100650 0x7fc8b0100a70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009900 tx=0x7fc8a402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 -- 172.21.15.42:0/125978776 shutdown_connections 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/125978776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8b0102200 0x7fc8b0108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/125978776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8b0101840 0x7fc8b0101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/125978776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0100650 0x7fc8b0100a70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 -- 172.21.15.42:0/125978776 >> 172.21.15.42:0/125978776 conn(0x7fc8b00fbbe0 msgr2=0x7fc8b00fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 -- 172.21.15.42:0/125978776 shutdown_connections 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 -- 172.21.15.42:0/125978776 wait complete. 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 Processor -- start 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.770+0000 7fc8b7a54640 1 -- start start 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8b0100650 0x7fc8b0069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 0x7fc8b019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8b0102200 0x7fc8b019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b010c3b0 con 0x7fc8b0101840 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b010c230 con 0x7fc8b0100650 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b010c530 con 0x7fc8b0102200 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 0x7fc8b019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b57f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8b0100650 0x7fc8b0069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 0x7fc8b019c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49700/0 (socket says 172.21.15.42:49700) 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 -- 172.21.15.42:0/1876064486 learned_addr learned my addr 172.21.15.42:0/1876064486 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8b0102200 0x7fc8b019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 -- 172.21.15.42:0/1876064486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8b0102200 msgr2=0x7fc8b019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8b0102200 0x7fc8b019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 -- 172.21.15.42:0/1876064486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8b0100650 msgr2=0x7fc8b0069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8b0100650 0x7fc8b0069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 -- 172.21.15.42:0/1876064486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b019f7c0 con 0x7fc8b0101840 2024-03-31T23:17:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 0x7fc8b019c8c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e9f0 tx=0x7fc8ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8a27fc640 1 -- 172.21.15.42:0/1876064486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac00ccc0 con 0x7fc8b0101840 2024-03-31T23:17:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b019fab0 con 0x7fc8b0101840 2024-03-31T23:17:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8a27fc640 1 -- 172.21.15.42:0/1876064486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8ac010930 con 0x7fc8b0101840 2024-03-31T23:17:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8a27fc640 1 -- 172.21.15.42:0/1876064486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac018980 con 0x7fc8b0101840 2024-03-31T23:17:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.771+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b01a0050 con 0x7fc8b0101840 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.773+0000 7fc8a27fc640 1 -- 172.21.15.42:0/1876064486 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fc8ac010ae0 con 0x7fc8b0101840 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 Processor -- start 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 -- start start 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17b610 0x56343e17ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8a27fc640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc89c0a2520 0x7fc89c0a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17c7e0 0x56343e17cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e183a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56343e0dfaf0 con 0x56343e17d1a0 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56343e0889d0 con 0x56343e17b610 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8ba630740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56343e0dbb90 con 0x56343e17c7e0 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc89c0a2520 0x7fc89c0a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8b5ff1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e183a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8b4fef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17c7e0 0x56343e17cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8b5ff1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e183a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49714/0 (socket says 172.21.15.42:49714) 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/3237400028 learned_addr learned my addr 172.21.15.42:0/3237400028 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8a27fc640 1 -- 172.21.15.42:0/1876064486 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc8ac0ced70 con 0x7fc8b0101840 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.774+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17b610 0x56343e17ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b4fef640 1 -- 172.21.15.42:0/3237400028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17b610 msgr2=0x56343e17ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17b610 0x56343e17ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b4fef640 1 -- 172.21.15.42:0/3237400028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 msgr2=0x56343e183a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e183a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b4fef640 1 -- 172.21.15.42:0/3237400028 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343ddf42d0 con 0x56343e17c7e0 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc89c0a2520 0x7fc89c0a49e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17c7e0 0x56343e17cc60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac09b170 tx=0x7fc8ac09afb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5925507fdd30776 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc89b7fe640 1 -- 172.21.15.42:0/3237400028 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac026040 con 0x56343e17c7e0 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc89b7fe640 1 -- 172.21.15.42:0/3237400028 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8ac0b9e50 con 0x56343e17c7e0 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.775+0000 7fc89b7fe640 1 -- 172.21.15.42:0/3237400028 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0a04f0 con 0x56343e17c7e0 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- 172.21.15.42:0/3237400028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17c7e0 msgr2=0x56343e17cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17c7e0 0x56343e17cc60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac09b170 tx=0x7fc8ac09afb0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- 172.21.15.42:0/3237400028 shutdown_connections 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e183a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17c7e0 0x56343e17cc60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- 172.21.15.42:0/3237400028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17b610 0x56343e17ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- 172.21.15.42:0/3237400028 >> 172.21.15.42:0/3237400028 conn(0x56343e176a00 msgr2=0x56343e176e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- 172.21.15.42:0/3237400028 shutdown_connections 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- 172.21.15.42:0/3237400028 wait complete. 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- start start 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 Processor -- start 2024-03-31T23:17:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 0x56343e185940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e185e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17d1a0 0x56343e18cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56343e1841b0 con 0x56343e17b610 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56343e09bf70 con 0x56343e17c7e0 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56343e184330 con 0x56343e17d1a0 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.776+0000 7fc8ba630740 10 client.0 _ll_register_callbacks cb 0x56343ddf3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b57f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 0x56343e185940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b57f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 0x56343e185940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49730/0 (socket says 172.21.15.42:49730) 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17d1a0 0x56343e18cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b57f0640 1 -- 172.21.15.42:0/4122075641 learned_addr learned my addr 172.21.15.42:0/4122075641 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e185e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 msgr2=0x56343e185e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e185e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4122075641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 msgr2=0x56343e185940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 0x56343e185940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4122075641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56343debe6b0 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 0x56343e185940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17d1a0 0x56343e18cec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8005fd0 tx=0x7fc8a8003d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c5ad759ceaa0d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc898ff9640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc898ff9640 1 -- 172.21.15.42:0/4122075641 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004720 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8ac0b9e50 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc898ff9640 1 -- 172.21.15.42:0/4122075641 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc8a8004b20 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.777+0000 7fc898ff9640 1 -- 172.21.15.42:0/4122075641 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8a8004d20 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 10 client.25057 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56343e18ff10 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc898ff9640 1 -- 172.21.15.42:0/4122075641 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8ac0b9e50 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc898ff9640 1 -- 172.21.15.42:0/4122075641 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8a801d030 con 0x56343e17d1a0 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 10 client.25057 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 10 client.25057 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 20 client.25057 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e192570 0x56343e1939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 4 client.25057 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56343e0ed030 con 0x56343e192570 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.778+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e192570 0x56343e1939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc898ff9640 10 client.25057 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e192570 0x56343e1939e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a327a65673ab4f5 server_cookie=d1c5343c8cbeb1c in_seq=0 out_seq=0 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc898ff9640 1 -- 172.21.15.42:0/4122075641 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56343e0ed030 con 0x56343e192570 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc898ff9640 10 client.25057 handle_command_reply: tid=0 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 client.25057 shutdown 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17d1a0 msgr2=0x56343e18cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17d1a0 0x56343e18cec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8005fd0 tx=0x7fc8a8003d40 comp rx=0 tx=0).stop 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 shutdown_connections 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e192570 0x56343e1939e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17d1a0 0x56343e18cec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e185e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4122075641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17b610 0x56343e185940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc898ff9640 0 client.25057 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.779+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 >> 172.21.15.42:0/4122075641 conn(0x56343e176a00 msgr2=0x56343e175b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.780+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 shutdown_connections 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.780+0000 7fc8ba630740 1 -- 172.21.15.42:0/4122075641 wait complete. 2024-03-31T23:17:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.780+0000 7fc8ba630740 20 client.25057 trim_cache size 0 max 16384 2024-03-31T23:17:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 Processor -- start 2024-03-31T23:17:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 -- start start 2024-03-31T23:17:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e176de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e18cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e185940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56343e191d20 con 0x56343e17d1a0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56343e1923f0 con 0x56343e17c7e0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8ba630740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56343e192ac0 con 0x56343e17b610 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e185940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e185940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49744/0 (socket says 172.21.15.42:49744) 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4145064261 learned_addr learned my addr 172.21.15.42:0/4145064261 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b57f0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e176de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e18cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4145064261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 msgr2=0x56343e176de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e176de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4145064261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 msgr2=0x56343e18cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e18cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 -- 172.21.15.42:0/4145064261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343e17c260 con 0x56343e17d1a0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e176de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.798+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e185940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009d40 tx=0x7fc8a8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28ebba4474a8176 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc89affd640 1 -- 172.21.15.42:0/4145064261 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8011c80 con 0x56343e17d1a0 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc89affd640 1 -- 172.21.15.42:0/4145064261 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8a8004b20 con 0x56343e17d1a0 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc89affd640 1 -- 172.21.15.42:0/4145064261 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8011230 con 0x56343e17d1a0 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 -- 172.21.15.42:0/4145064261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 msgr2=0x56343e185940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e185940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009d40 tx=0x7fc8a8000f40 comp rx=0 tx=0).stop 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 -- 172.21.15.42:0/4145064261 shutdown_connections 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17d1a0 0x56343e185940 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17c7e0 0x56343e18cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 --2- 172.21.15.42:0/4145064261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e176de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 -- 172.21.15.42:0/4145064261 >> 172.21.15.42:0/4145064261 conn(0x56343e176a00 msgr2=0x56343e1837c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 -- 172.21.15.42:0/4145064261 shutdown_connections 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.799+0000 7fc8ba630740 1 -- 172.21.15.42:0/4145064261 wait complete. 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 -- start start 2024-03-31T23:17:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 Processor -- start 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e188e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 0x56343e189350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17d1a0 0x56343e18c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56343e193860 con 0x56343e17c7e0 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56343e193190 con 0x56343e17d1a0 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56343e193f30 con 0x56343e17b610 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8ba630740 10 client.0 _ll_register_callbacks cb 0x7fc8a8011570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 0x56343e189350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 0x56343e189350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49760/0 (socket says 172.21.15.42:49760) 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 -- 172.21.15.42:0/2545211238 learned_addr learned my addr 172.21.15.42:0/2545211238 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e188e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b5ff1640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17d1a0 0x56343e18c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 -- 172.21.15.42:0/2545211238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 msgr2=0x56343e188e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e188e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 -- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17d1a0 msgr2=0x56343e18c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17d1a0 0x56343e18c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.800+0000 7fc8b4fef640 1 -- 172.21.15.42:0/2545211238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56343e18c8f0 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8b4fef640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 0x56343e189350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009250 tx=0x7fc8ac00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1870800da20c88c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc898ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc898ff9640 1 -- 172.21.15.42:0/2545211238 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0b3070 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc898ff9640 1 -- 172.21.15.42:0/2545211238 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc8ac0a0d50 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a8004b20 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc898ff9640 1 -- 172.21.15.42:0/2545211238 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8ac09b470 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 10 client.15270 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56343e1f8bc0 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc898ff9640 1 -- 172.21.15.42:0/2545211238 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8a8004b20 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc898ff9640 1 -- 172.21.15.42:0/2545211238 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8ac09f160 con 0x56343e17c7e0 2024-03-31T23:17:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 10 client.15270 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 10 client.15270 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 20 client.15270 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e1fd1f0 0x56343e1fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 4 client.15270 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.801+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "status"}) -- 0x56343e0e7380 con 0x56343e1fd1f0 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e1fd1f0 0x56343e1fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8b57f0640 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e1fd1f0 0x56343e1fbf00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3da2608268536fbe server_cookie=b4785344bd672741 in_seq=0 out_seq=0 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc898ff9640 10 client.15270 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc898ff9640 1 -- 172.21.15.42:0/2545211238 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56343e0e7380 con 0x56343e1fd1f0 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc898ff9640 10 client.15270 handle_command_reply: tid=0 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 client.15270 shutdown 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 msgr2=0x56343e189350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 0x56343e189350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009250 tx=0x7fc8ac00ce60 comp rx=0 tx=0).stop 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 shutdown_connections 2024-03-31T23:17:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56343e1fd1f0 0x56343e1fbf00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56343e17d1a0 0x56343e18c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56343e17c7e0 0x56343e189350 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 --2- 172.21.15.42:0/2545211238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56343e17b610 0x56343e188e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc898ff9640 0 client.15270 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 >> 172.21.15.42:0/2545211238 conn(0x56343e176a00 msgr2=0x56343e176de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 shutdown_connections 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 1 -- 172.21.15.42:0/2545211238 wait complete. 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.802+0000 7fc8ba630740 20 client.15270 trim_cache size 0 max 16384 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24464, 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 84.570669606999999, 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 91, 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 126.573823373 2024-03-31T23:17:23.810 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc89c0a2520 msgr2=0x7fc89c0a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc89c0a2520 0x7fc89c0a49e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a4005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 msgr2=0x7fc8b019c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 0x7fc8b019c8c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e9f0 tx=0x7fc8ac00edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 shutdown_connections 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8b0102200 0x7fc8b019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc89c0a2520 0x7fc89c0a49e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8b0101840 0x7fc8b019c8c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 --2- 172.21.15.42:0/1876064486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8b0100650 0x7fc8b0069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 >> 172.21.15.42:0/1876064486 conn(0x7fc8b00fbbe0 msgr2=0x7fc8b0104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 shutdown_connections 2024-03-31T23:17:23.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.803+0000 7fc8b7a54640 1 -- 172.21.15.42:0/1876064486 wait complete. 2024-03-31T23:17:23.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/3337667793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 msgr2=0x7f7d981098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/3337667793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 0x7f7d981098a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009be0 tx=0x7f7d9002bef0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/3337667793 shutdown_connections 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/3337667793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 0x7f7d981098a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/3337667793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98104b80 0x7f7d98106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/3337667793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98102250 0x7f7d98104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/3337667793 >> 172.21.15.42:0/3337667793 conn(0x7f7d980fbbe0 msgr2=0x7f7d980fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/3337667793 shutdown_connections 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.918+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/3337667793 wait complete. 2024-03-31T23:17:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 Processor -- start 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 -- start start 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 0x7f7d98101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98104b80 0x7f7d98100200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 0x7f7d98100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9810d500 con 0x7f7d98102250 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9810d380 con 0x7f7d981074b0 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9fe8f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9810d680 con 0x7f7d98104b80 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 0x7f7d98101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 0x7f7d98101bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49776/0 (socket says 172.21.15.42:49776) 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1665740016 learned_addr learned my addr 172.21.15.42:0/1665740016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 0x7f7d98100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98104b80 0x7f7d98100200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1665740016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98104b80 msgr2=0x7f7d98100200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98104b80 0x7f7d98100200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1665740016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 msgr2=0x7f7d98100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 0x7f7d98100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1665740016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d98100fd0 con 0x7f7d98102250 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.919+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98104b80 0x7f7d98100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.920+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 0x7f7d98101bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400e9f0 tx=0x7f7d9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.920+0000 7f7d8effd640 1 -- 172.21.15.42:0/1665740016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400cd80 con 0x7f7d98102250 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.920+0000 7f7d8effd640 1 -- 172.21.15.42:0/1665740016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d94010930 con 0x7f7d98102250 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.920+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d981a1c40 con 0x7f7d98102250 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.920+0000 7f7d8effd640 1 -- 172.21.15.42:0/1665740016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94018b00 con 0x7f7d98102250 2024-03-31T23:17:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.920+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d981a2190 con 0x7f7d98102250 2024-03-31T23:17:23.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:23 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2674658953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:23 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3520459034' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:23 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3232477303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.922+0000 7f7d8effd640 1 -- 172.21.15.42:0/1665740016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f7d94018ca0 con 0x7f7d98102250 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.922+0000 7f7da2a7c740 1 Processor -- start 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 -- start start 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8391e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a83914daf0 con 0x55a8391e9610 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a8390f69d0 con 0x55a8391ea7e0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a839149b90 con 0x55a8391eb1a0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9e42c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8391e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9e42c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8391e9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49786/0 (socket says 172.21.15.42:49786) 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9e42c640 1 -- 172.21.15.42:0/348330892 learned_addr learned my addr 172.21.15.42:0/348330892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d8effd640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7d840a24a0 0x7f7d840a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7d840a24a0 0x7f7d840a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d8effd640 1 -- 172.21.15.42:0/1665740016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7d940ceea0 con 0x7f7d98102250 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/348330892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 msgr2=0x55a8391f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/348330892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 msgr2=0x55a8391e9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8391e9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/348330892 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a838e622d0 con 0x55a8391ea7e0 2024-03-31T23:17:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8391e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.923+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391eac60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d940cc690 tx=0x7f7d94018520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7fe7348e48f7e9e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7d83fff640 1 -- 172.21.15.42:0/348330892 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d940d2590 con 0x55a8391ea7e0 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7d840a24a0 0x7f7d840a4960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55a8391ea6e0 tx=0x7f7d9002bef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7d83fff640 1 -- 172.21.15.42:0/348330892 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d9409b600 con 0x55a8391ea7e0 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7d83fff640 1 -- 172.21.15.42:0/348330892 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94084b90 con 0x55a8391ea7e0 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 -- 172.21.15.42:0/348330892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 msgr2=0x55a8391eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391eac60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d940cc690 tx=0x7f7d94018520 comp rx=0 tx=0).stop 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 -- 172.21.15.42:0/348330892 shutdown_connections 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391eac60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/348330892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8391e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 -- 172.21.15.42:0/348330892 >> 172.21.15.42:0/348330892 conn(0x55a8391e4a00 msgr2=0x55a8391e4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 -- 172.21.15.42:0/348330892 shutdown_connections 2024-03-31T23:17:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.924+0000 7f7da2a7c740 1 -- 172.21.15.42:0/348330892 wait complete. 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 -- start start 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 Processor -- start 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391e9610 0x55a8391f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391fae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a8391f20f0 con 0x55a8391ea7e0 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a839109f70 con 0x55a8391e9610 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a8391f2270 con 0x55a8391eb1a0 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7da2a7c740 10 client.0 _ll_register_callbacks cb 0x55a838e61ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7d9d42a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7d9d42a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49798/0 (socket says 172.21.15.42:49798) 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391e9610 0x55a8391f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7d9d42a640 1 -- 172.21.15.42:0/219293981 learned_addr learned my addr 172.21.15.42:0/219293981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.925+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 msgr2=0x55a8391fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391fae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/219293981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 msgr2=0x55a8391f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/219293981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a838f2c6b0 con 0x55a8391e9610 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391e9610 0x55a8391f38b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d9409beb0 tx=0x7f7d94019fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1edf5a5738913e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d817fa640 1 -- 172.21.15.42:0/219293981 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94097040 con 0x55a8391e9610 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d9409b600 con 0x55a8391e9610 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d817fa640 1 -- 172.21.15.42:0/219293981 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7d94084d90 con 0x55a8391e9610 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d817fa640 1 -- 172.21.15.42:0/219293981 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d9409f750 con 0x55a8391e9610 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7da2a7c740 10 client.25112 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8391fde10 con 0x55a8391e9610 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d817fa640 1 -- 172.21.15.42:0/219293981 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d9409b600 con 0x55a8391e9610 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.926+0000 7f7d817fa640 1 -- 172.21.15.42:0/219293981 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d940b4020 con 0x55a8391e9610 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7da2a7c740 10 client.25112 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7da2a7c740 10 client.25112 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7da2a7c740 20 client.25112 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a8391ff160 0x55a8392012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7da2a7c740 4 client.25112 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a83915b030 con 0x55a8391ff160 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a8391ff160 0x55a8392012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a8391ff160 0x55a8392012f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3532acb34f068041 server_cookie=1d13a4b8f4f8a7f4 in_seq=0 out_seq=0 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.927+0000 7f7d817fa640 10 client.25112 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7d817fa640 1 -- 172.21.15.42:0/219293981 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a83915b030 con 0x55a8391ff160 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7d817fa640 10 client.25112 handle_command_reply: tid=0 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 client.25112 shutdown 2024-03-31T23:17:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391e9610 msgr2=0x55a8391f38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391e9610 0x55a8391f38b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d9409beb0 tx=0x7f7d94019fa0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 shutdown_connections 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a8391ff160 0x55a8392012f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7d817fa640 0 client.25112 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/219293981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391e9610 0x55a8391f38b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.928+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 >> 172.21.15.42:0/219293981 conn(0x55a8391e4a00 msgr2=0x55a8391e3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.929+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 shutdown_connections 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.929+0000 7f7da2a7c740 1 -- 172.21.15.42:0/219293981 wait complete. 2024-03-31T23:17:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.929+0000 7f7da2a7c740 20 client.25112 trim_cache size 0 max 16384 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 Processor -- start 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 -- start start 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8392012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a8391ff630 con 0x55a8391e9610 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a8391ffd00 con 0x55a8391ea7e0 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a8392003d0 con 0x55a8391eb1a0 2024-03-31T23:17:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8392012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8392012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49802/0 (socket says 172.21.15.42:49802) 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1268007457 learned_addr learned my addr 172.21.15.42:0/1268007457 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1268007457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 msgr2=0x55a8391f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1268007457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 msgr2=0x55a8391fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 -- 172.21.15.42:0/1268007457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8391edc40 con 0x55a8391e9610 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8392012f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7d9409b590 tx=0x7f7d94099b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925895e52251e4da server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.947+0000 7f7d837fe640 1 -- 172.21.15.42:0/1268007457 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94097040 con 0x55a8391e9610 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7d837fe640 1 -- 172.21.15.42:0/1268007457 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d9409b600 con 0x55a8391e9610 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7d837fe640 1 -- 172.21.15.42:0/1268007457 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94084b90 con 0x55a8391e9610 2024-03-31T23:17:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 -- 172.21.15.42:0/1268007457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 msgr2=0x55a8392012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8392012f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7d9409b590 tx=0x7f7d94099b10 comp rx=0 tx=0).stop 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 -- 172.21.15.42:0/1268007457 shutdown_connections 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391eb1a0 0x55a8391f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391ea7e0 0x55a8391fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/1268007457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391e9610 0x55a8392012f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 -- 172.21.15.42:0/1268007457 >> 172.21.15.42:0/1268007457 conn(0x55a8391e4a00 msgr2=0x55a8391e4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 -- 172.21.15.42:0/1268007457 shutdown_connections 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 -- 172.21.15.42:0/1268007457 wait complete. 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 -- start start 2024-03-31T23:17:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.948+0000 7f7da2a7c740 1 Processor -- start 2024-03-31T23:17:23.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391e9610 0x55a8391f6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391eb1a0 0x55a8391f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a839201170 con 0x55a8391ea7e0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a839200aa0 con 0x55a8391eb1a0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a839201840 con 0x55a8391e9610 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7da2a7c740 10 client.0 _ll_register_callbacks cb 0x7f7d94005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49816/0 (socket says 172.21.15.42:49816) 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 -- 172.21.15.42:0/3904953092 learned_addr learned my addr 172.21.15.42:0/3904953092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9dc2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391e9610 0x55a8391f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9e42c640 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391eb1a0 0x55a8391f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 -- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391e9610 msgr2=0x55a8391f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391e9610 0x55a8391f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 -- 172.21.15.42:0/3904953092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391eb1a0 msgr2=0x55a8391f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391eb1a0 0x55a8391f9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 -- 172.21.15.42:0/3904953092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8391fa3c0 con 0x55a8391ea7e0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d9d42a640 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f6db0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55a8391f2ea0 tx=0x7f7d88012ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea2493fc66643c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:23.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.949+0000 7f7d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7d817fa640 1 -- 172.21.15.42:0/3904953092 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88004440 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d9409b600 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7d817fa640 1 -- 172.21.15.42:0/3904953092 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7d8801f8d0 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7d817fa640 1 -- 172.21.15.42:0/3904953092 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d88032050 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 10 client.15288 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a839265f60 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7d817fa640 1 -- 172.21.15.42:0/3904953092 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d9409b600 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7d817fa640 1 -- 172.21.15.42:0/3904953092 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d880037b0 con 0x55a8391ea7e0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 10 client.15288 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 10 client.15288 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 20 client.15288 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a83926ac20 0x55a839269930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 4 client.15288 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "status"}) -- 0x55a839155380 con 0x55a83926ac20 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.950+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a83926ac20 0x55a839269930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:23.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7d9dc2b640 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a83926ac20 0x55a839269930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=965b51b4b137a318 server_cookie=bee6381c7d459ebe in_seq=0 out_seq=0 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7d817fa640 10 client.15288 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7d817fa640 1 -- 172.21.15.42:0/3904953092 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a839155380 con 0x55a83926ac20 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7d817fa640 10 client.15288 handle_command_reply: tid=0 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 client.15288 shutdown 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 msgr2=0x55a8391f6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f6db0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55a8391f2ea0 tx=0x7f7d88012ca0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 shutdown_connections 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a8391eb1a0 0x55a8391f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8391ea7e0 0x55a8391f6db0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a83926ac20 0x55a839269930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 --2- 172.21.15.42:0/3904953092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8391e9610 0x55a8391f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7d817fa640 0 client.15288 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 >> 172.21.15.42:0/3904953092 conn(0x55a8391e4a00 msgr2=0x55a8391e84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 shutdown_connections 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 1 -- 172.21.15.42:0/3904953092 wait complete. 2024-03-31T23:17:23.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.951+0000 7f7da2a7c740 20 client.15288 trim_cache size 0 max 16384 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24472, 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 85.729778273999997, 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 91, 2024-03-31T23:17:23.958 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 123.94978220199999 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7d840a24a0 msgr2=0x7f7d840a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7d840a24a0 0x7f7d840a4960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55a8391ea6e0 tx=0x7f7d9002bef0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 msgr2=0x7f7d98101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 0x7f7d98101bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400e9f0 tx=0x7f7d9400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 shutdown_connections 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d981074b0 0x7f7d98100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d98104b80 0x7f7d98100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f7d840a24a0 0x7f7d840a4960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 --2- 172.21.15.42:0/1665740016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d98102250 0x7f7d98101bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 >> 172.21.15.42:0/1665740016 conn(0x7f7d980fbbe0 msgr2=0x7f7d98102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 shutdown_connections 2024-03-31T23:17:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:23.952+0000 7f7d9fe8f640 1 -- 172.21.15.42:0/1665740016 wait complete. 2024-03-31T23:17:23.963 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-31T23:17:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:23 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2674658953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:23 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3520459034' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:23 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3232477303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 -- 172.21.15.42:0/1950633441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 msgr2=0x7f6310101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 --2- 172.21.15.42:0/1950633441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310101b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6300009900 tx=0x7f630002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 -- 172.21.15.42:0/1950633441 shutdown_connections 2024-03-31T23:17:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 --2- 172.21.15.42:0/1950633441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 0x7f6310109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 --2- 172.21.15.42:0/1950633441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 0x7f6310102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 --2- 172.21.15.42:0/1950633441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310101b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 -- 172.21.15.42:0/1950633441 >> 172.21.15.42:0/1950633441 conn(0x7f63100fccf0 msgr2=0x7f63100ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 -- 172.21.15.42:0/1950633441 shutdown_connections 2024-03-31T23:17:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.066+0000 7f63160d4640 1 -- 172.21.15.42:0/1950633441 wait complete. 2024-03-31T23:17:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 Processor -- start 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 -- start start 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 0x7f6310198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 0x7f631019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f631010d4c0 con 0x7f6310101760 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f631010d340 con 0x7f6310103310 2024-03-31T23:17:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f63160d4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f631010d640 con 0x7f6310102950 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49836/0 (socket says 172.21.15.42:49836) 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f630f7fe640 1 -- 172.21.15.42:0/1073374843 learned_addr learned my addr 172.21.15.42:0/1073374843 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f630effd640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 0x7f6310198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.067+0000 7f630ffff640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 0x7f631019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630f7fe640 1 -- 172.21.15.42:0/1073374843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 msgr2=0x7f6310198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630f7fe640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 0x7f6310198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630f7fe640 1 -- 172.21.15.42:0/1073374843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 msgr2=0x7f631019f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630f7fe640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 0x7f631019f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630f7fe640 1 -- 172.21.15.42:0/1073374843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631019f7e0 con 0x7f6310101760 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630effd640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 0x7f6310198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630ffff640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 0x7f631019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630f7fe640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310197bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6300000c00 tx=0x7f6300004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630cff9640 1 -- 172.21.15.42:0/1073374843 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300043020 con 0x7f6310101760 2024-03-31T23:17:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630cff9640 1 -- 172.21.15.42:0/1073374843 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6300004250 con 0x7f6310101760 2024-03-31T23:17:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631019fa70 con 0x7f6310101760 2024-03-31T23:17:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f630cff9640 1 -- 172.21.15.42:0/1073374843 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300003b20 con 0x7f6310101760 2024-03-31T23:17:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.068+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101a0010 con 0x7f6310101760 2024-03-31T23:17:24.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.070+0000 7f630cff9640 1 -- 172.21.15.42:0/1073374843 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f6300046020 con 0x7f6310101760 2024-03-31T23:17:24.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 Processor -- start 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 -- start start 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630cff9640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62f80a2520 0x7f62f80a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c517a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c518c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c51fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b6c47baf0 con 0x559b6c517610 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559b6c4249d0 con 0x559b6c5191a0 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f6318d98740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559b6c477b90 con 0x559b6c5187e0 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630ffff640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62f80a2520 0x7f62f80a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c518c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630cff9640 1 -- 172.21.15.42:0/1073374843 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f63000f0b40 con 0x7f6310101760 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c518c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:52572/0 (socket says 172.21.15.42:52572) 2024-03-31T23:17:24.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 -- 172.21.15.42:0/4200160796 learned_addr learned my addr 172.21.15.42:0/4200160796 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630ffff640 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c51fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630f7fe640 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c517a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 -- 172.21.15.42:0/4200160796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 msgr2=0x559b6c51fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c51fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 -- 172.21.15.42:0/4200160796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 msgr2=0x559b6c517a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c517a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.071+0000 7f630effd640 1 -- 172.21.15.42:0/4200160796 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b6c1902d0 con 0x559b6c5187e0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f630ffff640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62f80a2520 0x7f62f80a49e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6308005fd0 tx=0x7f6308013660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f630effd640 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c518c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63040114f0 tx=0x7f63040119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5e56492b6c9b763 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f62f5ffb640 1 -- 172.21.15.42:0/4200160796 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304004020 con 0x559b6c5187e0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f62f5ffb640 1 -- 172.21.15.42:0/4200160796 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63040041c0 con 0x559b6c5187e0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f62f5ffb640 1 -- 172.21.15.42:0/4200160796 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630400fa00 con 0x559b6c5187e0 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f6318d98740 1 -- 172.21.15.42:0/4200160796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 msgr2=0x559b6c518c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.072+0000 7f6318d98740 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c518c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63040114f0 tx=0x7f63040119b0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- 172.21.15.42:0/4200160796 shutdown_connections 2024-03-31T23:17:24.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c51fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c518c60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 --2- 172.21.15.42:0/4200160796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c517a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- 172.21.15.42:0/4200160796 >> 172.21.15.42:0/4200160796 conn(0x559b6c512a00 msgr2=0x559b6c512e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- 172.21.15.42:0/4200160796 shutdown_connections 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- 172.21.15.42:0/4200160796 wait complete. 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- start start 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 Processor -- start 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c526350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b6c5245c0 con 0x559b6c517610 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559b6c437f70 con 0x559b6c5191a0 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559b6c524740 con 0x559b6c5187e0 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f6318d98740 10 client.0 _ll_register_callbacks cb 0x559b6c18fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:24.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49854/0 (socket says 172.21.15.42:49854) 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f630effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c526350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f630f7fe640 1 -- 172.21.15.42:0/426162539 learned_addr learned my addr 172.21.15.42:0/426162539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.073+0000 7f630ffff640 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f630f7fe640 1 -- 172.21.15.42:0/426162539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 msgr2=0x559b6c526350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f630f7fe640 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c526350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f630f7fe640 1 -- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 msgr2=0x559b6c52d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f630f7fe640 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f630f7fe640 1 -- 172.21.15.42:0/426162539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b6c25a6b0 con 0x559b6c517610 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f630f7fe640 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f630002c900 tx=0x7f63000035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcdf4046d683b91 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f62eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f62eeffd640 1 -- 172.21.15.42:0/426162539 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000c1390 con 0x559b6c517610 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f62eeffd640 1 -- 172.21.15.42:0/426162539 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6300004400 con 0x559b6c517610 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63040041c0 con 0x559b6c517610 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f62eeffd640 1 -- 172.21.15.42:0/426162539 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63000c5c50 con 0x559b6c517610 2024-03-31T23:17:24.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f6318d98740 10 client.15300 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b6c530370 con 0x559b6c517610 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f62eeffd640 1 -- 172.21.15.42:0/426162539 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63040041c0 con 0x559b6c517610 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.074+0000 7f62eeffd640 1 -- 172.21.15.42:0/426162539 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63000b3cb0 con 0x559b6c517610 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f6318d98740 10 client.15300 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f6318d98740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f6318d98740 20 client.15300 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f6318d98740 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c532b30 0x559b6c533fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f6318d98740 4 client.15300 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b6c489030 con 0x559b6c532b30 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f630effd640 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c532b30 0x559b6c533fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f630effd640 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c532b30 0x559b6c533fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd45a9141babd0e3 server_cookie=46b5622f41adbdb6 in_seq=0 out_seq=0 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.075+0000 7f62eeffd640 10 client.15300 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f62eeffd640 1 -- 172.21.15.42:0/426162539 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559b6c489030 con 0x559b6c532b30 2024-03-31T23:17:24.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f62eeffd640 10 client.15300 handle_command_reply: tid=0 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 client.15300 shutdown 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 msgr2=0x559b6c525e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f630002c900 tx=0x7f63000035f0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 shutdown_connections 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c532b30 0x559b6c533fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5187e0 0x559b6c526350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f62eeffd640 0 client.15300 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 --2- 172.21.15.42:0/426162539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525e10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 >> 172.21.15.42:0/426162539 conn(0x559b6c512a00 msgr2=0x559b6c511b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 shutdown_connections 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 1 -- 172.21.15.42:0/426162539 wait complete. 2024-03-31T23:17:24.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.076+0000 7f6318d98740 20 client.15300 trim_cache size 0 max 16384 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.094+0000 7f6318d98740 1 Processor -- start 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.094+0000 7f6318d98740 1 -- start start 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.094+0000 7f6318d98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f6318d98740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5187e0 0x559b6c52d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f6318d98740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5191a0 0x559b6c525f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f6318d98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b6c5322e0 con 0x559b6c517610 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f6318d98740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559b6c5329b0 con 0x559b6c5187e0 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f6318d98740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559b6c533080 con 0x559b6c5191a0 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49862/0 (socket says 172.21.15.42:49862) 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 -- 172.21.15.42:0/117932249 learned_addr learned my addr 172.21.15.42:0/117932249 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630ffff640 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5191a0 0x559b6c525f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630effd640 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5187e0 0x559b6c52d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 -- 172.21.15.42:0/117932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5191a0 msgr2=0x559b6c525f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5191a0 0x559b6c525f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 -- 172.21.15.42:0/117932249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5187e0 msgr2=0x559b6c52d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5187e0 0x559b6c52d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 -- 172.21.15.42:0/117932249 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b6c511040 con 0x559b6c517610 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f630f7fe640 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f63000bcf40 tx=0x7f63000bd3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0f7e84a03ab9fc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f62f57fa640 1 -- 172.21.15.42:0/117932249 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000c1390 con 0x559b6c517610 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f62f57fa640 1 -- 172.21.15.42:0/117932249 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63000bd940 con 0x559b6c517610 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.095+0000 7f62f57fa640 1 -- 172.21.15.42:0/117932249 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000bcd80 con 0x559b6c517610 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 -- 172.21.15.42:0/117932249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 msgr2=0x559b6c525a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f63000bcf40 tx=0x7f63000bd3c0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 -- 172.21.15.42:0/117932249 shutdown_connections 2024-03-31T23:17:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c5191a0 0x559b6c525f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5187e0 0x559b6c52d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 --2- 172.21.15.42:0/117932249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c517610 0x559b6c525a20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 -- 172.21.15.42:0/117932249 >> 172.21.15.42:0/117932249 conn(0x559b6c512a00 msgr2=0x559b6c5316c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 -- 172.21.15.42:0/117932249 shutdown_connections 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 -- 172.21.15.42:0/117932249 wait complete. 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 -- start start 2024-03-31T23:17:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 Processor -- start 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c517610 0x559b6c5290e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.096+0000 7f6318d98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 0x559b6c529620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b6c533e20 con 0x559b6c5187e0 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559b6c533750 con 0x559b6c5191a0 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559b6c5344f0 con 0x559b6c517610 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 10 client.0 _ll_register_callbacks cb 0x7f63000a7f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 0x559b6c529620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 0x559b6c529620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49868/0 (socket says 172.21.15.42:49868) 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 -- 172.21.15.42:0/1007594939 learned_addr learned my addr 172.21.15.42:0/1007594939 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630f7fe640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c517610 0x559b6c5290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630ffff640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 -- 172.21.15.42:0/1007594939 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c517610 msgr2=0x559b6c5290e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c517610 0x559b6c5290e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 -- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 msgr2=0x559b6c52c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 -- 172.21.15.42:0/1007594939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b6c52cc30 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f630effd640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 0x559b6c529620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6304009710 tx=0x7f63040041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcaa1b64d56963f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f62eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f62eeffd640 1 -- 172.21.15.42:0/1007594939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304011300 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63000bd940 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f62eeffd640 1 -- 172.21.15.42:0/1007594939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6304016040 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f62eeffd640 1 -- 172.21.15.42:0/1007594939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6304005040 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 10 client.15306 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.097+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b6c598ef0 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f62eeffd640 1 -- 172.21.15.42:0/1007594939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63000bd940 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f62eeffd640 1 -- 172.21.15.42:0/1007594939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63040035f0 con 0x559b6c5187e0 2024-03-31T23:17:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f6318d98740 10 client.15306 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f6318d98740 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f6318d98740 20 client.15306 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f6318d98740 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c59d900 0x559b6c59c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f6318d98740 4 client.15306 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "status"}) -- 0x559b6c483380 con 0x559b6c59d900 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f630f7fe640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c59d900 0x559b6c59c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f62eeffd640 10 client.15306 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.098+0000 7f630f7fe640 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c59d900 0x559b6c59c610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b7d80550af3eb9a server_cookie=542da7f932289791 in_seq=0 out_seq=0 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f62eeffd640 1 -- 172.21.15.42:0/1007594939 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559b6c483380 con 0x559b6c59d900 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f62eeffd640 10 client.15306 handle_command_reply: tid=0 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 client.15306 shutdown 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 msgr2=0x559b6c529620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 0x559b6c529620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6304009710 tx=0x7f63040041a0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 shutdown_connections 2024-03-31T23:17:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x559b6c59d900 0x559b6c59c610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559b6c5191a0 0x559b6c52c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b6c5187e0 0x559b6c529620 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f62eeffd640 0 client.15306 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 --2- 172.21.15.42:0/1007594939 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559b6c517610 0x559b6c5290e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 >> 172.21.15.42:0/1007594939 conn(0x559b6c512a00 msgr2=0x559b6c5316c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 shutdown_connections 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 1 -- 172.21.15.42:0/1007594939 wait complete. 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f6318d98740 20 client.15306 trim_cache size 0 max 16384 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:24.106 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24497, 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 109.96575127200001, 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 91, 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 115.41113380500001 2024-03-31T23:17:24.107 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62f80a2520 msgr2=0x7f62f80a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62f80a2520 0x7f62f80a49e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6308005fd0 tx=0x7f6308013660 comp rx=0 tx=0).stop 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 msgr2=0x7f6310197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310197bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6300000c00 tx=0x7f6300004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 shutdown_connections 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6310103310 0x7f631019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6310102950 0x7f6310198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62f80a2520 0x7f62f80a49e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 --2- 172.21.15.42:0/1073374843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6310101760 0x7f6310197bc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.099+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 >> 172.21.15.42:0/1073374843 conn(0x7f63100fccf0 msgr2=0x7f6310105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.100+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 shutdown_connections 2024-03-31T23:17:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:24.100+0000 7f63160d4640 1 -- 172.21.15.42:0/1073374843 wait complete. 2024-03-31T23:17:24.111 INFO:tasks.cephadm:Setup complete, yielding 2024-03-31T23:17:24.111 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-31T23:17:24.121 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:17:24.121 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch status' 2024-03-31T23:17:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:24.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:24 smithi042 ceph-mon[32380]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-31T23:17:24.921 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:24 smithi094 ceph-mon[36167]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-31T23:17:24.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:24 smithi188 ceph-mon[36068]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 -- 172.21.15.42:0/1705588782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064102370 msgr2=0x7f30641027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 --2- 172.21.15.42:0/1705588782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064102370 0x7f30641027d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f30600099c0 tx=0x7f3060009cd0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 -- 172.21.15.42:0/1705588782 shutdown_connections 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 --2- 172.21.15.42:0/1705588782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064101170 0x7f3064101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 --2- 172.21.15.42:0/1705588782 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102d10 0x7f30641095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 --2- 172.21.15.42:0/1705588782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064102370 0x7f30641027d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 -- 172.21.15.42:0/1705588782 >> 172.21.15.42:0/1705588782 conn(0x7f30640fc730 msgr2=0x7f30640feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 -- 172.21.15.42:0/1705588782 shutdown_connections 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.020+0000 7f306b47f700 1 -- 172.21.15.42:0/1705588782 wait complete. 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 Processor -- start 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 -- start start 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 0x7f306406b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102370 0x7f306419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064102d10 0x7f306419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f306410ce70 con 0x7f3064101170 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f306410ccf0 con 0x7f3064102370 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306b47f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f306410cff0 con 0x7f3064102d10 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 0x7f306406b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 0x7f306406b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49878/0 (socket says 172.21.15.42:49878) 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 -- 172.21.15.42:0/4055583695 learned_addr learned my addr 172.21.15.42:0/4055583695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f3068a1a700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102370 0x7f306419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f3069a1c700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064102d10 0x7f306419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 -- 172.21.15.42:0/4055583695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064102d10 msgr2=0x7f306419f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064102d10 0x7f306419f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 -- 172.21.15.42:0/4055583695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102370 msgr2=0x7f306419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102370 0x7f306419d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f306921b700 1 -- 172.21.15.42:0/4055583695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30641a01b0 con 0x7f3064101170 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f3069a1c700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064102d10 0x7f306419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.021+0000 7f3068a1a700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102370 0x7f306419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.022+0000 7f306921b700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 0x7f306406b4c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f305400e950 tx=0x7f305400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.022+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305400eea0 con 0x7f3064101170 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.022+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30641a04a0 con 0x7f3064101170 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.022+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3054004530 con 0x7f3064101170 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.022+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30641a09b0 con 0x7f3064101170 2024-03-31T23:17:26.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.022+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054010430 con 0x7f3064101170 2024-03-31T23:17:26.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.023+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3048005360 con 0x7f3064101170 2024-03-31T23:17:26.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.024+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f305400cbd0 con 0x7f3064101170 2024-03-31T23:17:26.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.024+0000 7f305a7fc700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f30500a25b0 0x7f30500a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:26.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.024+0000 7f3068a1a700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f30500a25b0 0x7f30500a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:26.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.025+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f30540ced50 con 0x7f3064101170 2024-03-31T23:17:26.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.025+0000 7f3068a1a700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f30500a25b0 0x7f30500a4a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3060000c00 tx=0x7f3060005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.029+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f305409bb50 con 0x7f3064101170 2024-03-31T23:17:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.250+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f3048000bf0 con 0x7f30500a25b0 2024-03-31T23:17:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.252+0000 7f305a7fc700 1 -- 172.21.15.42:0/4055583695 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3048000bf0 con 0x7f30500a25b0 2024-03-31T23:17:26.252 INFO:teuthology.orchestra.run.smithi042.stdout:Backend: cephadm 2024-03-31T23:17:26.252 INFO:teuthology.orchestra.run.smithi042.stdout:Available: Yes 2024-03-31T23:17:26.252 INFO:teuthology.orchestra.run.smithi042.stdout:Paused: No 2024-03-31T23:17:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.253+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f30500a25b0 msgr2=0x7f30500a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.253+0000 7f306b47f700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f30500a25b0 0x7f30500a4a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3060000c00 tx=0x7f3060005fb0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.253+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 msgr2=0x7f306406b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.253+0000 7f306b47f700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 0x7f306406b4c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f305400e950 tx=0x7f305400ec60 comp rx=0 tx=0).stop 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 shutdown_connections 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f30500a25b0 0x7f30500a4a70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3064102d10 0x7f306419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3064101170 0x7f306406b4c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 --2- 172.21.15.42:0/4055583695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3064102370 0x7f306419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 >> 172.21.15.42:0/4055583695 conn(0x7f30640fc730 msgr2=0x7f3064105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 shutdown_connections 2024-03-31T23:17:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:26.254+0000 7f306b47f700 1 -- 172.21.15.42:0/4055583695 wait complete. 2024-03-31T23:17:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:26 smithi094 ceph-mon[36167]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-31T23:17:26.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:26 smithi188 ceph-mon[36068]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-31T23:17:27.007 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:26 smithi042 ceph-mon[32380]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-31T23:17:27.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch ps' 2024-03-31T23:17:27.282 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:27.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:27 smithi042 ceph-mon[32380]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:27 smithi094 ceph-mon[36167]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:27.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:27 smithi188 ceph-mon[36068]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:28.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:28 smithi042 ceph-mon[32380]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:28.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:28 smithi094 ceph-mon[36167]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:28.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:28 smithi188 ceph-mon[36068]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 -- 172.21.15.42:0/3544116368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c101460 msgr2=0x7fde5c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 --2- 172.21.15.42:0/3544116368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c101460 0x7fde5c1018c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fde480099c0 tx=0x7fde48009cd0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 -- 172.21.15.42:0/3544116368 shutdown_connections 2024-03-31T23:17:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 --2- 172.21.15.42:0/3544116368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c102720 0x7fde5c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 --2- 172.21.15.42:0/3544116368 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101e00 0x7fde5c1096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 --2- 172.21.15.42:0/3544116368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c101460 0x7fde5c1018c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 -- 172.21.15.42:0/3544116368 >> 172.21.15.42:0/3544116368 conn(0x7fde5c0fbe90 msgr2=0x7fde5c0fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 -- 172.21.15.42:0/3544116368 shutdown_connections 2024-03-31T23:17:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.046+0000 7fde62c80700 1 -- 172.21.15.42:0/3544116368 wait complete. 2024-03-31T23:17:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.047+0000 7fde62c80700 1 Processor -- start 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.047+0000 7fde62c80700 1 -- start start 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde62c80700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 0x7fde5c105200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde62c80700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c101e00 0x7fde5c103850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde62c80700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c102720 0x7fde5c103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde62c80700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c10ce70 con 0x7fde5c102720 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde62c80700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c10ccf0 con 0x7fde5c101460 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde62c80700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c10cff0 con 0x7fde5c101e00 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 0x7fde5c105200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c101e00 0x7fde5c103850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 0x7fde5c105200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:57772/0 (socket says 172.21.15.42:57772) 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 -- 172.21.15.42:0/1729263610 learned_addr learned my addr 172.21.15.42:0/1729263610 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde6121d700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c102720 0x7fde5c103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 -- 172.21.15.42:0/1729263610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c101e00 msgr2=0x7fde5c103850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c101e00 0x7fde5c103850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 -- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c102720 msgr2=0x7fde5c103d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c102720 0x7fde5c103d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 -- 172.21.15.42:0/1729263610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c104640 con 0x7fde5c101460 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde60a1c700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 0x7fde5c105200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde5000e950 tx=0x7fde5000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.048+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50004230 con 0x7fde5c101460 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.049+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde500043d0 con 0x7fde5c101460 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.049+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50010430 con 0x7fde5c101460 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.049+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c1a2740 con 0x7fde5c101460 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.049+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c1a2c50 con 0x7fde5c101460 2024-03-31T23:17:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.050+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5c068f00 con 0x7fde5c101460 2024-03-31T23:17:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.051+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fde5000c7e0 con 0x7fde5c101460 2024-03-31T23:17:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.051+0000 7fde59ffb700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fde4c0a25b0 0x7fde4c0a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.052+0000 7fde5bfff700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fde4c0a25b0 0x7fde4c0a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.052+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fde500ced40 con 0x7fde5c101460 2024-03-31T23:17:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.052+0000 7fde5bfff700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fde4c0a25b0 0x7fde4c0a4a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde48000c00 tx=0x7fde48005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:29.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.055+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fde5009bb40 con 0x7fde5c101460 2024-03-31T23:17:29.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.269+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fde5c1a2f10 con 0x7fde4c0a25b0 2024-03-31T23:17:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.283+0000 7fde59ffb700 1 -- 172.21.15.42:0/1729263610 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7fde5c1a2f10 con 0x7fde4c0a25b0 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.a smithi042 running (2m) 22s ago 2m 16.0M - 19.0.0-1977-g384f31f3 ec18d7baa60e d804080dd6db 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.b smithi094 running (2m) 54s ago 2m 26.3M - 19.0.0-1977-g384f31f3 ec18d7baa60e f34074edf473 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.c smithi188 running (2m) 54s ago 2m 19.6M - 19.0.0-1977-g384f31f3 ec18d7baa60e 36dbe4bda118 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.d smithi042 running (2m) 22s ago 2m 14.0M - 19.0.0-1977-g384f31f3 ec18d7baa60e 8c677f38087f 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.e smithi094 running (2m) 54s ago 2m 18.4M - 19.0.0-1977-g384f31f3 ec18d7baa60e b3f19d8e60c2 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.f smithi188 running (2m) 54s ago 2m 16.0M - 19.0.0-1977-g384f31f3 ec18d7baa60e fe1f16ec5f23 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.g smithi042 running (2m) 22s ago 2m 16.4M - 19.0.0-1977-g384f31f3 ec18d7baa60e b435f34e9bd1 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.h smithi094 running (2m) 54s ago 2m 17.6M - 19.0.0-1977-g384f31f3 ec18d7baa60e 427c02c34b76 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.i smithi188 running (2m) 54s ago 2m 17.4M - 19.0.0-1977-g384f31f3 ec18d7baa60e 35279880fdbf 2024-03-31T23:17:29.284 INFO:teuthology.orchestra.run.smithi042.stdout:mds.j smithi042 running (2m) 22s ago 2m 14.0M - 19.0.0-1977-g384f31f3 ec18d7baa60e fb2ead0503e3 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mds.k smithi094 running (2m) 54s ago 2m 15.0M - 19.0.0-1977-g384f31f3 ec18d7baa60e edc1229fc2b8 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mds.l smithi188 running (2m) 54s ago 2m 18.3M - 19.0.0-1977-g384f31f3 ec18d7baa60e 9dcc09fd4e75 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.x smithi042 *:9283,8765 running (9m) 22s ago 9m 514M - 19.0.0-1977-g384f31f3 ec18d7baa60e ba3aeb64305d 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.y smithi094 *:8443,8765 running (7m) 54s ago 7m 452M - 19.0.0-1977-g384f31f3 ec18d7baa60e 595da78b082b 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.z smithi188 *:8443,8765 running (7m) 54s ago 7m 452M - 19.0.0-1977-g384f31f3 ec18d7baa60e 39960ce38a16 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mon.a smithi042 running (9m) 22s ago 9m 53.2M 2048M 19.0.0-1977-g384f31f3 ec18d7baa60e 5e468e8e05c6 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mon.b smithi094 running (7m) 54s ago 7m 39.3M 2048M 19.0.0-1977-g384f31f3 ec18d7baa60e 41f61d177940 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:mon.c smithi188 running (8m) 54s ago 8m 39.4M 2048M 19.0.0-1977-g384f31f3 ec18d7baa60e 50bcb0a98509 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 smithi042 running (7m) 22s ago 7m 54.9M 4273M 19.0.0-1977-g384f31f3 ec18d7baa60e fdb3b50209b6 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 smithi094 running (7m) 54s ago 7m 49.5M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e b9df366ac9f7 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 smithi188 running (6m) 54s ago 6m 49.6M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e 1c4e54a7ad63 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 smithi042 running (6m) 22s ago 6m 43.8M 4273M 19.0.0-1977-g384f31f3 ec18d7baa60e b476ef182465 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 smithi094 running (5m) 54s ago 5m 52.3M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e ddc349100ac8 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 smithi188 running (5m) 54s ago 5m 44.8M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e d647c5b8d56c 2024-03-31T23:17:29.285 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 smithi042 running (4m) 22s ago 4m 44.8M 4273M 19.0.0-1977-g384f31f3 ec18d7baa60e 6249b426b708 2024-03-31T23:17:29.286 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 smithi094 running (4m) 54s ago 4m 54.7M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e a4397c9fb45b 2024-03-31T23:17:29.286 INFO:teuthology.orchestra.run.smithi042.stdout:osd.8 smithi188 running (4m) 54s ago 4m 42.8M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e affb58be7d76 2024-03-31T23:17:29.286 INFO:teuthology.orchestra.run.smithi042.stdout:osd.9 smithi042 running (3m) 22s ago 3m 43.2M 4273M 19.0.0-1977-g384f31f3 ec18d7baa60e 3ca25a81d62f 2024-03-31T23:17:29.286 INFO:teuthology.orchestra.run.smithi042.stdout:osd.10 smithi094 running (3m) 54s ago 3m 43.1M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e 6c37e54fa5c1 2024-03-31T23:17:29.286 INFO:teuthology.orchestra.run.smithi042.stdout:osd.11 smithi188 running (2m) 54s ago 2m 41.9M 4270M 19.0.0-1977-g384f31f3 ec18d7baa60e 23fa1b6c7d58 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fde4c0a25b0 msgr2=0x7fde4c0a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fde4c0a25b0 0x7fde4c0a4a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde48000c00 tx=0x7fde48005fb0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 msgr2=0x7fde5c105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 0x7fde5c105200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde5000e950 tx=0x7fde5000ec60 comp rx=0 tx=0).stop 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 shutdown_connections 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fde4c0a25b0 0x7fde4c0a4a70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde5c102720 0x7fde5c103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde5c101460 0x7fde5c105200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 --2- 172.21.15.42:0/1729263610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c101e00 0x7fde5c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 >> 172.21.15.42:0/1729263610 conn(0x7fde5c0fbe90 msgr2=0x7fde5c0fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 shutdown_connections 2024-03-31T23:17:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:29.285+0000 7fde62c80700 1 -- 172.21.15.42:0/1729263610 wait complete. 2024-03-31T23:17:29.999 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch ls' 2024-03-31T23:17:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:30.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:30 smithi094 ceph-mon[36167]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:30.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:30 smithi094 ceph-mon[36167]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:30.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:30 smithi188 ceph-mon[36068]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:30.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:30 smithi188 ceph-mon[36068]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:31.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:30 smithi042 ceph-mon[32380]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:31.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:30 smithi042 ceph-mon[32380]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 -- 172.21.15.42:0/4043686348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca04100cf0 msgr2=0x7fca0410a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 --2- 172.21.15.42:0/4043686348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca04100cf0 0x7fca0410a8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009f90 tx=0x7fc9fc00b330 comp rx=0 tx=0).stop 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 -- 172.21.15.42:0/4043686348 shutdown_connections 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 --2- 172.21.15.42:0/4043686348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca04100cf0 0x7fca0410a8a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 --2- 172.21.15.42:0/4043686348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca041038b0 0x7fca04103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 --2- 172.21.15.42:0/4043686348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 0x7fca041007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.073+0000 7fca0c16a700 1 -- 172.21.15.42:0/4043686348 >> 172.21.15.42:0/4043686348 conn(0x7fca040fbed0 msgr2=0x7fca040fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.074+0000 7fca0c16a700 1 -- 172.21.15.42:0/4043686348 shutdown_connections 2024-03-31T23:17:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.074+0000 7fca0c16a700 1 -- 172.21.15.42:0/4043686348 wait complete. 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.074+0000 7fca0c16a700 1 Processor -- start 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.074+0000 7fca0c16a700 1 -- start start 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0c16a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 0x7fca04198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0c16a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 0x7fca041989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0c16a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca041038b0 0x7fca0419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0c16a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca0410dff0 con 0x7fca04100cf0 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0c16a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fca0410de70 con 0x7fca04100330 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0c16a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca0410e170 con 0x7fca041038b0 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09705700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 0x7fca041989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09705700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 0x7fca041989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49912/0 (socket says 172.21.15.42:49912) 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09705700 1 -- 172.21.15.42:0/1603122527 learned_addr learned my addr 172.21.15.42:0/1603122527 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 0x7fca04198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca0a707700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca041038b0 0x7fca0419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 -- 172.21.15.42:0/1603122527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca041038b0 msgr2=0x7fca0419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca041038b0 0x7fca0419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 -- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 msgr2=0x7fca041989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 0x7fca041989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 -- 172.21.15.42:0/1603122527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca04101440 con 0x7fca04100330 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09705700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 0x7fca041989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.075+0000 7fca09f06700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 0x7fca04198490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4005fd0 tx=0x7fc9f400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.076+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400cbd0 con 0x7fca04100330 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.076+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9f400cd70 con 0x7fca04100330 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.076+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40188e0 con 0x7fca04100330 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.076+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca04101730 con 0x7fca04100330 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.076+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca04101c20 con 0x7fca04100330 2024-03-31T23:17:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.077+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca04068f00 con 0x7fca04100330 2024-03-31T23:17:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.078+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fc9f401f020 con 0x7fca04100330 2024-03-31T23:17:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.079+0000 7fca02ffd700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9ec0a25b0 0x7fc9ec0a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.079+0000 7fca09705700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9ec0a25b0 0x7fc9ec0a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:32.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.079+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc9f40cea20 con 0x7fca04100330 2024-03-31T23:17:32.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.079+0000 7fca09705700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9ec0a25b0 0x7fc9ec0a4a70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8005950 tx=0x7fc9f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.083+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc9f409b880 con 0x7fca04100330 2024-03-31T23:17:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.297+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fca04109290 con 0x7fc9ec0a25b0 2024-03-31T23:17:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.303+0000 7fca02ffd700 1 -- 172.21.15.42:0/1603122527 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fca04109290 con 0x7fc9ec0a25b0 2024-03-31T23:17:32.304 INFO:teuthology.orchestra.run.smithi042.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-31T23:17:32.304 INFO:teuthology.orchestra.run.smithi042.stdout:mds.all 12/12 57s ago 2m smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-03-31T23:17:32.304 INFO:teuthology.orchestra.run.smithi042.stdout:mgr 3/3 57s ago 7m smithi042=x;smithi094=y;smithi188=z;count:3 2024-03-31T23:17:32.304 INFO:teuthology.orchestra.run.smithi042.stdout:mon 3/3 57s ago 8m smithi042:172.21.15.42=a;smithi094:172.21.15.94=b;smithi188:172.21.15.188=c;count:3 2024-03-31T23:17:32.304 INFO:teuthology.orchestra.run.smithi042.stdout:osd 12 57s ago - 2024-03-31T23:17:32.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9ec0a25b0 msgr2=0x7fc9ec0a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:32.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9ec0a25b0 0x7fc9ec0a4a70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8005950 tx=0x7fc9f8009260 comp rx=0 tx=0).stop 2024-03-31T23:17:32.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 msgr2=0x7fca04198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 0x7fca04198490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4005fd0 tx=0x7fc9f400ee70 comp rx=0 tx=0).stop 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 shutdown_connections 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc9ec0a25b0 0x7fc9ec0a4a70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca041038b0 0x7fca0419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca04100330 0x7fca04198490 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 --2- 172.21.15.42:0/1603122527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca04100cf0 0x7fca041989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 >> 172.21.15.42:0/1603122527 conn(0x7fca040fbed0 msgr2=0x7fca04106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.305+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 shutdown_connections 2024-03-31T23:17:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:32.306+0000 7fca0c16a700 1 -- 172.21.15.42:0/1603122527 wait complete. 2024-03-31T23:17:32.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:32 smithi094 ceph-mon[36167]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:32.948 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:32 smithi042 ceph-mon[32380]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:32.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:32 smithi188 ceph-mon[36068]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:32.975 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch host ls' 2024-03-31T23:17:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:33 smithi094 ceph-mon[36167]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:33.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:33 smithi188 ceph-mon[36068]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:34.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:33 smithi042 ceph-mon[32380]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:34.638 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:34 smithi042 ceph-mon[32380]: pgmap v347: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:34.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:34 smithi094 ceph-mon[36167]: pgmap v347: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:34.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:34 smithi188 ceph-mon[36068]: pgmap v347: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 -- 172.21.15.42:0/273201665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102370 msgr2=0x7ffa2c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/273201665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102370 0x7ffa2c1027d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffa180099c0 tx=0x7ffa18009cd0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 -- 172.21.15.42:0/273201665 shutdown_connections 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/273201665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c102d10 0x7ffa2c1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/273201665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c101170 0x7ffa2c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/273201665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102370 0x7ffa2c1027d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 -- 172.21.15.42:0/273201665 >> 172.21.15.42:0/273201665 conn(0x7ffa2c0fc710 msgr2=0x7ffa2c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 -- 172.21.15.42:0/273201665 shutdown_connections 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.002+0000 7ffa32c3d700 1 -- 172.21.15.42:0/273201665 wait complete. 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 Processor -- start 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 -- start start 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 0x7ffa2c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c102370 0x7ffa2c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 0x7ffa2c19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c10ce50 con 0x7ffa2c102d10 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c10ccd0 con 0x7ffa2c102370 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa32c3d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c10cfd0 con 0x7ffa2c101170 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa311da700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 0x7ffa2c19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:35.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa309d9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 0x7ffa2c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa311da700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 0x7ffa2c19fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48202/0 (socket says 172.21.15.42:48202) 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa309d9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 0x7ffa2c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:44488/0 (socket says 172.21.15.42:44488) 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa311da700 1 -- 172.21.15.42:0/4275172970 learned_addr learned my addr 172.21.15.42:0/4275172970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.003+0000 7ffa2bfff700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c102370 0x7ffa2c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa309d9700 1 -- 172.21.15.42:0/4275172970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c102370 msgr2=0x7ffa2c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa309d9700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c102370 0x7ffa2c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa309d9700 1 -- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 msgr2=0x7ffa2c19fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa309d9700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 0x7ffa2c19fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa309d9700 1 -- 172.21.15.42:0/4275172970 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c1a01c0 con 0x7ffa2c101170 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa2bfff700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c102370 0x7ffa2c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa311da700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 0x7ffa2c19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa309d9700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 0x7ffa2c198560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000e9f0 tx=0x7ffa2000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20004220 con 0x7ffa2c101170 2024-03-31T23:17:35.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa200043c0 con 0x7ffa2c101170 2024-03-31T23:17:35.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2c1a04b0 con 0x7ffa2c101170 2024-03-31T23:17:35.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20003d60 con 0x7ffa2c101170 2024-03-31T23:17:35.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.004+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2c1a09f0 con 0x7ffa2c101170 2024-03-31T23:17:35.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.005+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2c068f00 con 0x7ffa2c101170 2024-03-31T23:17:35.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.006+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7ffa2000c7c0 con 0x7ffa2c101170 2024-03-31T23:17:35.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.007+0000 7ffa29ffb700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffa1c0a2530 0x7ffa1c0a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:35.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.007+0000 7ffa2bfff700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffa1c0a2530 0x7ffa1c0a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:35.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.007+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ffa200cecf0 con 0x7ffa2c101170 2024-03-31T23:17:35.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.007+0000 7ffa2bfff700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffa1c0a2530 0x7ffa1c0a49f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffa18003a60 tx=0x7ffa18005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:35.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.011+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ffa2009baf0 con 0x7ffa2c101170 2024-03-31T23:17:35.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.220+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ffa2c1a0cb0 con 0x7ffa1c0a2530 2024-03-31T23:17:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.222+0000 7ffa29ffb700 1 -- 172.21.15.42:0/4275172970 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ffa2c1a0cb0 con 0x7ffa1c0a2530 2024-03-31T23:17:35.222 INFO:teuthology.orchestra.run.smithi042.stdout:HOST ADDR LABELS STATUS 2024-03-31T23:17:35.223 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 172.21.15.42 2024-03-31T23:17:35.223 INFO:teuthology.orchestra.run.smithi042.stdout:smithi094 172.21.15.94 2024-03-31T23:17:35.223 INFO:teuthology.orchestra.run.smithi042.stdout:smithi188 172.21.15.188 2024-03-31T23:17:35.223 INFO:teuthology.orchestra.run.smithi042.stdout:3 hosts in cluster 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffa1c0a2530 msgr2=0x7ffa1c0a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffa1c0a2530 0x7ffa1c0a49f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffa18003a60 tx=0x7ffa18005fb0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 msgr2=0x7ffa2c198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 0x7ffa2c198560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000e9f0 tx=0x7ffa2000ed00 comp rx=0 tx=0).stop 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 shutdown_connections 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffa1c0a2530 0x7ffa1c0a49f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa2c101170 0x7ffa2c198560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c102d10 0x7ffa2c19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 --2- 172.21.15.42:0/4275172970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa2c102370 0x7ffa2c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 >> 172.21.15.42:0/4275172970 conn(0x7ffa2c0fc710 msgr2=0x7ffa2c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 shutdown_connections 2024-03-31T23:17:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:35.225+0000 7ffa32c3d700 1 -- 172.21.15.42:0/4275172970 wait complete. 2024-03-31T23:17:35.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch device ls' 2024-03-31T23:17:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:36.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:36 smithi042 ceph-mon[32380]: pgmap v348: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:36.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:36 smithi042 ceph-mon[32380]: from='client.25120 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:36.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:36 smithi094 ceph-mon[36167]: pgmap v348: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:36.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:36 smithi094 ceph-mon[36167]: from='client.25120 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:36.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:36 smithi188 ceph-mon[36068]: pgmap v348: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:36.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:36 smithi188 ceph-mon[36068]: from='client.25120 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:37.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 -- 172.21.15.42:0/2457973589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98102d10 msgr2=0x7fbf981095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:37.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/2457973589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98102d10 0x7fbf981095c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009f90 tx=0x7fbf9000b330 comp rx=0 tx=0).stop 2024-03-31T23:17:37.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 -- 172.21.15.42:0/2457973589 shutdown_connections 2024-03-31T23:17:37.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/2457973589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98102d10 0x7fbf981095c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/2457973589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98101170 0x7fbf98101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/2457973589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 0x7fbf981027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 -- 172.21.15.42:0/2457973589 >> 172.21.15.42:0/2457973589 conn(0x7fbf980fc710 msgr2=0x7fbf980feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:37.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 -- 172.21.15.42:0/2457973589 shutdown_connections 2024-03-31T23:17:37.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.671+0000 7fbf9cde5700 1 -- 172.21.15.42:0/2457973589 wait complete. 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 Processor -- start 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 -- start start 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98101170 0x7fbf981050b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 0x7fbf98103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 0x7fbf98103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810cf00 con 0x7fbf98102d10 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810cd80 con 0x7fbf98102370 2024-03-31T23:17:37.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9cde5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810d080 con 0x7fbf98101170 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf96d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 0x7fbf98103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf96d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 0x7fbf98103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48228/0 (socket says 172.21.15.42:48228) 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf96d9d700 1 -- 172.21.15.42:0/326453036 learned_addr learned my addr 172.21.15.42:0/326453036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf9659c700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98101170 0x7fbf981050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.672+0000 7fbf95d9b700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 0x7fbf98103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf95d9b700 1 -- 172.21.15.42:0/326453036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98101170 msgr2=0x7fbf981050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf95d9b700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98101170 0x7fbf981050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf95d9b700 1 -- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 msgr2=0x7fbf98103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf95d9b700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 0x7fbf98103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf95d9b700 1 -- 172.21.15.42:0/326453036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf981041d0 con 0x7fbf98102370 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf96d9d700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 0x7fbf98103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf95d9b700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 0x7fbf98103750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00e9f0 tx=0x7fbf8c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00c9c0 con 0x7fbf98102370 2024-03-31T23:17:37.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf98104460 con 0x7fbf98102370 2024-03-31T23:17:37.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf8c00cb60 con 0x7fbf98102370 2024-03-31T23:17:37.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c018660 con 0x7fbf98102370 2024-03-31T23:17:37.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.673+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a7090 con 0x7fbf98102370 2024-03-31T23:17:37.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.674+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf981a7260 con 0x7fbf98102370 2024-03-31T23:17:37.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.675+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fbf8c047a80 con 0x7fbf98102370 2024-03-31T23:17:37.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.676+0000 7fbf877fe700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf800a25b0 0x7fbf800a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:37.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.676+0000 7fbf9659c700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf800a25b0 0x7fbf800a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:37.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.676+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbf8c0cec20 con 0x7fbf98102370 2024-03-31T23:17:37.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.676+0000 7fbf9659c700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf800a25b0 0x7fbf800a4a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009750 tx=0x7fbf88009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:37.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.684+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbf8c09ba20 con 0x7fbf98102370 2024-03-31T23:17:37.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.897+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fbf980fe830 con 0x7fbf800a25b0 2024-03-31T23:17:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.899+0000 7fbf877fe700 1 -- 172.21.15.42:0/326453036 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fbf980fe830 con 0x7fbf800a25b0 2024-03-31T23:17:37.900 INFO:teuthology.orchestra.run.smithi042.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-31T23:17:37.900 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130021480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-31T23:17:37.900 INFO:teuthology.orchestra.run.smithi042.stdout:smithi094 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001L480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-31T23:17:37.900 INFO:teuthology.orchestra.run.smithi042.stdout:smithi188 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500MP400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-31T23:17:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf800a25b0 msgr2=0x7fbf800a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf800a25b0 0x7fbf800a4a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009750 tx=0x7fbf88009310 comp rx=0 tx=0).stop 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 msgr2=0x7fbf98103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 0x7fbf98103750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00e9f0 tx=0x7fbf8c00ed00 comp rx=0 tx=0).stop 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 shutdown_connections 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf800a25b0 0x7fbf800a4a70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf98101170 0x7fbf981050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf98102d10 0x7fbf98103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 --2- 172.21.15.42:0/326453036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98102370 0x7fbf98103750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 >> 172.21.15.42:0/326453036 conn(0x7fbf980fc710 msgr2=0x7fbf980fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 shutdown_connections 2024-03-31T23:17:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:37.901+0000 7fbf9cde5700 1 -- 172.21.15.42:0/326453036 wait complete. 2024-03-31T23:17:38.720 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-31T23:17:38.757 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:17:38.757 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-03-31T23:17:38.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:38 smithi094 ceph-mon[36167]: pgmap v349: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:38.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:38 smithi188 ceph-mon[36068]: pgmap v349: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:39.015 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:39.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:38 smithi042 ceph-mon[32380]: pgmap v349: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-31T23:17:39.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:39 smithi042 ceph-mon[32380]: from='client.25166 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:39 smithi094 ceph-mon[36167]: from='client.25166 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:39.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:39 smithi188 ceph-mon[36068]: from='client.25166 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:17:40.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:40 smithi042 ceph-mon[32380]: pgmap v350: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 -- 172.21.15.42:0/4132636344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103ed0 msgr2=0x7f95a410a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/4132636344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103ed0 0x7f95a410a780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f959c00b0a0 tx=0x7f959c00b3b0 comp rx=0 tx=0).stop 2024-03-31T23:17:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 -- 172.21.15.42:0/4132636344 shutdown_connections 2024-03-31T23:17:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/4132636344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103ed0 0x7f95a410a780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/4132636344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 0x7f95a4100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/4132636344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a4103530 0x7f95a4103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 -- 172.21.15.42:0/4132636344 >> 172.21.15.42:0/4132636344 conn(0x7f95a40fbed0 msgr2=0x7f95a40fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 -- 172.21.15.42:0/4132636344 shutdown_connections 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 -- 172.21.15.42:0/4132636344 wait complete. 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 Processor -- start 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.815+0000 7f95ab7a9700 1 -- start start 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 0x7f95a4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 0x7f95a41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a4103ed0 0x7f95a419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410dfc0 con 0x7f95a4103530 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410de40 con 0x7f95a4100550 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410e140 con 0x7f95a4103ed0 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 0x7f95a41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a9545700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 0x7f95a4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 0x7f95a41989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48248/0 (socket says 172.21.15.42:48248) 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a9545700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 0x7f95a4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:60824/0 (socket says 172.21.15.42:60824) 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 -- 172.21.15.42:0/3676091567 learned_addr learned my addr 172.21.15.42:0/3676091567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a9d46700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a4103ed0 0x7f95a419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 -- 172.21.15.42:0/3676091567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a4103ed0 msgr2=0x7f95a419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a4103ed0 0x7f95a419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 -- 172.21.15.42:0/3676091567 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 msgr2=0x7f95a4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 0x7f95a4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 -- 172.21.15.42:0/3676091567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a41a00d0 con 0x7f95a4103530 2024-03-31T23:17:40.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95a8d44700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 0x7f95a41989b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f959400e9d0 tx=0x7f959400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:40.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959400cbd0 con 0x7f95a4103530 2024-03-31T23:17:40.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f959400ee70 con 0x7f95a4103530 2024-03-31T23:17:40.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a41a03c0 con 0x7f95a4103530 2024-03-31T23:17:40.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594018710 con 0x7f95a4103530 2024-03-31T23:17:40.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.816+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a41a0950 con 0x7f95a4103530 2024-03-31T23:17:40.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.817+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a4068f00 con 0x7f95a4103530 2024-03-31T23:17:40.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.818+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f95940188b0 con 0x7f95a4103530 2024-03-31T23:17:40.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.819+0000 7f959a7fc700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f95900a25b0 0x7f95900a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:40.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.819+0000 7f95a9545700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f95900a25b0 0x7f95900a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:40.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.819+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f95940cee20 con 0x7f95a4103530 2024-03-31T23:17:40.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.819+0000 7f95a9545700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f95900a25b0 0x7f95900a4a70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95a406a7a0 tx=0x7f95a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:40.823+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f959409bc80 con 0x7f95a4103530 2024-03-31T23:17:40.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:40 smithi094 ceph-mon[36167]: pgmap v350: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:40.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:40 smithi188 ceph-mon[36068]: pgmap v350: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:17:41.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.073+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f95a4062e50 con 0x7f95a4103530 2024-03-31T23:17:41.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.074+0000 7f959a7fc700 1 -- 172.21.15.42:0/3676091567 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3086 (secure 0 0 0) 0x7f959409b580 con 0x7f95a4103530 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:e28 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:legacy client fscid: 1 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:Filesystem 'cephfs' (1) 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:fs_name cephfs 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 28 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-03-31T23:15:33.212486+0000 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-03-31T23:16:02.248954+0000 2024-03-31T23:17:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:tableserver 0 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:root 0 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:session_timeout 300 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:session_autoclose 300 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:max_file_size 1099511627776 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:max_xattr_size 65536 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:required_client_features {} 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:last_failure 0 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:last_failure_osd_epoch 0 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:max_mds 5 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:in 0,1,2,3,4 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:up {0=24497,1=24472,2=24464,3=24454,4=24442} 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:failed 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:damaged 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:stopped 2024-03-31T23:17:41.076 INFO:teuthology.orchestra.run.smithi042.stdout:data_pools [3,4] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:metadata_pool 2 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:inline_data disabled 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:balancer 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:bal_rank_mask -1 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:standby_count_wanted 0 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:qdb_cluster leader: 24497 members: 24472,24497,24464,24454,24442 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b{0:24497} state up:active seq 3 addr [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e{0:24431} state up:standby-replay seq 1 addr [v2:172.21.15.94:6834/1301341988,v1:172.21.15.94:6835/1301341988] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.i{1:24472} state up:active seq 11 addr [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.k{1:24398} state up:standby-replay seq 1 addr [v2:172.21.15.94:6832/2977205291,v1:172.21.15.94:6833/2977205291] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.h{2:24464} state up:active seq 12 addr [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.l{2:24397} state up:standby-replay seq 1 addr [v2:172.21.15.188:6832/524584837,v1:172.21.15.188:6833/524584837] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c{3:24454} state up:active seq 13 addr [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a{3:14646} state up:standby-replay seq 1 addr [v2:172.21.15.42:6840/1878678856,v1:172.21.15.42:6841/1878678856] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.077 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f{4:24442} state up:active seq 14 addr [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.g{4:14634} state up:standby-replay seq 1 addr [v2:172.21.15.42:6838/2174921226,v1:172.21.15.42:6839/2174921226] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout:Standby daemons: 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.j{-1:14550} state up:standby seq 1 addr [v2:172.21.15.42:6834/957043264,v1:172.21.15.42:6835/957043264] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.078 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d{-1:14562} state up:standby seq 1 addr [v2:172.21.15.42:6836/795209517,v1:172.21.15.42:6837/795209517] compat {c=[1],r=[1],i=[1fff]}] 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f95900a25b0 msgr2=0x7f95900a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f95900a25b0 0x7f95900a4a70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95a406a7a0 tx=0x7f95a0009260 comp rx=0 tx=0).stop 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 msgr2=0x7f95a41989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 0x7f95a41989b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f959400e9d0 tx=0x7f959400ece0 comp rx=0 tx=0).stop 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 shutdown_connections 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f95900a25b0 0x7f95900a4a70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a4103ed0 0x7f95a419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:41.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95a4100550 0x7f95a4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:41.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 --2- 172.21.15.42:0/3676091567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a4103530 0x7f95a41989b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:41.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 >> 172.21.15.42:0/3676091567 conn(0x7f95a40fbed0 msgr2=0x7f95a4106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:41.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 shutdown_connections 2024-03-31T23:17:41.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:41.076+0000 7f95ab7a9700 1 -- 172.21.15.42:0/3676091567 wait complete. 2024-03-31T23:17:41.080 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:17:41.733 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:41 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3676091567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-31T23:17:41.734 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-03-31T23:17:41.734 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:41 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-03-31T23:17:41.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph osd dump' 2024-03-31T23:17:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:41 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3676091567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-31T23:17:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-03-31T23:17:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:41 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-03-31T23:17:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:41 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3676091567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-31T23:17:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-03-31T23:17:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:41 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-03-31T23:17:41.982 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:42 smithi094 ceph-mon[36167]: pgmap v351: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-03-31T23:17:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:42 smithi094 ceph-mon[36167]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-03-31T23:17:42.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:42 smithi094 ceph-mon[36167]: osdmap e92: 12 total, 12 up, 12 in 2024-03-31T23:17:42.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:42 smithi188 ceph-mon[36068]: pgmap v351: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:42.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-03-31T23:17:42.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:42 smithi188 ceph-mon[36068]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-03-31T23:17:42.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:42 smithi188 ceph-mon[36068]: osdmap e92: 12 total, 12 up, 12 in 2024-03-31T23:17:43.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:42 smithi042 ceph-mon[32380]: pgmap v351: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-31T23:17:43.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-03-31T23:17:43.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:42 smithi042 ceph-mon[32380]: from='mgr.14152 172.21.15.42:0/3019525875' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-03-31T23:17:43.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:42 smithi042 ceph-mon[32380]: osdmap e92: 12 total, 12 up, 12 in 2024-03-31T23:17:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.566+0000 7f136e59a700 1 -- 172.21.15.42:0/2113212381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 msgr2=0x7f1368102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.566+0000 7f136e59a700 1 --2- 172.21.15.42:0/2113212381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f1368102690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f13580099c0 tx=0x7f1358009cd0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 -- 172.21.15.42:0/2113212381 shutdown_connections 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 --2- 172.21.15.42:0/2113212381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103e10 0x7f136810a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 --2- 172.21.15.42:0/2113212381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f1368102690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 --2- 172.21.15.42:0/2113212381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103470 0x7f13681038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 -- 172.21.15.42:0/2113212381 >> 172.21.15.42:0/2113212381 conn(0x7f13680fd850 msgr2=0x7f13680ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 -- 172.21.15.42:0/2113212381 shutdown_connections 2024-03-31T23:17:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 -- 172.21.15.42:0/2113212381 wait complete. 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 Processor -- start 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.567+0000 7f136e59a700 1 -- start start 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f136819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103470 0x7f136819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103e10 0x7f13681a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f136810df60 con 0x7f1368102270 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f136810dde0 con 0x7f1368103470 2024-03-31T23:17:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f136810e0e0 con 0x7f1368103e10 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f1367fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f136819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f1367fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f136819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60514/0 (socket says 172.21.15.42:60514) 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f1367fff700 1 -- 172.21.15.42:0/1027369891 learned_addr learned my addr 172.21.15.42:0/1027369891 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103470 0x7f136819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136cb37700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103e10 0x7f13681a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 -- 172.21.15.42:0/1027369891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103e10 msgr2=0x7f13681a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103e10 0x7f13681a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 -- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 msgr2=0x7f136819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f136819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 -- 172.21.15.42:0/1027369891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13681a2420 con 0x7f1368103470 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f1367fff700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f136819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136cb37700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103e10 0x7f13681a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13677fe700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103470 0x7f136819ad00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f135c00e9f0 tx=0x7f135c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c004220 con 0x7f1368103470 2024-03-31T23:17:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13681a2710 con 0x7f1368103470 2024-03-31T23:17:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f135c004d30 con 0x7f1368103470 2024-03-31T23:17:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.568+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c005020 con 0x7f1368103470 2024-03-31T23:17:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.569+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13681a2c50 con 0x7f1368103470 2024-03-31T23:17:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.569+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1368068f00 con 0x7f1368103470 2024-03-31T23:17:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.571+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f135c0053f0 con 0x7f1368103470 2024-03-31T23:17:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.571+0000 7f13657fa700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f13500a2530 0x7f13500a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.571+0000 7f1367fff700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f13500a2530 0x7f13500a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.571+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f135c0ceaf0 con 0x7f1368103470 2024-03-31T23:17:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.571+0000 7f1367fff700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f13500a2530 0x7f13500a49f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1358000c00 tx=0x7f1358005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:43.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.574+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f135c09b920 con 0x7f1368103470 2024-03-31T23:17:43.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.781+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f13681a2f10 con 0x7f1368103470 2024-03-31T23:17:43.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.782+0000 7f13657fa700 1 -- 172.21.15.42:0/1027369891 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) ==== 56+0+5628 (secure 0 0 0) 0x7f135c00c760 con 0x7f1368103470 2024-03-31T23:17:43.783 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 93 2024-03-31T23:17:43.783 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-03-31T23:07:44.954200+0000 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-03-31T23:17:42.640704+0000 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:crush_version 27 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:full_ratio 0.95 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:backfillfull_ratio 0.9 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:nearfull_ratio 0.85 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:require_min_compat_client luminous 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:min_compat_client luminous 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:require_osd_release squid 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:stretch_mode_enabled false 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-03-31T23:17:43.784 INFO:teuthology.orchestra.run.smithi042.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:max_osd 12 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6802/2561562305,v1:172.21.15.42:6803/2561562305] [v2:172.21.15.42:6804/2561562305,v1:172.21.15.42:6805/2561562305] exists,up fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6800/3613405638,v1:172.21.15.94:6801/3613405638] [v2:172.21.15.94:6802/3613405638,v1:172.21.15.94:6803/3613405638] exists,up 7c72d11f-d1e4-429e-b066-1fc0cc75bc37 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6800/3086405523,v1:172.21.15.188:6801/3086405523] [v2:172.21.15.188:6802/3086405523,v1:172.21.15.188:6803/3086405523] exists,up 35000c1d-43e1-4918-aa28-dac85f3b7802 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6810/3411304012,v1:172.21.15.42:6811/3411304012] [v2:172.21.15.42:6812/3411304012,v1:172.21.15.42:6813/3411304012] exists,up f930edaa-f275-44f4-ae10-1699013ce78b 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 up in weight 1 up_from 33 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6808/3966467075,v1:172.21.15.94:6809/3966467075] [v2:172.21.15.94:6810/3966467075,v1:172.21.15.94:6811/3966467075] exists,up cf0bfa0c-ff89-4cfa-ae26-a97164273ee9 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 up in weight 1 up_from 38 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6808/432169288,v1:172.21.15.188:6809/432169288] [v2:172.21.15.188:6810/432169288,v1:172.21.15.188:6811/432169288] exists,up 0176a668-abe0-43f2-98de-235389566eb6 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6818/2819581932,v1:172.21.15.42:6819/2819581932] [v2:172.21.15.42:6820/2819581932,v1:172.21.15.42:6821/2819581932] exists,up 7878060c-9e7e-4383-98be-826d47820b5e 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 up in weight 1 up_from 51 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6816/2551405001,v1:172.21.15.94:6817/2551405001] [v2:172.21.15.94:6818/2551405001,v1:172.21.15.94:6819/2551405001] exists,up 864a3347-34e1-4a21-96be-9c620c631fd8 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.8 up in weight 1 up_from 59 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6816/1325771974,v1:172.21.15.188:6817/1325771974] [v2:172.21.15.188:6818/1325771974,v1:172.21.15.188:6819/1325771974] exists,up 290efe08-cf7f-4cfb-8dcf-c346705f3b7c 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.9 up in weight 1 up_from 67 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6826/892645704,v1:172.21.15.42:6827/892645704] [v2:172.21.15.42:6828/892645704,v1:172.21.15.42:6829/892645704] exists,up 2b15764c-d0d6-4f5b-89e1-4f1c3b673599 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.10 up in weight 1 up_from 72 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6824/12358886,v1:172.21.15.94:6825/12358886] [v2:172.21.15.94:6826/12358886,v1:172.21.15.94:6827/12358886] exists,up b06f08e0-c853-4d15-8a08-c35257d23814 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.11 up in weight 1 up_from 80 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6824/3794628957,v1:172.21.15.188:6825/3794628957] [v2:172.21.15.188:6826/3794628957,v1:172.21.15.188:6827/3794628957] exists,up 047cc9e9-aff1-433b-b4df-145e31c678c8 2024-03-31T23:17:43.785 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.a [2,11] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.f [8,11] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.1 [4,9] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.6 [3,6] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.c [3,9] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.11 [5,9] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.1d [4,7] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.23 [4,8] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 4.2 [9,1] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 4.9 [5,10] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 4.f [9,8] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 4.1f [9,8] 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6801/1517474041 expires 2024-04-01T23:08:40.680947+0000 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6800/1517474041 expires 2024-04-01T23:08:40.680947+0000 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/1353829037 expires 2024-04-01T23:08:40.680947+0000 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/3347343211 expires 2024-04-01T23:08:14.773907+0000 2024-03-31T23:17:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/99599854 expires 2024-04-01T23:08:40.680947+0000 2024-03-31T23:17:43.787 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/510916434 expires 2024-04-01T23:08:14.773907+0000 2024-03-31T23:17:43.787 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/355558561 expires 2024-04-01T23:08:14.773907+0000 2024-03-31T23:17:43.787 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6800/3342764964 expires 2024-04-01T23:08:14.773907+0000 2024-03-31T23:17:43.787 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6801/3342764964 expires 2024-04-01T23:08:14.773907+0000 2024-03-31T23:17:43.787 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/3890423578 expires 2024-04-01T23:08:40.680947+0000 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.784+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f13500a2530 msgr2=0x7f13500a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.784+0000 7f136e59a700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f13500a2530 0x7f13500a49f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1358000c00 tx=0x7f1358005fb0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.784+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103470 msgr2=0x7f136819ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.784+0000 7f136e59a700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103470 0x7f136819ad00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f135c00e9f0 tx=0x7f135c00ed00 comp rx=0 tx=0).stop 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 shutdown_connections 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f13500a2530 0x7f13500a49f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1368103e10 0x7f13681a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1368102270 0x7f136819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 --2- 172.21.15.42:0/1027369891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1368103470 0x7f136819ad00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 >> 172.21.15.42:0/1027369891 conn(0x7f13680fd850 msgr2=0x7f1368074470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 shutdown_connections 2024-03-31T23:17:43.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:43.785+0000 7f136e59a700 1 -- 172.21.15.42:0/1027369891 wait complete. 2024-03-31T23:17:43.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:43 smithi094 ceph-mon[36167]: osdmap e93: 12 total, 12 up, 12 in 2024-03-31T23:17:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:43 smithi188 ceph-mon[36068]: osdmap e93: 12 total, 12 up, 12 in 2024-03-31T23:17:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:43 smithi042 ceph-mon[32380]: osdmap e93: 12 total, 12 up, 12 in 2024-03-31T23:17:44.440 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-31T23:17:44.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:44.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 -- 172.21.15.42:0/1037654615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0102240 msgr2=0x7fb8f0108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/1037654615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0102240 0x7fb8f0108ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009ca0 tx=0x7fb8e802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 -- 172.21.15.42:0/1037654615 shutdown_connections 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/1037654615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0102240 0x7fb8f0108ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/1037654615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0101880 0x7fb8f0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/1037654615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8f0100690 0x7fb8f0100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 -- 172.21.15.42:0/1037654615 >> 172.21.15.42:0/1037654615 conn(0x7fb8f00fbc00 msgr2=0x7fb8f00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 -- 172.21.15.42:0/1037654615 shutdown_connections 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.560+0000 7fb8f4e64640 1 -- 172.21.15.42:0/1037654615 wait complete. 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 Processor -- start 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 -- start start 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 0x7fb8f0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8f0101880 0x7fb8f0198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 0x7fb8f019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f010c440 con 0x7fb8f0102240 2024-03-31T23:17:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f010c2c0 con 0x7fb8f0101880 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8f4e64640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f010c5c0 con 0x7fb8f0100690 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8eed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 0x7fb8f019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8ee59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 0x7fb8f0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.561+0000 7fb8ee59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 0x7fb8f0197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38648/0 (socket says 172.21.15.42:38648) 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8ee59c640 1 -- 172.21.15.42:0/2444233549 learned_addr learned my addr 172.21.15.42:0/2444233549 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 0x7fb8f019f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60528/0 (socket says 172.21.15.42:60528) 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8e7fff640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8f0101880 0x7fb8f0198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 -- 172.21.15.42:0/2444233549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 msgr2=0x7fb8f0197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 0x7fb8f0197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 -- 172.21.15.42:0/2444233549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8f0101880 msgr2=0x7fb8f0198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8f0101880 0x7fb8f0198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 -- 172.21.15.42:0/2444233549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f019f770 con 0x7fb8f0102240 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8ee59c640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 0x7fb8f0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8eed9d640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 0x7fb8f019f100 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb8e802c630 tx=0x7fb8e80346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8039040 con 0x7fb8f0102240 2024-03-31T23:17:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f019fa00 con 0x7fb8f0102240 2024-03-31T23:17:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8e8044070 con 0x7fb8f0102240 2024-03-31T23:17:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8004500 con 0x7fb8f0102240 2024-03-31T23:17:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.562+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f019ff10 con 0x7fb8f0102240 2024-03-31T23:17:44.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.563+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f01a0200 con 0x7fb8f0102240 2024-03-31T23:17:44.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.564+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fb8e80046a0 con 0x7fb8f0102240 2024-03-31T23:17:44.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.565+0000 7fb8e77fe640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb8dc0a24a0 0x7fb8dc0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.565+0000 7fb8ee59c640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb8dc0a24a0 0x7fb8dc0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.565+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fb8e80f1b10 con 0x7fb8f0102240 2024-03-31T23:17:44.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.565+0000 7fb8ee59c640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb8dc0a24a0 0x7fb8dc0a4960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00058c0 tx=0x7fb8e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:44.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.569+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb8e80be8e0 con 0x7fb8f0102240 2024-03-31T23:17:44.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.752+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8f01a04f0 con 0x7fb8f0102240 2024-03-31T23:17:44.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.754+0000 7fb8e77fe640 1 -- 172.21.15.42:0/2444233549 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7fb8e80be1e0 con 0x7fb8f0102240 2024-03-31T23:17:44.755 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:44.755 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb8dc0a24a0 msgr2=0x7fb8dc0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb8dc0a24a0 0x7fb8dc0a4960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00058c0 tx=0x7fb8e0005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 msgr2=0x7fb8f019f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 0x7fb8f019f100 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb8e802c630 tx=0x7fb8e80346f0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 shutdown_connections 2024-03-31T23:17:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb8dc0a24a0 0x7fb8dc0a4960 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8f0102240 0x7fb8f019f100 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8f0101880 0x7fb8f0198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 --2- 172.21.15.42:0/2444233549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8f0100690 0x7fb8f0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 >> 172.21.15.42:0/2444233549 conn(0x7fb8f00fbc00 msgr2=0x7fb8f00fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 shutdown_connections 2024-03-31T23:17:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.756+0000 7fb8f4e64640 1 -- 172.21.15.42:0/2444233549 wait complete. 2024-03-31T23:17:44.767 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:44 smithi042 ceph-mon[32380]: pgmap v354: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-31T23:17:44.767 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:44 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1027369891' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-31T23:17:44.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:44.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 -- 172.21.15.42:0/1401927402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748102220 msgr2=0x7f8748108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 --2- 172.21.15.42:0/1401927402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748102220 0x7f8748108ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8740009ca0 tx=0x7f874002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 -- 172.21.15.42:0/1401927402 shutdown_connections 2024-03-31T23:17:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 --2- 172.21.15.42:0/1401927402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748102220 0x7f8748108ab0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 --2- 172.21.15.42:0/1401927402 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748101860 0x7f8748101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 --2- 172.21.15.42:0/1401927402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748100670 0x7f8748100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 -- 172.21.15.42:0/1401927402 >> 172.21.15.42:0/1401927402 conn(0x7f87480fbc20 msgr2=0x7f87480fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 -- 172.21.15.42:0/1401927402 shutdown_connections 2024-03-31T23:17:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.875+0000 7f8750015640 1 -- 172.21.15.42:0/1401927402 wait complete. 2024-03-31T23:17:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 Processor -- start 2024-03-31T23:17:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 -- start start 2024-03-31T23:17:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748100670 0x7f8748197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 0x7f8748197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748102220 0x7f874819f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f874810c410 con 0x7f8748101860 2024-03-31T23:17:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f874810c290 con 0x7f8748100670 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f8750015640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f874810c590 con 0x7f8748102220 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 0x7f8748197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 0x7f8748197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60548/0 (socket says 172.21.15.42:60548) 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 -- 172.21.15.42:0/3803290675 learned_addr learned my addr 172.21.15.42:0/3803290675 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874e5b2640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748102220 0x7f874819f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874ddb1640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748100670 0x7f8748197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 -- 172.21.15.42:0/3803290675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748102220 msgr2=0x7f874819f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748102220 0x7f874819f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 -- 172.21.15.42:0/3803290675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748100670 msgr2=0x7f8748197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748100670 0x7f8748197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 -- 172.21.15.42:0/3803290675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874819f6a0 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874e5b2640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748102220 0x7f874819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874ddb1640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748100670 0x7f8748197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.876+0000 7f874d5b0640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 0x7f8748197fc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f873800e9f0 tx=0x7f873800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.877+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873800cd80 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.877+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8738010930 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.877+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738018b00 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.877+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874819f990 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.877+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874819fe90 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.878+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87481a00c0 con 0x7f8748101860 2024-03-31T23:17:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.879+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f8738018ca0 con 0x7f8748101860 2024-03-31T23:17:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.879+0000 7f873effd640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f87340a2520 0x7f87340a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.879+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f87380cf100 con 0x7f8748101860 2024-03-31T23:17:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.879+0000 7f874ddb1640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f87340a2520 0x7f87340a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.880+0000 7f874ddb1640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f87340a2520 0x7f87340a49e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87481016c0 tx=0x7f8744005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:44.883+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f873809b8e0 con 0x7f8748101860 2024-03-31T23:17:44.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:44 smithi094 ceph-mon[36167]: pgmap v354: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-31T23:17:44.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:44 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1027369891' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-31T23:17:44.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:44 smithi188 ceph-mon[36068]: pgmap v354: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-31T23:17:44.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:44 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1027369891' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-31T23:17:45.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.065+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f87481a03b0 con 0x7f8748101860 2024-03-31T23:17:45.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.065+0000 7f873effd640 1 -- 172.21.15.42:0/3803290675 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f873809f980 con 0x7f8748101860 2024-03-31T23:17:45.066 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:45.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f87340a2520 msgr2=0x7f87340a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f87340a2520 0x7f87340a49e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87481016c0 tx=0x7f8744005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:45.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 msgr2=0x7f8748197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 0x7f8748197fc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f873800e9f0 tx=0x7f873800eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 shutdown_connections 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8748102220 0x7f874819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f87340a2520 0x7f87340a49e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8748101860 0x7f8748197fc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 --2- 172.21.15.42:0/3803290675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8748100670 0x7f8748197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.067+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 >> 172.21.15.42:0/3803290675 conn(0x7f87480fbc20 msgr2=0x7f8748069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.068+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 shutdown_connections 2024-03-31T23:17:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.068+0000 7f8750015640 1 -- 172.21.15.42:0/3803290675 wait complete. 2024-03-31T23:17:45.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:17:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 -- 172.21.15.42:0/1013146649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0103310 msgr2=0x7f21a0109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/1013146649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0103310 0x7f21a0109ba0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2198009ca0 tx=0x7f219802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 -- 172.21.15.42:0/1013146649 shutdown_connections 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/1013146649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0103310 0x7f21a0109ba0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/1013146649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21a0102950 0x7f21a0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/1013146649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21a0101760 0x7f21a0101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 -- 172.21.15.42:0/1013146649 >> 172.21.15.42:0/1013146649 conn(0x7f21a00fccf0 msgr2=0x7f21a00ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 -- 172.21.15.42:0/1013146649 shutdown_connections 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.185+0000 7f21a5d6c640 1 -- 172.21.15.42:0/1013146649 wait complete. 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 Processor -- start 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 -- start start 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21a0101760 0x7f21a0197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 0x7f21a0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21a0103310 0x7f21a019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f21a010d500 con 0x7f21a0102950 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f21a010d380 con 0x7f21a0103310 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f21a5d6c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f21a010d680 con 0x7f21a0101760 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f219effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 0x7f21a0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f219effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 0x7f21a0198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60570/0 (socket says 172.21.15.42:60570) 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f219effd640 1 -- 172.21.15.42:0/3613839097 learned_addr learned my addr 172.21.15.42:0/3613839097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f219f7fe640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21a0101760 0x7f21a0197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.186+0000 7f219ffff640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21a0103310 0x7f21a019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219effd640 1 -- 172.21.15.42:0/3613839097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21a0101760 msgr2=0x7f21a0197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219effd640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21a0101760 0x7f21a0197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219effd640 1 -- 172.21.15.42:0/3613839097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21a0103310 msgr2=0x7f21a019f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219effd640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21a0103310 0x7f21a019f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219effd640 1 -- 172.21.15.42:0/3613839097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a019f700 con 0x7f21a0102950 2024-03-31T23:17:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219effd640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 0x7f21a0198020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f219400e9f0 tx=0x7f219400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:45.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219400cd80 con 0x7f21a0102950 2024-03-31T23:17:45.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2194010930 con 0x7f21a0102950 2024-03-31T23:17:45.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a019f9f0 con 0x7f21a0102950 2024-03-31T23:17:45.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194018b00 con 0x7f21a0102950 2024-03-31T23:17:45.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.187+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a019ff90 con 0x7f21a0102950 2024-03-31T23:17:45.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.188+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a0108a80 con 0x7f21a0102950 2024-03-31T23:17:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.189+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f2194018ca0 con 0x7f21a0102950 2024-03-31T23:17:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.189+0000 7f219cff9640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f21880a2520 0x7f21880a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.190+0000 7f219f7fe640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f21880a2520 0x7f21880a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.190+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f21940cf060 con 0x7f21a0102950 2024-03-31T23:17:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.190+0000 7f219f7fe640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f21880a2520 0x7f21880a49e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2190005fd0 tx=0x7f219000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:45.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.193+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f219409b840 con 0x7f21a0102950 2024-03-31T23:17:45.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.376+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f21a002d300 con 0x7f21a0102950 2024-03-31T23:17:45.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.376+0000 7f219cff9640 1 -- 172.21.15.42:0/3613839097 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f219409f8e0 con 0x7f21a0102950 2024-03-31T23:17:45.377 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f21880a2520 msgr2=0x7f21880a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f21880a2520 0x7f21880a49e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2190005fd0 tx=0x7f219000b410 comp rx=0 tx=0).stop 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 msgr2=0x7f21a0198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 0x7f21a0198020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f219400e9f0 tx=0x7f219400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 shutdown_connections 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21a0103310 0x7f21a019f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f21880a2520 0x7f21880a49e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21a0102950 0x7f21a0198020 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 --2- 172.21.15.42:0/3613839097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21a0101760 0x7f21a0197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 >> 172.21.15.42:0/3613839097 conn(0x7f21a00fccf0 msgr2=0x7f21a0105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 shutdown_connections 2024-03-31T23:17:45.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.378+0000 7f21a5d6c640 1 -- 172.21.15.42:0/3613839097 wait complete. 2024-03-31T23:17:45.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 -- 172.21.15.42:0/1212627158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 msgr2=0x7f9c88108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/1212627158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c88108ab0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009ca0 tx=0x7f9c8002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 -- 172.21.15.42:0/1212627158 shutdown_connections 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/1212627158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c88108ab0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/1212627158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c88101860 0x7f9c88101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/1212627158 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c88100670 0x7f9c88100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 -- 172.21.15.42:0/1212627158 >> 172.21.15.42:0/1212627158 conn(0x7f9c880fbc20 msgr2=0x7f9c880fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 -- 172.21.15.42:0/1212627158 shutdown_connections 2024-03-31T23:17:45.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 -- 172.21.15.42:0/1212627158 wait complete. 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.495+0000 7f9c8dc84640 1 Processor -- start 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 -- start start 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c88100670 0x7f9c88197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c88101860 0x7f9c88197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c8819f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8810c420 con 0x7f9c88102220 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8810c2a0 con 0x7f9c88101860 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c8dc84640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8810c5a0 con 0x7f9c88100670 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c8819f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c8819f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60592/0 (socket says 172.21.15.42:60592) 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 -- 172.21.15.42:0/2482966765 learned_addr learned my addr 172.21.15.42:0/2482966765 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c877fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c88100670 0x7f9c88197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c86ffd640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c88101860 0x7f9c88197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 -- 172.21.15.42:0/2482966765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c88100670 msgr2=0x7f9c88197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c88100670 0x7f9c88197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 -- 172.21.15.42:0/2482966765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c88101860 msgr2=0x7f9c88197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c88101860 0x7f9c88197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 -- 172.21.15.42:0/2482966765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8819f6b0 con 0x7f9c88102220 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.496+0000 7f9c87fff640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c8819f040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9c8002c700 tx=0x7f9c800346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.497+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80039040 con 0x7f9c88102220 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.497+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c80044070 con 0x7f9c88102220 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.497+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8819f940 con 0x7f9c88102220 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.497+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800043c0 con 0x7f9c88102220 2024-03-31T23:17:45.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.497+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8819fe30 con 0x7f9c88102220 2024-03-31T23:17:45.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.498+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c881a0060 con 0x7f9c88102220 2024-03-31T23:17:45.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.499+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f9c800045a0 con 0x7f9c88102220 2024-03-31T23:17:45.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.499+0000 7f9c84ff9640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9c700a24a0 0x7f9c700a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.499+0000 7f9c877fe640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9c700a24a0 0x7f9c700a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.499+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9c800f10a0 con 0x7f9c88102220 2024-03-31T23:17:45.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.500+0000 7f9c877fe640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9c700a24a0 0x7f9c700a4960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9c881016c0 tx=0x7f9c78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:45.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.504+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9c800bded0 con 0x7f9c88102220 2024-03-31T23:17:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.685+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9c881a02d0 con 0x7f9c88102220 2024-03-31T23:17:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.685+0000 7f9c84ff9640 1 -- 172.21.15.42:0/2482966765 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f9c800dd020 con 0x7f9c88102220 2024-03-31T23:17:45.686 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:17:45.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9c700a24a0 msgr2=0x7f9c700a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9c700a24a0 0x7f9c700a4960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9c881016c0 tx=0x7f9c78005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:45.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 msgr2=0x7f9c8819f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c8819f040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9c8002c700 tx=0x7f9c800346d0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 shutdown_connections 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9c700a24a0 0x7f9c700a4960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c88102220 0x7f9c8819f040 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c88101860 0x7f9c88197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.687+0000 7f9c8dc84640 1 --2- 172.21.15.42:0/2482966765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c88100670 0x7f9c88197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.688+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 >> 172.21.15.42:0/2482966765 conn(0x7f9c880fbc20 msgr2=0x7f9c88069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.688+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 shutdown_connections 2024-03-31T23:17:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.688+0000 7f9c8dc84640 1 -- 172.21.15.42:0/2482966765 wait complete. 2024-03-31T23:17:45.699 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:17:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 -- 172.21.15.42:0/737337699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 msgr2=0x7fbf44101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/737337699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44101b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009ca0 tx=0x7fbf3c02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 -- 172.21.15.42:0/737337699 shutdown_connections 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/737337699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 0x7fbf44109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/737337699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf44102950 0x7fbf44102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/737337699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44101b80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 -- 172.21.15.42:0/737337699 >> 172.21.15.42:0/737337699 conn(0x7fbf440fccf0 msgr2=0x7fbf440ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 -- 172.21.15.42:0/737337699 shutdown_connections 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.804+0000 7fbf4aafb640 1 -- 172.21.15.42:0/737337699 wait complete. 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 Processor -- start 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 -- start start 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf44102950 0x7fbf441980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 0x7fbf4419f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410d510 con 0x7fbf44101760 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410d390 con 0x7fbf44103310 2024-03-31T23:17:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf4aafb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410d690 con 0x7fbf44102950 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf48897640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf48897640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60610/0 (socket says 172.21.15.42:60610) 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf48897640 1 -- 172.21.15.42:0/660954419 learned_addr learned my addr 172.21.15.42:0/660954419 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf43fff640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf44102950 0x7fbf441980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.805+0000 7fbf49098640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 0x7fbf4419f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf48897640 1 -- 172.21.15.42:0/660954419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf44102950 msgr2=0x7fbf441980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf48897640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf44102950 0x7fbf441980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf48897640 1 -- 172.21.15.42:0/660954419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 msgr2=0x7fbf4419f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf48897640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 0x7fbf4419f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf48897640 1 -- 172.21.15.42:0/660954419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4419f7d0 con 0x7fbf44101760 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf49098640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 0x7fbf4419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf48897640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44197bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c037040 tx=0x7fbf3c0346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c039040 con 0x7fbf44101760 2024-03-31T23:17:45.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4419fa60 con 0x7fbf44101760 2024-03-31T23:17:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf3c044070 con 0x7fbf44101760 2024-03-31T23:17:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0044d0 con 0x7fbf44101760 2024-03-31T23:17:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.806+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4419ffa0 con 0x7fbf44101760 2024-03-31T23:17:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.807+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf44108a80 con 0x7fbf44101760 2024-03-31T23:17:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.808+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fbf3c004670 con 0x7fbf44101760 2024-03-31T23:17:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.809+0000 7fbf41ffb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf2c0a24a0 0x7fbf2c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.809+0000 7fbf43fff640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf2c0a24a0 0x7fbf2c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.809+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fbf3c0f1bc0 con 0x7fbf44101760 2024-03-31T23:17:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.809+0000 7fbf43fff640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf2c0a24a0 0x7fbf2c0a4960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbf441990c0 tx=0x7fbf38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.812+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbf3c0be9f0 con 0x7fbf44101760 2024-03-31T23:17:45.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:45 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2444233549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:45.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:45 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3803290675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:45.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:45 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3613839097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:45.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:45 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2444233549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:45.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:45 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3803290675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:45.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:45 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3613839097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:45.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.993+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbf4402d170 con 0x7fbf44101760 2024-03-31T23:17:45.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.994+0000 7fbf41ffb640 1 -- 172.21.15.42:0/660954419 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fbf3c0be2f0 con 0x7fbf44101760 2024-03-31T23:17:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf2c0a24a0 msgr2=0x7fbf2c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf2c0a24a0 0x7fbf2c0a4960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbf441990c0 tx=0x7fbf38005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 msgr2=0x7fbf44197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44197bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c037040 tx=0x7fbf3c0346f0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 shutdown_connections 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf44103310 0x7fbf4419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf44102950 0x7fbf441980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf2c0a24a0 0x7fbf2c0a4960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 --2- 172.21.15.42:0/660954419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf44101760 0x7fbf44197bb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 >> 172.21.15.42:0/660954419 conn(0x7fbf440fccf0 msgr2=0x7fbf44105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 shutdown_connections 2024-03-31T23:17:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:45.996+0000 7fbf4aafb640 1 -- 172.21.15.42:0/660954419 wait complete. 2024-03-31T23:17:46.007 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:45 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2444233549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.007 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:45 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3803290675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.007 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:45 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3613839097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 -- 172.21.15.42:0/3108458845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 msgr2=0x7fa604101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3108458845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 0x7fa604101d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009900 tx=0x7fa5f402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 -- 172.21.15.42:0/3108458845 shutdown_connections 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3108458845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041022a0 0x7fa604108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3108458845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 0x7fa604101d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3108458845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6041006f0 0x7fa604100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 -- 172.21.15.42:0/3108458845 >> 172.21.15.42:0/3108458845 conn(0x7fa6040fbc80 msgr2=0x7fa6040fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 -- 172.21.15.42:0/3108458845 shutdown_connections 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.110+0000 7fa60b54b640 1 -- 172.21.15.42:0/3108458845 wait complete. 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 Processor -- start 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 -- start start 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 0x7fa604197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 0x7fa604198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6041022a0 0x7fa60419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa60410d4f0 con 0x7fa6041006f0 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa60410d370 con 0x7fa6041022a0 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa60b54b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa60410d670 con 0x7fa6041018e0 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 0x7fa604197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 0x7fa604197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60616/0 (socket says 172.21.15.42:60616) 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 -- 172.21.15.42:0/3805654602 learned_addr learned my addr 172.21.15.42:0/3805654602 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa608ae6640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 0x7fa604198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa609ae8640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6041022a0 0x7fa60419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 -- 172.21.15.42:0/3805654602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 msgr2=0x7fa604198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 0x7fa604198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 -- 172.21.15.42:0/3805654602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6041022a0 msgr2=0x7fa60419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6041022a0 0x7fa60419f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.111+0000 7fa6092e7640 1 -- 172.21.15.42:0/3805654602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60419f760 con 0x7fa6041006f0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.112+0000 7fa6092e7640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 0x7fa604197b40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa60000eb70 tx=0x7fa60000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.112+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600003b70 con 0x7fa6041006f0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.112+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60419fa50 con 0x7fa6041006f0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.112+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa60000ee70 con 0x7fa6041006f0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.112+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6000108d0 con 0x7fa6041006f0 2024-03-31T23:17:46.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.112+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60419ff70 con 0x7fa6041006f0 2024-03-31T23:17:46.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.113+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa604107a10 con 0x7fa6041006f0 2024-03-31T23:17:46.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.114+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fa600003f30 con 0x7fa6041006f0 2024-03-31T23:17:46.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.114+0000 7fa5fa7fc640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5f00a24a0 0x7fa5f00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.114+0000 7fa608ae6640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5f00a24a0 0x7fa5f00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.115+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fa6000cf0c0 con 0x7fa6041006f0 2024-03-31T23:17:46.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.115+0000 7fa608ae6640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5f00a24a0 0x7fa5f00a4960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa5f402c900 tx=0x7fa5f4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:46.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.119+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa60009bef0 con 0x7fa6041006f0 2024-03-31T23:17:46.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.342+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60402d170 con 0x7fa6041006f0 2024-03-31T23:17:46.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.343+0000 7fa5fa7fc640 1 -- 172.21.15.42:0/3805654602 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7fa60009b7f0 con 0x7fa6041006f0 2024-03-31T23:17:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:46.344 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:16:02.248954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24472,24497,24464,24454,24442]},"id":1}]} 2024-03-31T23:17:46.344 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:17:46.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5f00a24a0 msgr2=0x7fa5f00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5f00a24a0 0x7fa5f00a4960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa5f402c900 tx=0x7fa5f4005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 msgr2=0x7fa604197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 0x7fa604197b40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa60000eb70 tx=0x7fa60000c6a0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 shutdown_connections 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6041022a0 0x7fa60419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6041018e0 0x7fa604198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa5f00a24a0 0x7fa5f00a4960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 --2- 172.21.15.42:0/3805654602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6041006f0 0x7fa604197b40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 >> 172.21.15.42:0/3805654602 conn(0x7fa6040fbc80 msgr2=0x7fa604104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 shutdown_connections 2024-03-31T23:17:46.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.345+0000 7fa60b54b640 1 -- 172.21.15.42:0/3805654602 wait complete. 2024-03-31T23:17:46.357 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 -- 172.21.15.42:0/256885841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 msgr2=0x7fcc10100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 --2- 172.21.15.42:0/256885841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc10100ab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009900 tx=0x7fcc0002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 -- 172.21.15.42:0/256885841 shutdown_connections 2024-03-31T23:17:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 --2- 172.21.15.42:0/256885841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc10102240 0x7fcc10108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 --2- 172.21.15.42:0/256885841 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc10101880 0x7fcc10101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 --2- 172.21.15.42:0/256885841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc10100ab0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 -- 172.21.15.42:0/256885841 >> 172.21.15.42:0/256885841 conn(0x7fcc100fbc00 msgr2=0x7fcc100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 -- 172.21.15.42:0/256885841 shutdown_connections 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.459+0000 7fcc1575e640 1 -- 172.21.15.42:0/256885841 wait complete. 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 Processor -- start 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 -- start start 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc1006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc10101880 0x7fcc1019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc10102240 0x7fcc1019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1010c3f0 con 0x7fcc10100690 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1010c270 con 0x7fcc10102240 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc1575e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1010c570 con 0x7fcc10101880 2024-03-31T23:17:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc1006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc1006a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60622/0 (socket says 172.21.15.42:60622) 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 -- 172.21.15.42:0/2314284227 learned_addr learned my addr 172.21.15.42:0/2314284227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc07fff640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc10101880 0x7fcc1019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0f7fe640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc10102240 0x7fcc1019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 -- 172.21.15.42:0/2314284227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc10101880 msgr2=0x7fcc1019c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc10101880 0x7fcc1019c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 -- 172.21.15.42:0/2314284227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc10102240 msgr2=0x7fcc1019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc10102240 0x7fcc1019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.460+0000 7fcc0effd640 1 -- 172.21.15.42:0/2314284227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1019f7c0 con 0x7fcc10100690 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.461+0000 7fcc0effd640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc1006a910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc00000c00 tx=0x7fcc00004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.461+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00043020 con 0x7fcc10100690 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.461+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc00004250 con 0x7fcc10100690 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.461+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1019fa50 con 0x7fcc10100690 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.461+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00003b90 con 0x7fcc10100690 2024-03-31T23:17:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.461+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1019fff0 con 0x7fcc10100690 2024-03-31T23:17:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.462+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc101079b0 con 0x7fcc10100690 2024-03-31T23:17:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.463+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fcc00046020 con 0x7fcc10100690 2024-03-31T23:17:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.463+0000 7fcc0cff9640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcbfc0a2520 0x7fcbfc0a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.463+0000 7fcc07fff640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcbfc0a2520 0x7fcbfc0a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.463+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fcc000f0af0 con 0x7fcc10100690 2024-03-31T23:17:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.464+0000 7fcc07fff640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcbfc0a2520 0x7fcbfc0a49e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcc1006a680 tx=0x7fcbf8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:46.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.468+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcc0004d020 con 0x7fcc10100690 2024-03-31T23:17:46.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.655+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc10062350 con 0x7fcc10100690 2024-03-31T23:17:46.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.656+0000 7fcc0cff9640 1 -- 172.21.15.42:0/2314284227 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7fcc000bd920 con 0x7fcc10100690 2024-03-31T23:17:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:46.658 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:46.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcbfc0a2520 msgr2=0x7fcbfc0a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcbfc0a2520 0x7fcbfc0a49e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcc1006a680 tx=0x7fcbf8005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:46.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 msgr2=0x7fcc1006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc1006a910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc00000c00 tx=0x7fcc00004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 shutdown_connections 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc10102240 0x7fcc1019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc10101880 0x7fcc1019c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcbfc0a2520 0x7fcbfc0a49e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 --2- 172.21.15.42:0/2314284227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc10100690 0x7fcc1006a910 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 >> 172.21.15.42:0/2314284227 conn(0x7fcc100fbc00 msgr2=0x7fcc10104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 shutdown_connections 2024-03-31T23:17:46.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.658+0000 7fcc1575e640 1 -- 172.21.15.42:0/2314284227 wait complete. 2024-03-31T23:17:46.660 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:46 smithi042 ceph-mon[32380]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:46.661 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:46 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2482966765' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:46.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 -- 172.21.15.42:0/2974669980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 msgr2=0x7efc54108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 --2- 172.21.15.42:0/2974669980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc54108aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009ca0 tx=0x7efc4c02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 -- 172.21.15.42:0/2974669980 shutdown_connections 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 --2- 172.21.15.42:0/2974669980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc54108aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 --2- 172.21.15.42:0/2974669980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 0x7efc54101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 --2- 172.21.15.42:0/2974669980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 0x7efc54100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 -- 172.21.15.42:0/2974669980 >> 172.21.15.42:0/2974669980 conn(0x7efc540fbbf0 msgr2=0x7efc540fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 -- 172.21.15.42:0/2974669980 shutdown_connections 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 -- 172.21.15.42:0/2974669980 wait complete. 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 Processor -- start 2024-03-31T23:17:46.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.777+0000 7efc58cdf640 1 -- start start 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 0x7efc54197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 0x7efc541980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc5419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc5410c410 con 0x7efc54102210 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc5410c290 con 0x7efc54101850 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc5410c590 con 0x7efc54100660 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc5419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc5259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 0x7efc54197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc4bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 0x7efc541980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc5419f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60634/0 (socket says 172.21.15.42:60634) 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc5259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 0x7efc54197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38798/0 (socket says 172.21.15.42:38798) 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 -- 172.21.15.42:0/3520524043 learned_addr learned my addr 172.21.15.42:0/3520524043 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:46.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 -- 172.21.15.42:0/3520524043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 msgr2=0x7efc54197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 0x7efc54197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 -- 172.21.15.42:0/3520524043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 msgr2=0x7efc541980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 0x7efc541980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 -- 172.21.15.42:0/3520524043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5419f7a0 con 0x7efc54102210 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc4bfff640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 0x7efc541980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc52d9d640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc5419f130 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efc4c02c700 tx=0x7efc4c0346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c039040 con 0x7efc54102210 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc4c044070 con 0x7efc54102210 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0043c0 con 0x7efc54102210 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5419fa30 con 0x7efc54102210 2024-03-31T23:17:46.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.778+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5419ff20 con 0x7efc54102210 2024-03-31T23:17:46.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.779+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc541a0150 con 0x7efc54102210 2024-03-31T23:17:46.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.780+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7efc4c004580 con 0x7efc54102210 2024-03-31T23:17:46.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.781+0000 7efc4b7fe640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efc400a24a0 0x7efc400a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:46.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.781+0000 7efc5259c640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efc400a24a0 0x7efc400a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:46.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.781+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7efc4c0f10c0 con 0x7efc54102210 2024-03-31T23:17:46.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.781+0000 7efc5259c640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efc400a24a0 0x7efc400a4960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc541016b0 tx=0x7efc44005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:46.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.786+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efc4c0bdef0 con 0x7efc54102210 2024-03-31T23:17:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:46 smithi094 ceph-mon[36167]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:46 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2482966765' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:46 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/660954419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:46 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3805654602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:46 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2314284227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.967+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efc541a03c0 con 0x7efc54102210 2024-03-31T23:17:46.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.967+0000 7efc4b7fe640 1 -- 172.21.15.42:0/3520524043 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7efc4c0bd7f0 con 0x7efc54102210 2024-03-31T23:17:46.969 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:46.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:46 smithi188 ceph-mon[36068]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:17:46.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:46 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2482966765' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:46 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/660954419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:46 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3805654602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:46 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2314284227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efc400a24a0 msgr2=0x7efc400a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efc400a24a0 0x7efc400a4960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc541016b0 tx=0x7efc44005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:46.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 msgr2=0x7efc5419f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc5419f130 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efc4c02c700 tx=0x7efc4c0346d0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 shutdown_connections 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efc400a24a0 0x7efc400a4960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc54102210 0x7efc5419f130 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc54101850 0x7efc541980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.969+0000 7efc58cdf640 1 --2- 172.21.15.42:0/3520524043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54100660 0x7efc54197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.970+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 >> 172.21.15.42:0/3520524043 conn(0x7efc540fbbf0 msgr2=0x7efc54069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.970+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 shutdown_connections 2024-03-31T23:17:46.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:46.970+0000 7efc58cdf640 1 -- 172.21.15.42:0/3520524043 wait complete. 2024-03-31T23:17:46.980 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:46 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/660954419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:46.981 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:46 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3805654602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.981 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:46 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2314284227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:46.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:17:47.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 -- 172.21.15.42:0/1691876092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8101760 msgr2=0x7f29b8101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 --2- 172.21.15.42:0/1691876092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8101760 0x7f29b8101b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009ca0 tx=0x7f29a802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 -- 172.21.15.42:0/1691876092 shutdown_connections 2024-03-31T23:17:47.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 --2- 172.21.15.42:0/1691876092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8103310 0x7f29b8109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 --2- 172.21.15.42:0/1691876092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8102950 0x7f29b8102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 --2- 172.21.15.42:0/1691876092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8101760 0x7f29b8101b80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 -- 172.21.15.42:0/1691876092 >> 172.21.15.42:0/1691876092 conn(0x7f29b80fccf0 msgr2=0x7f29b80ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 -- 172.21.15.42:0/1691876092 shutdown_connections 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.086+0000 7f29be084640 1 -- 172.21.15.42:0/1691876092 wait complete. 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 Processor -- start 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 -- start start 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8101760 0x7f29b8197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8102950 0x7f29b81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 0x7f29b819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f29b810d510 con 0x7f29b8103310 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29b810d390 con 0x7f29b8101760 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29be084640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f29b810d690 con 0x7f29b8102950 2024-03-31T23:17:47.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 0x7f29b819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8102950 0x7f29b81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8101760 0x7f29b8197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 0x7f29b819f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60666/0 (socket says 172.21.15.42:60666) 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8102950 0x7f29b81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38806/0 (socket says 172.21.15.42:38806) 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 -- 172.21.15.42:0/640111481 learned_addr learned my addr 172.21.15.42:0/640111481 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8101760 0x7f29b8197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:57318/0 (socket says 172.21.15.42:57318) 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 -- 172.21.15.42:0/640111481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8102950 msgr2=0x7f29b81980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8102950 0x7f29b81980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 -- 172.21.15.42:0/640111481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8101760 msgr2=0x7f29b8197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8101760 0x7f29b8197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.087+0000 7f29b7fff640 1 -- 172.21.15.42:0/640111481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b819f7d0 con 0x7f29b8103310 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.088+0000 7f29b7fff640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 0x7f29b819f160 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f29b000e970 tx=0x7f29b000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.088+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b000ccc0 con 0x7f29b8103310 2024-03-31T23:17:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.088+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29b000ce60 con 0x7f29b8103310 2024-03-31T23:17:47.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.088+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b819fac0 con 0x7f29b8103310 2024-03-31T23:17:47.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.088+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0010690 con 0x7f29b8103310 2024-03-31T23:17:47.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.088+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81a0060 con 0x7f29b8103310 2024-03-31T23:17:47.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.089+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b8108a80 con 0x7f29b8103310 2024-03-31T23:17:47.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.090+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f29b00046c0 con 0x7f29b8103310 2024-03-31T23:17:47.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.091+0000 7f29b4ff9640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29a00a2520 0x7f29a00a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.091+0000 7f29b77fe640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29a00a2520 0x7f29a00a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.091+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f29b00cee00 con 0x7f29b8103310 2024-03-31T23:17:47.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.091+0000 7f29b77fe640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29a00a2520 0x7f29a00a49e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29a802c700 tx=0x7f29a8032670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:47.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.096+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f29b009bc30 con 0x7f29b8103310 2024-03-31T23:17:47.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.276+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f29b80623f0 con 0x7f29b8103310 2024-03-31T23:17:47.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.277+0000 7f29b4ff9640 1 -- 172.21.15.42:0/640111481 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f29b009b530 con 0x7f29b8103310 2024-03-31T23:17:47.278 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29a00a2520 msgr2=0x7f29a00a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29a00a2520 0x7f29a00a49e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29a802c700 tx=0x7f29a8032670 comp rx=0 tx=0).stop 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 msgr2=0x7f29b819f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 0x7f29b819f160 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f29b000e970 tx=0x7f29b000ed70 comp rx=0 tx=0).stop 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 shutdown_connections 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f29a00a2520 0x7f29a00a49e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29b8103310 0x7f29b819f160 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29b8102950 0x7f29b81980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 --2- 172.21.15.42:0/640111481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29b8101760 0x7f29b8197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 >> 172.21.15.42:0/640111481 conn(0x7f29b80fccf0 msgr2=0x7f29b8105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:47.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 shutdown_connections 2024-03-31T23:17:47.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.279+0000 7f29be084640 1 -- 172.21.15.42:0/640111481 wait complete. 2024-03-31T23:17:47.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:17:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1294713638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c107430 msgr2=0x7fdd3c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1294713638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c107430 0x7fdd3c109880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009be0 tx=0x7fdd3402bef0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1294713638 shutdown_connections 2024-03-31T23:17:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1294713638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c107430 0x7fdd3c109880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1294713638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd3c104b00 0x7fdd3c106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1294713638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1294713638 >> 172.21.15.42:0/1294713638 conn(0x7fdd3c0fbbe0 msgr2=0x7fdd3c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1294713638 shutdown_connections 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1294713638 wait complete. 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 Processor -- start 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.400+0000 7fdd42a1c640 1 -- start start 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd42a1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd42a1c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c104b00 0x7fdd3c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd42a1c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd3c107430 0x7fdd3c19f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd42a1c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c10d500 con 0x7fdd3c1021d0 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd42a1c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c10d380 con 0x7fdd3c104b00 2024-03-31T23:17:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd42a1c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c10d680 con 0x7fdd3c107430 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c104b00 0x7fdd3c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60672/0 (socket says 172.21.15.42:60672) 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 -- 172.21.15.42:0/1794626957 learned_addr learned my addr 172.21.15.42:0/1794626957 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd40fb9640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd3c107430 0x7fdd3c19f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 -- 172.21.15.42:0/1794626957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd3c107430 msgr2=0x7fdd3c19f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd3c107430 0x7fdd3c19f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 -- 172.21.15.42:0/1794626957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c104b00 msgr2=0x7fdd3c198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c104b00 0x7fdd3c198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 -- 172.21.15.42:0/1794626957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c19f6f0 con 0x7fdd3c1021d0 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3b7fe640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c104b00 0x7fdd3c198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.401+0000 7fdd3bfff640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c197ad0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000e9c0 tx=0x7fdd3000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.402+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000cde0 con 0x7fdd3c1021d0 2024-03-31T23:17:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.402+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c19f9e0 con 0x7fdd3c1021d0 2024-03-31T23:17:47.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.402+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd300035f0 con 0x7fdd3c1021d0 2024-03-31T23:17:47.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.402+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c19ff80 con 0x7fdd3c1021d0 2024-03-31T23:17:47.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.402+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30018630 con 0x7fdd3c1021d0 2024-03-31T23:17:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.403+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c068990 con 0x7fdd3c1021d0 2024-03-31T23:17:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.404+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fdd300037a0 con 0x7fdd3c1021d0 2024-03-31T23:17:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.404+0000 7fdd397fa640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fdd240a24a0 0x7fdd240a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.405+0000 7fdd3b7fe640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fdd240a24a0 0x7fdd240a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.405+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fdd300ced40 con 0x7fdd3c1021d0 2024-03-31T23:17:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.405+0000 7fdd3b7fe640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fdd240a24a0 0x7fdd240a4960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c198fe0 tx=0x7fdd2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:47.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.409+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fdd3009bb70 con 0x7fdd3c1021d0 2024-03-31T23:17:47.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.591+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdd3c062350 con 0x7fdd3c1021d0 2024-03-31T23:17:47.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.591+0000 7fdd397fa640 1 -- 172.21.15.42:0/1794626957 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fdd3009b470 con 0x7fdd3c1021d0 2024-03-31T23:17:47.592 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:17:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fdd240a24a0 msgr2=0x7fdd240a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fdd240a24a0 0x7fdd240a4960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c198fe0 tx=0x7fdd2c005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 msgr2=0x7fdd3c197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c197ad0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000e9c0 tx=0x7fdd3000ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 shutdown_connections 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd3c107430 0x7fdd3c19f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd3c104b00 0x7fdd3c198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fdd240a24a0 0x7fdd240a4960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 --2- 172.21.15.42:0/1794626957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd3c1021d0 0x7fdd3c197ad0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 >> 172.21.15.42:0/1794626957 conn(0x7fdd3c0fbbe0 msgr2=0x7fdd3c102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 shutdown_connections 2024-03-31T23:17:47.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.593+0000 7fdd42a1c640 1 -- 172.21.15.42:0/1794626957 wait complete. 2024-03-31T23:17:47.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:17:47.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 -- 172.21.15.42:0/2048974630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 msgr2=0x7ff96c101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 --2- 172.21.15.42:0/2048974630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c101cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff954009900 tx=0x7ff95402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 -- 172.21.15.42:0/2048974630 shutdown_connections 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 --2- 172.21.15.42:0/2048974630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c102200 0x7ff96c108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 --2- 172.21.15.42:0/2048974630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c101cc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 --2- 172.21.15.42:0/2048974630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff96c100650 0x7ff96c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 -- 172.21.15.42:0/2048974630 >> 172.21.15.42:0/2048974630 conn(0x7ff96c0fbbe0 msgr2=0x7ff96c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 -- 172.21.15.42:0/2048974630 shutdown_connections 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.710+0000 7ff971727640 1 -- 172.21.15.42:0/2048974630 wait complete. 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 Processor -- start 2024-03-31T23:17:47.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 -- start start 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c100650 0x7ff96c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff96c102200 0x7ff96c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c10c3b0 con 0x7ff96c101840 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c10c230 con 0x7ff96c100650 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff971727640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c10c530 con 0x7ff96c102200 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff96a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff96a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60688/0 (socket says 172.21.15.42:60688) 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff96a7fc640 1 -- 172.21.15.42:0/2775154414 learned_addr learned my addr 172.21.15.42:0/2775154414 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff96affd640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c100650 0x7ff96c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.711+0000 7ff96b7fe640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff96c102200 0x7ff96c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96a7fc640 1 -- 172.21.15.42:0/2775154414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff96c102200 msgr2=0x7ff96c19f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96a7fc640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff96c102200 0x7ff96c19f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96a7fc640 1 -- 172.21.15.42:0/2775154414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c100650 msgr2=0x7ff96c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96a7fc640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c100650 0x7ff96c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96a7fc640 1 -- 172.21.15.42:0/2775154414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c19f760 con 0x7ff96c101840 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96affd640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c100650 0x7ff96c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff96a7fc640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c198080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff954009230 tx=0x7ff954004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954043020 con 0x7ff96c101840 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c19f9f0 con 0x7ff96c101840 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff954004250 con 0x7ff96c101840 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954003b50 con 0x7ff96c101840 2024-03-31T23:17:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.712+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c19ff90 con 0x7ff96c101840 2024-03-31T23:17:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.713+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96c1a0220 con 0x7ff96c101840 2024-03-31T23:17:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.714+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7ff954046020 con 0x7ff96c101840 2024-03-31T23:17:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.715+0000 7ff963fff640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff9580a24a0 0x7ff9580a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.715+0000 7ff96affd640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff9580a24a0 0x7ff9580a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.715+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7ff9540f0fc0 con 0x7ff96c101840 2024-03-31T23:17:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.715+0000 7ff96affd640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff9580a24a0 0x7ff9580a4960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff96c1016a0 tx=0x7ff964005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.718+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff95404d020 con 0x7ff96c101840 2024-03-31T23:17:47.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.899+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff96c1a03f0 con 0x7ff96c101840 2024-03-31T23:17:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.900+0000 7ff963fff640 1 -- 172.21.15.42:0/2775154414 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7ff9540bdd90 con 0x7ff96c101840 2024-03-31T23:17:47.901 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff9580a24a0 msgr2=0x7ff9580a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff9580a24a0 0x7ff9580a4960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff96c1016a0 tx=0x7ff964005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 msgr2=0x7ff96c198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c198080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff954009230 tx=0x7ff954004ab0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 shutdown_connections 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff96c102200 0x7ff96c19f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ff9580a24a0 0x7ff9580a4960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c101840 0x7ff96c198080 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 --2- 172.21.15.42:0/2775154414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff96c100650 0x7ff96c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 >> 172.21.15.42:0/2775154414 conn(0x7ff96c0fbbe0 msgr2=0x7ff96c0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 shutdown_connections 2024-03-31T23:17:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:47.902+0000 7ff971727640 1 -- 172.21.15.42:0/2775154414 wait complete. 2024-03-31T23:17:47.913 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3520524043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.913 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/640111481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.913 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:47 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1794626957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.914 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:17:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3520524043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/640111481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:47 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1794626957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3520524043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/640111481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:47 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1794626957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 -- 172.21.15.42:0/1300365053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 msgr2=0x7f45e4108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 --2- 172.21.15.42:0/1300365053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e4108ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ca0 tx=0x7f45dc02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 -- 172.21.15.42:0/1300365053 shutdown_connections 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 --2- 172.21.15.42:0/1300365053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e4108ad0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 --2- 172.21.15.42:0/1300365053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45e4101880 0x7f45e4101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 --2- 172.21.15.42:0/1300365053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45e4100690 0x7f45e4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 -- 172.21.15.42:0/1300365053 >> 172.21.15.42:0/1300365053 conn(0x7f45e40fbc00 msgr2=0x7f45e40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 -- 172.21.15.42:0/1300365053 shutdown_connections 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.015+0000 7f45e92df640 1 -- 172.21.15.42:0/1300365053 wait complete. 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 Processor -- start 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 -- start start 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45e4100690 0x7f45e4199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45e4101880 0x7f45e419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e41a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45e410c440 con 0x7f45e4102240 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f45e410c2c0 con 0x7f45e4101880 2024-03-31T23:17:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e92df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f45e410c5c0 con 0x7f45e4100690 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e41a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e2ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45e4100690 0x7f45e4199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e41a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60708/0 (socket says 172.21.15.42:60708) 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.016+0000 7f45e37fe640 1 -- 172.21.15.42:0/616699832 learned_addr learned my addr 172.21.15.42:0/616699832 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45dbfff640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45e4101880 0x7f45e419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e37fe640 1 -- 172.21.15.42:0/616699832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45e4100690 msgr2=0x7f45e4199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e37fe640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45e4100690 0x7f45e4199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e37fe640 1 -- 172.21.15.42:0/616699832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45e4101880 msgr2=0x7f45e419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e37fe640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45e4101880 0x7f45e419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e37fe640 1 -- 172.21.15.42:0/616699832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e41a1970 con 0x7f45e4102240 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e37fe640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e41a1300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45dc02c630 tx=0x7f45dc034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc039040 con 0x7f45e4102240 2024-03-31T23:17:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e41a1c00 con 0x7f45e4102240 2024-03-31T23:17:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45dc044070 con 0x7f45e4102240 2024-03-31T23:17:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004430 con 0x7f45e4102240 2024-03-31T23:17:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.017+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e41a20f0 con 0x7f45e4102240 2024-03-31T23:17:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.018+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e41a2380 con 0x7f45e4102240 2024-03-31T23:17:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.019+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f45dc0045d0 con 0x7f45e4102240 2024-03-31T23:17:48.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.020+0000 7f45e0ff9640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f45d00a24a0 0x7f45d00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.020+0000 7f45e2ffd640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f45d00a24a0 0x7f45d00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.020+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f45dc0f1630 con 0x7f45e4102240 2024-03-31T23:17:48.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.020+0000 7f45e2ffd640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f45d00a24a0 0x7f45d00a4960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f45e41016e0 tx=0x7f45d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.024+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f45dc0be460 con 0x7f45e4102240 2024-03-31T23:17:48.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.244+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45e41a2710 con 0x7f45e4102240 2024-03-31T23:17:48.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.245+0000 7f45e0ff9640 1 -- 172.21.15.42:0/616699832 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f45dc0098b0 con 0x7f45e4102240 2024-03-31T23:17:48.246 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:48.246 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:16:02.248954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24472,24497,24464,24454,24442]},"id":1}]} 2024-03-31T23:17:48.247 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-03-31T23:17:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f45d00a24a0 msgr2=0x7f45d00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f45d00a24a0 0x7f45d00a4960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f45e41016e0 tx=0x7f45d4005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 msgr2=0x7f45e41a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e41a1300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45dc02c630 tx=0x7f45dc034670 comp rx=0 tx=0).stop 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 shutdown_connections 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f45d00a24a0 0x7f45d00a4960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45e4102240 0x7f45e41a1300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45e4101880 0x7f45e419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 --2- 172.21.15.42:0/616699832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45e4100690 0x7f45e4199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 >> 172.21.15.42:0/616699832 conn(0x7f45e40fbc00 msgr2=0x7f45e40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 shutdown_connections 2024-03-31T23:17:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.247+0000 7f45e92df640 1 -- 172.21.15.42:0/616699832 wait complete. 2024-03-31T23:17:48.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 -- 172.21.15.42:0/3082839414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c107450 msgr2=0x7f0c5c1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 --2- 172.21.15.42:0/3082839414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c107450 0x7f0c5c1098a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009be0 tx=0x7f0c4c02bef0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 -- 172.21.15.42:0/3082839414 shutdown_connections 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 --2- 172.21.15.42:0/3082839414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c107450 0x7f0c5c1098a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 --2- 172.21.15.42:0/3082839414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c104b20 0x7f0c5c106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 --2- 172.21.15.42:0/3082839414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c1045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 -- 172.21.15.42:0/3082839414 >> 172.21.15.42:0/3082839414 conn(0x7f0c5c0fbbe0 msgr2=0x7f0c5c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 -- 172.21.15.42:0/3082839414 shutdown_connections 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 -- 172.21.15.42:0/3082839414 wait complete. 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 Processor -- start 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 -- start start 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.362+0000 7f0c61440640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5c104b20 0x7f0c5c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c61440640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 0x7f0c5c19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c61440640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c10d540 con 0x7f0c5c107450 2024-03-31T23:17:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c61440640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c10d3c0 con 0x7f0c5c1021f0 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c61440640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c10d6c0 con 0x7f0c5c104b20 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 0x7f0c5c19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:57396/0 (socket says 172.21.15.42:57396) 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 0x7f0c5c19f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60730/0 (socket says 172.21.15.42:60730) 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 -- 172.21.15.42:0/2533615780 learned_addr learned my addr 172.21.15.42:0/2533615780 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5a7fc640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5c104b20 0x7f0c5c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 -- 172.21.15.42:0/2533615780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5c104b20 msgr2=0x7f0c5c198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5c104b20 0x7f0c5c198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 -- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 msgr2=0x7f0c5c19f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 0x7f0c5c19f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 -- 172.21.15.42:0/2533615780 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c19f720 con 0x7f0c5c1021f0 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5b7fe640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 0x7f0c5c19f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c5affd640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c197b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400e9f0 tx=0x7f0c5400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400cd80 con 0x7f0c5c1021f0 2024-03-31T23:17:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c54005520 con 0x7f0c5c1021f0 2024-03-31T23:17:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5c19fa10 con 0x7f0c5c1021f0 2024-03-31T23:17:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54010690 con 0x7f0c5c1021f0 2024-03-31T23:17:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.363+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5c19ff10 con 0x7f0c5c1021f0 2024-03-31T23:17:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.364+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5c0fd6d0 con 0x7f0c5c1021f0 2024-03-31T23:17:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.365+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f0c540046c0 con 0x7f0c5c1021f0 2024-03-31T23:17:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.366+0000 7f0c43fff640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c440a24a0 0x7f0c440a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.366+0000 7f0c5a7fc640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c440a24a0 0x7f0c440a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.366+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f0c540ceeb0 con 0x7f0c5c1021f0 2024-03-31T23:17:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.366+0000 7f0c5a7fc640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c440a24a0 0x7f0c440a4960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c199010 tx=0x7f0c50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.370+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0c5409bce0 con 0x7f0c5c1021f0 2024-03-31T23:17:48.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.552+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c5c02d400 con 0x7f0c5c1021f0 2024-03-31T23:17:48.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.554+0000 7f0c43fff640 1 -- 172.21.15.42:0/2533615780 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7f0c5409b5e0 con 0x7f0c5c1021f0 2024-03-31T23:17:48.555 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:48.555 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c440a24a0 msgr2=0x7f0c440a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c440a24a0 0x7f0c440a4960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c199010 tx=0x7f0c50009260 comp rx=0 tx=0).stop 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 msgr2=0x7f0c5c197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c197b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400e9f0 tx=0x7f0c5400edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 shutdown_connections 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f0c440a24a0 0x7f0c440a4960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c5c107450 0x7f0c5c19f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5c104b20 0x7f0c5c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 --2- 172.21.15.42:0/2533615780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c1021f0 0x7f0c5c197b00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 >> 172.21.15.42:0/2533615780 conn(0x7f0c5c0fbbe0 msgr2=0x7f0c5c102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 shutdown_connections 2024-03-31T23:17:48.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.556+0000 7f0c61440640 1 -- 172.21.15.42:0/2533615780 wait complete. 2024-03-31T23:17:48.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-31T23:15:33.212486+0000', 'modified': '2024-03-31T23:16:02.248954+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24472, 'mds_2': 24464, 'mds_3': 24454, 'mds_4': 24442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14634': {'gid': 14634, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6839/2174921226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 2174921226}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 2174921226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14646': {'gid': 14646, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6841/1878678856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6840', 'nonce': 1878678856}, {'type': 'v1', 'addr': '172.21.15.42:6841', 'nonce': 1878678856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24397': {'gid': 24397, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.188:6833/524584837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6832', 'nonce': 524584837}, {'type': 'v1', 'addr': '172.21.15.188:6833', 'nonce': 524584837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.94:6833/2977205291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6832', 'nonce': 2977205291}, {'type': 'v1', 'addr': '172.21.15.94:6833', 'nonce': 2977205291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.94:6835/1301341988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 1301341988}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 1301341988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.188:6835/2839339934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6834', 'nonce': 2839339934}, {'type': 'v1', 'addr': '172.21.15.188:6835', 'nonce': 2839339934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.188:6837/67113861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6836', 'nonce': 67113861}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 67113861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.94:6837/2576498268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 2576498268}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 2576498268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.188:6839/2041061045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6838', 'nonce': 2041061045}, {'type': 'v1', 'addr': '172.21.15.188:6839', 'nonce': 2041061045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6839/1375958649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 1375958649}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 1375958649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24472, 24497, 24464, 24454, 24442]} 2024-03-31T23:17:48.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-31T23:17:48.569 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 -- 172.21.15.42:0/2979561604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 msgr2=0x7fd310109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 --2- 172.21.15.42:0/2979561604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310109d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ca0 tx=0x7fd30802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 -- 172.21.15.42:0/2979561604 shutdown_connections 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 --2- 172.21.15.42:0/2979561604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310109d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 --2- 172.21.15.42:0/2979561604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3100ff810 0x7fd3100ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 --2- 172.21.15.42:0/2979561604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd310102da0 0x7fd3101031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 -- 172.21.15.42:0/2979561604 >> 172.21.15.42:0/2979561604 conn(0x7fd3100fb350 msgr2=0x7fd3100fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 -- 172.21.15.42:0/2979561604 shutdown_connections 2024-03-31T23:17:48.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.673+0000 7fd317823640 1 -- 172.21.15.42:0/2979561604 wait complete. 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 Processor -- start 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 -- start start 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3100ff810 0x7fd3101024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310100ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd310102da0 0x7fd310101020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd31010d550 con 0x7fd3101001d0 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd31010d3d0 con 0x7fd310102da0 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd317823640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd31010d6d0 con 0x7fd3100ff810 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310100ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310100ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60740/0 (socket says 172.21.15.42:60740) 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 -- 172.21.15.42:0/979875688 learned_addr learned my addr 172.21.15.42:0/979875688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd3155bf640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3100ff810 0x7fd3101024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd315dc0640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd310102da0 0x7fd310101020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 -- 172.21.15.42:0/979875688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3100ff810 msgr2=0x7fd3101024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3100ff810 0x7fd3101024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 -- 172.21.15.42:0/979875688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd310102da0 msgr2=0x7fd310101020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd310102da0 0x7fd310101020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 -- 172.21.15.42:0/979875688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3101018b0 con 0x7fd3101001d0 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.674+0000 7fd314dbe640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310100ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd30000e9f0 tx=0x7fd30000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.675+0000 7fd3067fc640 1 -- 172.21.15.42:0/979875688 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30000cd80 con 0x7fd3101001d0 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.675+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3101a1c00 con 0x7fd3101001d0 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.675+0000 7fd3067fc640 1 -- 172.21.15.42:0/979875688 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd300010930 con 0x7fd3101001d0 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.675+0000 7fd3067fc640 1 -- 172.21.15.42:0/979875688 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300018b00 con 0x7fd3101001d0 2024-03-31T23:17:48.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.675+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3101a21a0 con 0x7fd3101001d0 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd3067fc640 1 -- 172.21.15.42:0/979875688 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fd300018ca0 con 0x7fd3101001d0 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 Processor -- start 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 -- start start 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 0x55c42daf0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd3067fc640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd2fc0a24a0 0x7fd2fc0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42daf1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42daf8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c42da54af0 con 0x55c42daf21a0 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55c42d9fd9d0 con 0x55c42daf17e0 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd31a407740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c42da50b90 con 0x55c42daf0610 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd3155bf640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd2fc0a24a0 0x7fd2fc0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.677+0000 7fd315dc0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42daf8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 0x55c42daf0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd314dbe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42daf1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 0x55c42daf0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38908/0 (socket says 172.21.15.42:38908) 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 -- 172.21.15.42:0/2246421154 learned_addr learned my addr 172.21.15.42:0/2246421154 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd3067fc640 1 -- 172.21.15.42:0/979875688 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fd3000cede0 con 0x7fd3101001d0 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 -- 172.21.15.42:0/2246421154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 msgr2=0x55c42daf1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42daf1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 -- 172.21.15.42:0/2246421154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 msgr2=0x55c42daf8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42daf8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 -- 172.21.15.42:0/2246421154 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d7692d0 con 0x55c42daf0610 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd314dbe640 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42daf1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd3155bf640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd2fc0a24a0 0x7fd2fc0a4960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd310069a40 tx=0x7fd30c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd315dc0640 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 0x55c42daf0a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3080325a0 tx=0x7fd308032670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f3bf2ef14aabd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd2fb7fe640 1 -- 172.21.15.42:0/2246421154 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30804a070 con 0x55c42daf0610 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd2fb7fe640 1 -- 172.21.15.42:0/2246421154 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd308032970 con 0x55c42daf0610 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.678+0000 7fd2fb7fe640 1 -- 172.21.15.42:0/2246421154 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308039040 con 0x55c42daf0610 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 -- 172.21.15.42:0/2246421154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 msgr2=0x55c42daf0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 0x55c42daf0a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3080325a0 tx=0x7fd308032670 comp rx=0 tx=0).stop 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 -- 172.21.15.42:0/2246421154 shutdown_connections 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42daf8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42daf1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 --2- 172.21.15.42:0/2246421154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf0610 0x55c42daf0a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 -- 172.21.15.42:0/2246421154 >> 172.21.15.42:0/2246421154 conn(0x55c42daeba00 msgr2=0x55c42daebe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 -- 172.21.15.42:0/2246421154 shutdown_connections 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 -- 172.21.15.42:0/2246421154 wait complete. 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 -- start start 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.679+0000 7fd31a407740 1 Processor -- start 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42dafa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf17e0 0x55c42dafaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42db01f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c42daf9150 con 0x55c42daf21a0 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55c42da10f70 con 0x55c42daf0610 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c42daf92d0 con 0x55c42daf17e0 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd31a407740 10 client.0 _ll_register_callbacks cb 0x55c42d768ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42db01f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd3155bf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42dafa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42db01f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60772/0 (socket says 172.21.15.42:60772) 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 -- 172.21.15.42:0/735937733 learned_addr learned my addr 172.21.15.42:0/735937733 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd314dbe640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf17e0 0x55c42dafaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 -- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf17e0 msgr2=0x55c42dafaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf17e0 0x55c42dafaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 -- 172.21.15.42:0/735937733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 msgr2=0x55c42dafa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42dafa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 -- 172.21.15.42:0/735937733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42d8336b0 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd3155bf640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42dafa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd315dc0640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42db01f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd30802c630 tx=0x7fd3080046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cf77fb306176d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd2f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.680+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/735937733 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30804a030 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/735937733 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fd308032770 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd308032970 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/735937733 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd308039050 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 10 client.15438 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c42db04ee0 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/735937733 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd308032970 con 0x55c42daf21a0 2024-03-31T23:17:48.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/735937733 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd30803f070 con 0x55c42daf21a0 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 10 client.15438 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 10 client.15438 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 20 client.15438 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db06230 0x55c42db08400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 4 client.15438 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c42da62030 con 0x55c42db06230 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.681+0000 7fd3155bf640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db06230 0x55c42db08400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.682+0000 7fd2f8ff9640 10 client.15438 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.682+0000 7fd3155bf640 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db06230 0x55c42db08400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=57bec614fc8361ac server_cookie=82cb3b83ce35d037 in_seq=0 out_seq=0 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/735937733 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c42da62030 con 0x55c42db06230 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd2f8ff9640 10 client.15438 handle_command_reply: tid=0 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 client.15438 shutdown 2024-03-31T23:17:48.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 msgr2=0x55c42db01f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42db01f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd30802c630 tx=0x7fd3080046a0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 shutdown_connections 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db06230 0x55c42db08400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf21a0 0x55c42db01f00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf17e0 0x55c42dafaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 --2- 172.21.15.42:0/735937733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42dafa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 >> 172.21.15.42:0/735937733 conn(0x55c42daeba00 msgr2=0x55c42daeab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd2f8ff9640 0 client.15438 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 shutdown_connections 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 1 -- 172.21.15.42:0/735937733 wait complete. 2024-03-31T23:17:48.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.683+0000 7fd31a407740 20 client.15438 trim_cache size 0 max 16384 2024-03-31T23:17:48.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 Processor -- start 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 -- start start 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42daebde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 0x55c42db01ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42daf9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c42db06740 con 0x55c42daf17e0 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55c42db06e10 con 0x55c42daf0610 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.701+0000 7fd31a407740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c42db074e0 con 0x55c42daf21a0 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 0x55c42db01ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 0x55c42db01ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60780/0 (socket says 172.21.15.42:60780) 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 -- 172.21.15.42:0/140896646 learned_addr learned my addr 172.21.15.42:0/140896646 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd315dc0640 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42daf9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd3155bf640 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42daebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 -- 172.21.15.42:0/140896646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 msgr2=0x55c42daf9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42daf9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 -- 172.21.15.42:0/140896646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 msgr2=0x55c42daebde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42daebde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 -- 172.21.15.42:0/140896646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42dafb820 con 0x55c42daf17e0 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd314dbe640 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 0x55c42db01ec0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3000a0a00 tx=0x7fd300086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabaa4185beeb4e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd2faffd640 1 -- 172.21.15.42:0/140896646 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3000a07f0 con 0x55c42daf17e0 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd2faffd640 1 -- 172.21.15.42:0/140896646 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd30009b5c0 con 0x55c42daf17e0 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.702+0000 7fd2faffd640 1 -- 172.21.15.42:0/140896646 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3000a3f20 con 0x55c42daf17e0 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- 172.21.15.42:0/140896646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 msgr2=0x55c42db01ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 0x55c42db01ec0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3000a0a00 tx=0x7fd300086040 comp rx=0 tx=0).stop 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- 172.21.15.42:0/140896646 shutdown_connections 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42daf9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf17e0 0x55c42db01ec0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- 172.21.15.42:0/140896646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf0610 0x55c42daebde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- 172.21.15.42:0/140896646 >> 172.21.15.42:0/140896646 conn(0x55c42daeba00 msgr2=0x55c42daf87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- 172.21.15.42:0/140896646 shutdown_connections 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- 172.21.15.42:0/140896646 wait complete. 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- start start 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 Processor -- start 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 0x55c42dafe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42dafe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42db00f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c42db08280 con 0x55c42daf0610 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55c42db07bb0 con 0x55c42daf17e0 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c42db08950 con 0x55c42daf21a0 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.703+0000 7fd31a407740 10 client.0 _ll_register_callbacks cb 0x7fd308048070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:48.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 0x55c42dafe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 0x55c42dafe0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60788/0 (socket says 172.21.15.42:60788) 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 -- 172.21.15.42:0/184294675 learned_addr learned my addr 172.21.15.42:0/184294675 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd314dbe640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42dafe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd315dc0640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42db00f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 -- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 msgr2=0x55c42db00f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42db00f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 -- 172.21.15.42:0/184294675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 msgr2=0x55c42dafe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42dafe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 -- 172.21.15.42:0/184294675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42db01490 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd315dc0640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42db00f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd3155bf640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 0x55c42dafe0f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55c42daec970 tx=0x7fd30c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabbf2a72783ae3f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd2f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/184294675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c029770 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/184294675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fd30c004020 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd30009b5c0 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/184294675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd30c03b050 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd31a407740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c42db6d0e0 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.704+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/184294675 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd30009b5c0 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/184294675 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd30c01d5b0 con 0x55c42daf0610 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 10 client.15444 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-31T23:17:48.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 20 client.15444 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db71d20 0x55c42db70a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 4 client.15444 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "status"}) -- 0x55c42da5c380 con 0x55c42db71d20 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd314dbe640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db71d20 0x55c42db70a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd314dbe640 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db71d20 0x55c42db70a30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=60a1804693586a6 server_cookie=fa99453b5ebf48e3 in_seq=0 out_seq=0 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd2f8ff9640 10 client.15444 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd2f8ff9640 1 -- 172.21.15.42:0/184294675 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c42da5c380 con 0x55c42db71d20 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd2f8ff9640 10 client.15444 handle_command_reply: tid=0 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 1 client.15444 shutdown 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 msgr2=0x55c42dafe0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.705+0000 7fd31a407740 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 0x55c42dafe0f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55c42daec970 tx=0x7fd30c004730 comp rx=0 tx=0).stop 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 shutdown_connections 2024-03-31T23:17:48.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c42daf21a0 0x55c42db00f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c42daf17e0 0x55c42dafe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55c42db71d20 0x55c42db70a30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 --2- 172.21.15.42:0/184294675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c42daf0610 0x55c42dafe0f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 >> 172.21.15.42:0/184294675 conn(0x55c42daeba00 msgr2=0x55c42daf9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd2f8ff9640 0 client.15444 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 shutdown_connections 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 1 -- 172.21.15.42:0/184294675 wait complete. 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd31a407740 20 client.15444 trim_cache size 0 max 16384 2024-03-31T23:17:48.714 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24442, 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 107.45972322999999, 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 93, 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 157.22373691999999 2024-03-31T23:17:48.715 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:48.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd2fc0a24a0 msgr2=0x7fd2fc0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd2fc0a24a0 0x7fd2fc0a4960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd310069a40 tx=0x7fd30c005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 msgr2=0x7fd310100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310100ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd30000e9f0 tx=0x7fd30000eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 shutdown_connections 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd310102da0 0x7fd310101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd2fc0a24a0 0x7fd2fc0a4960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3101001d0 0x7fd310100ae0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 --2- 172.21.15.42:0/979875688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3100ff810 0x7fd3101024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 >> 172.21.15.42:0/979875688 conn(0x7fd3100fb350 msgr2=0x7fd310105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 shutdown_connections 2024-03-31T23:17:48.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.706+0000 7fd317823640 1 -- 172.21.15.42:0/979875688 wait complete. 2024-03-31T23:17:48.718 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-31T23:17:48.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:48 smithi042 ceph-mon[32380]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-31T23:17:48.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2775154414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:48.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/616699832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:48.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:48 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2533615780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 -- 172.21.15.42:0/323731635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 msgr2=0x7faf5c109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 --2- 172.21.15.42:0/323731635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c109ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf54009ca0 tx=0x7faf5402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 -- 172.21.15.42:0/323731635 shutdown_connections 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 --2- 172.21.15.42:0/323731635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c109ba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 --2- 172.21.15.42:0/323731635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c102950 0x7faf5c102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 --2- 172.21.15.42:0/323731635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c101760 0x7faf5c101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 -- 172.21.15.42:0/323731635 >> 172.21.15.42:0/323731635 conn(0x7faf5c0fccf0 msgr2=0x7faf5c0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 -- 172.21.15.42:0/323731635 shutdown_connections 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.827+0000 7faf624cd640 1 -- 172.21.15.42:0/323731635 wait complete. 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 Processor -- start 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 -- start start 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c101760 0x7faf5c197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c102950 0x7faf5c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c19f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10d510 con 0x7faf5c103310 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10d390 con 0x7faf5c101760 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf624cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10d690 con 0x7faf5c102950 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf60a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c19f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf60a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c19f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60800/0 (socket says 172.21.15.42:60800) 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.828+0000 7faf60a6a640 1 -- 172.21.15.42:0/1961690016 learned_addr learned my addr 172.21.15.42:0/1961690016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf5bfff640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c101760 0x7faf5c197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c102950 0x7faf5c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf60a6a640 1 -- 172.21.15.42:0/1961690016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c102950 msgr2=0x7faf5c198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf60a6a640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c102950 0x7faf5c198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf60a6a640 1 -- 172.21.15.42:0/1961690016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c101760 msgr2=0x7faf5c197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf60a6a640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c101760 0x7faf5c197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf60a6a640 1 -- 172.21.15.42:0/1961690016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c19f6f0 con 0x7faf5c103310 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf60a6a640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c19f080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faf5402c700 tx=0x7faf540346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf597fa640 1 -- 172.21.15.42:0/1961690016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54039040 con 0x7faf5c103310 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c19f980 con 0x7faf5c103310 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf597fa640 1 -- 172.21.15.42:0/1961690016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf54044070 con 0x7faf5c103310 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf597fa640 1 -- 172.21.15.42:0/1961690016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540043c0 con 0x7faf5c103310 2024-03-31T23:17:48.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.829+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c19fe70 con 0x7faf5c103310 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.831+0000 7faf597fa640 1 -- 172.21.15.42:0/1961690016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7faf540045a0 con 0x7faf5c103310 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 Processor -- start 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 -- start start 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f03b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0f0318af0 con 0x55f0f03b57e0 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f0f02c19d0 con 0x55f0f03b61a0 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf65191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f0f0314b90 con 0x55f0f03b4610 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf597fa640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faf440a24a0 0x7faf440a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf60a6a640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faf440a24a0 0x7faf440a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f03b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38940/0 (socket says 172.21.15.42:38940) 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 -- 172.21.15.42:0/1486065536 learned_addr learned my addr 172.21.15.42:0/1486065536 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f03b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60802/0 (socket says 172.21.15.42:60802) 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf597fa640 1 -- 172.21.15.42:0/1961690016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7faf540f10c0 con 0x7faf5c103310 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 -- 172.21.15.42:0/1486065536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 msgr2=0x55f0f03bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03bca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 -- 172.21.15.42:0/1486065536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 msgr2=0x55f0f03b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f03b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.832+0000 7faf5b7fe640 1 -- 172.21.15.42:0/1486065536 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f002d2d0 con 0x55f0f03b4610 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.833+0000 7faf60a6a640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faf440a24a0 0x7faf440a4960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faf540bd780 tx=0x7faf540b8210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.833+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03b4a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf500058c0 tx=0x7faf50005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39c170a6aec2006 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.833+0000 7faf427fc640 1 -- 172.21.15.42:0/1486065536 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50004030 con 0x55f0f03b4610 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.833+0000 7faf427fc640 1 -- 172.21.15.42:0/1486065536 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf50005520 con 0x55f0f03b4610 2024-03-31T23:17:48.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.833+0000 7faf427fc640 1 -- 172.21.15.42:0/1486065536 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50004d00 con 0x55f0f03b4610 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 -- 172.21.15.42:0/1486065536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 msgr2=0x55f0f03b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03b4a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf500058c0 tx=0x7faf50005850 comp rx=0 tx=0).stop 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 -- 172.21.15.42:0/1486065536 shutdown_connections 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f03b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 --2- 172.21.15.42:0/1486065536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03b4a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 -- 172.21.15.42:0/1486065536 >> 172.21.15.42:0/1486065536 conn(0x55f0f03afa00 msgr2=0x55f0f03afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 -- 172.21.15.42:0/1486065536 shutdown_connections 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 -- 172.21.15.42:0/1486065536 wait complete. 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 -- start start 2024-03-31T23:17:48.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.834+0000 7faf65191740 1 Processor -- start 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 0x55f0f03be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b57e0 0x55f0f03bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03bd1b0 con 0x55f0f03b4610 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f0f02d4f70 con 0x55f0f03b61a0 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03bd330 con 0x55f0f03b57e0 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 0x55f0f03be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 10 client.0 _ll_register_callbacks cb 0x55f0f002cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 0x55f0f03be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60806/0 (socket says 172.21.15.42:60806) 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 -- 172.21.15.42:0/3481079823 learned_addr learned my addr 172.21.15.42:0/3481079823 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5bfff640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b57e0 0x55f0f03bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 -- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b57e0 msgr2=0x55f0f03bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b57e0 0x55f0f03bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 -- 172.21.15.42:0/3481079823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 msgr2=0x55f0f03c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 -- 172.21.15.42:0/3481079823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f00f76b0 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 0x55f0f03be940 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faf50009800 tx=0x7faf50009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7808f2cec6d7e035 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf3b7fe640 1 -- 172.21.15.42:0/3481079823 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50029040 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf3b7fe640 1 -- 172.21.15.42:0/3481079823 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7faf50004ca0 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.835+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf50005520 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf3b7fe640 1 -- 172.21.15.42:0/3481079823 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf50037050 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 10 client.15456 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f0f03c8ea0 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf3b7fe640 1 -- 172.21.15.42:0/3481079823 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf50005520 con 0x55f0f03b4610 2024-03-31T23:17:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf3b7fe640 1 -- 172.21.15.42:0/3481079823 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf5001f710 con 0x55f0f03b4610 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 10 client.15456 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 10 client.15456 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 20 client.15456 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f03cb210 0x55f0f03cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 4 client.15456 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0f0326030 con 0x55f0f03cb210 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.836+0000 7faf5bfff640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f03cb210 0x55f0f03cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.837+0000 7faf3b7fe640 10 client.15456 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.837+0000 7faf5bfff640 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f03cb210 0x55f0f03cc680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6140115e6569cb2b server_cookie=115a6f654b25774b in_seq=0 out_seq=0 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf3b7fe640 1 -- 172.21.15.42:0/3481079823 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f0f0326030 con 0x55f0f03cb210 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf3b7fe640 10 client.15456 handle_command_reply: tid=0 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 client.15456 shutdown 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 msgr2=0x55f0f03be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 0x55f0f03be940 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faf50009800 tx=0x7faf50009fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 shutdown_connections 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f03cb210 0x55f0f03cc680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f03c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b57e0 0x55f0f03bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 --2- 172.21.15.42:0/3481079823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b4610 0x55f0f03be940 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 >> 172.21.15.42:0/3481079823 conn(0x55f0f03afa00 msgr2=0x55f0f03aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf3b7fe640 0 client.15456 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 shutdown_connections 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 1 -- 172.21.15.42:0/3481079823 wait complete. 2024-03-31T23:17:48.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.838+0000 7faf65191740 20 client.15456 trim_cache size 0 max 16384 2024-03-31T23:17:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.857+0000 7faf65191740 1 Processor -- start 2024-03-31T23:17:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.857+0000 7faf65191740 1 -- start start 2024-03-31T23:17:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf65191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf65191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b57e0 0x55f0f03c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf65191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 0x55f0f03ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf65191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03ca9c0 con 0x55f0f03b61a0 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf65191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03cb090 con 0x55f0f03b57e0 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf65191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03cb760 con 0x55f0f03b4610 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 0x55f0f03ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 0x55f0f03ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60816/0 (socket says 172.21.15.42:60816) 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 -- 172.21.15.42:0/2480041002 learned_addr learned my addr 172.21.15.42:0/2480041002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5bfff640 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b57e0 0x55f0f03c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 -- 172.21.15.42:0/2480041002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 msgr2=0x55f0f03c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 -- 172.21.15.42:0/2480041002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b57e0 msgr2=0x55f0f03c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b57e0 0x55f0f03c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 -- 172.21.15.42:0/2480041002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f03bda00 con 0x55f0f03b61a0 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 0x55f0f03ca250 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55f0f03cae80 tx=0x7faf50022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb062df5b950f824 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf41ffb640 1 -- 172.21.15.42:0/2480041002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50004740 con 0x55f0f03b61a0 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf41ffb640 1 -- 172.21.15.42:0/2480041002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf500048e0 con 0x55f0f03b61a0 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.858+0000 7faf41ffb640 1 -- 172.21.15.42:0/2480041002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf500112d0 con 0x55f0f03b61a0 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 -- 172.21.15.42:0/2480041002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 msgr2=0x55f0f03ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 0x55f0f03ca250 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55f0f03cae80 tx=0x7faf50022040 comp rx=0 tx=0).stop 2024-03-31T23:17:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 -- 172.21.15.42:0/2480041002 shutdown_connections 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b61a0 0x55f0f03ca250 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b57e0 0x55f0f03c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 --2- 172.21.15.42:0/2480041002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 -- 172.21.15.42:0/2480041002 >> 172.21.15.42:0/2480041002 conn(0x55f0f03afa00 msgr2=0x55f0f03bc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 -- 172.21.15.42:0/2480041002 shutdown_connections 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 -- 172.21.15.42:0/2480041002 wait complete. 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.859+0000 7faf65191740 1 -- start start 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 Processor -- start 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f042cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f042f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03cc500 con 0x55f0f03b57e0 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03cbe30 con 0x55f0f03b61a0 2024-03-31T23:17:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f0f03ccbd0 con 0x55f0f03b4610 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf65191740 10 client.0 _ll_register_callbacks cb 0x7faf4c009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f042cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f042cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60824/0 (socket says 172.21.15.42:60824) 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 -- 172.21.15.42:0/2327584059 learned_addr learned my addr 172.21.15.42:0/2327584059 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f042f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 -- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 msgr2=0x55f0f03c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 -- 172.21.15.42:0/2327584059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 msgr2=0x55f0f042f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f042f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 -- 172.21.15.42:0/2327584059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f042fd60 con 0x55f0f03b57e0 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f042f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf5bfff640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f042cf60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55f0f03b0970 tx=0x7faf4c0204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64724ee2876a6440 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.860+0000 7faf3b7fe640 1 -- 172.21.15.42:0/2327584059 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c010b60 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf3b7fe640 1 -- 172.21.15.42:0/2327584059 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7faf4c010d00 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf500048e0 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf3b7fe640 1 -- 172.21.15.42:0/2327584059 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf4c005020 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f0f04310c0 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf3b7fe640 1 -- 172.21.15.42:0/2327584059 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf500048e0 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf3b7fe640 1 -- 172.21.15.42:0/2327584059 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf4c01f410 con 0x55f0f03b57e0 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 10 client.15462 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 20 client.15462 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f0435c90 0x55f0f04349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 4 client.15462 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "status"}) -- 0x55f0f0320380 con 0x55f0f0435c90 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.861+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f0435c90 0x55f0f04349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf5b7fe640 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f0435c90 0x55f0f04349a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23583697db6ff5d8 server_cookie=6787afb9dc266a8f in_seq=0 out_seq=0 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf3b7fe640 10 client.15462 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf3b7fe640 1 -- 172.21.15.42:0/2327584059 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f0f0320380 con 0x55f0f0435c90 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf3b7fe640 10 client.15462 handle_command_reply: tid=0 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 client.15462 shutdown 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 msgr2=0x55f0f042cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f042cf60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55f0f03b0970 tx=0x7faf4c0204d0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 shutdown_connections 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f0f0435c90 0x55f0f04349a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0f03b61a0 0x55f0f042f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf3b7fe640 0 client.15462 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0f03b57e0 0x55f0f042cf60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 --2- 172.21.15.42:0/2327584059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0f03b4610 0x55f0f03c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 >> 172.21.15.42:0/2327584059 conn(0x55f0f03afa00 msgr2=0x55f0f03bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 shutdown_connections 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 1 -- 172.21.15.42:0/2327584059 wait complete. 2024-03-31T23:17:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.862+0000 7faf65191740 20 client.15462 trim_cache size 0 max 16384 2024-03-31T23:17:48.873 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:48.873 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:48.873 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-03-31T23:17:48.873 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24454, 2024-03-31T23:17:48.874 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:48.874 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:48.874 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:48.874 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 108.62568845200001, 2024-03-31T23:17:48.874 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:48.875 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 93, 2024-03-31T23:17:48.875 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:48.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 154.507541726 2024-03-31T23:17:48.875 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:48.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faf440a24a0 msgr2=0x7faf440a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faf440a24a0 0x7faf440a4960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faf540bd780 tx=0x7faf540b8210 comp rx=0 tx=0).stop 2024-03-31T23:17:48.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 msgr2=0x7faf5c19f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c19f080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faf5402c700 tx=0x7faf540346d0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 shutdown_connections 2024-03-31T23:17:48.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faf440a24a0 0x7faf440a4960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf5c103310 0x7faf5c19f080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c102950 0x7faf5c198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 --2- 172.21.15.42:0/1961690016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c101760 0x7faf5c197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 >> 172.21.15.42:0/1961690016 conn(0x7faf5c0fccf0 msgr2=0x7faf5c105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 shutdown_connections 2024-03-31T23:17:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.863+0000 7faf624cd640 1 -- 172.21.15.42:0/1961690016 wait complete. 2024-03-31T23:17:48.880 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-31T23:17:48.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:48 smithi094 ceph-mon[36167]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-31T23:17:48.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2775154414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:48.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/616699832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:48.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:48 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2533615780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:48.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:48 smithi188 ceph-mon[36068]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-31T23:17:48.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2775154414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:48.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/616699832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:48.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:48 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2533615780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:48.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 -- 172.21.15.42:0/1433353259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4102210 msgr2=0x7f9de4108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 --2- 172.21.15.42:0/1433353259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4102210 0x7f9de4108aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009ca0 tx=0x7f9ddc02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 -- 172.21.15.42:0/1433353259 shutdown_connections 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 --2- 172.21.15.42:0/1433353259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4102210 0x7f9de4108aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 --2- 172.21.15.42:0/1433353259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de4101850 0x7f9de4101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 --2- 172.21.15.42:0/1433353259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4100660 0x7f9de4100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 -- 172.21.15.42:0/1433353259 >> 172.21.15.42:0/1433353259 conn(0x7f9de40fbbf0 msgr2=0x7f9de40fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 -- 172.21.15.42:0/1433353259 shutdown_connections 2024-03-31T23:17:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.983+0000 7f9dea17a640 1 -- 172.21.15.42:0/1433353259 wait complete. 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 Processor -- start 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 -- start start 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4100660 0x7f9de406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 0x7f9de419c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de4102210 0x7f9de419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9de410c400 con 0x7f9de4101850 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9de410c280 con 0x7f9de4100660 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9dea17a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9de410c580 con 0x7f9de4102210 2024-03-31T23:17:48.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9de2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 0x7f9de419c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9de2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 0x7f9de419c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60850/0 (socket says 172.21.15.42:60850) 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4100660 0x7f9de406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.984+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3333676260 learned_addr learned my addr 172.21.15.42:0/3333676260 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de3fff640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de4102210 0x7f9de419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3333676260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de4102210 msgr2=0x7f9de419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de4102210 0x7f9de419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3333676260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4100660 msgr2=0x7f9de406a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:48.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4100660 0x7f9de406a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3333676260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de419f7c0 con 0x7f9de4101850 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de37fe640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4100660 0x7f9de406a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 0x7f9de419c890 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800e9f0 tx=0x7f9dd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de0ff9640 1 -- 172.21.15.42:0/3333676260 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800cd80 con 0x7f9de4101850 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de419fa50 con 0x7f9de4101850 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de0ff9640 1 -- 172.21.15.42:0/3333676260 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dd8010930 con 0x7f9de4101850 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9de0ff9640 1 -- 172.21.15.42:0/3333676260 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8018b00 con 0x7f9de4101850 2024-03-31T23:17:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.985+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de419fff0 con 0x7f9de4101850 2024-03-31T23:17:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9de0ff9640 1 -- 172.21.15.42:0/3333676260 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f9dd8018ca0 con 0x7f9de4101850 2024-03-31T23:17:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 Processor -- start 2024-03-31T23:17:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 -- start start 2024-03-31T23:17:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e9947ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e9947fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e99486a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563e993e2af0 con 0x563e9947f7e0 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563e9938b9d0 con 0x563e9947e610 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563e993deb90 con 0x563e994801a0 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e9947fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e9947fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60856/0 (socket says 172.21.15.42:60856) 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9de37fe640 1 -- 172.21.15.42:0/1669544130 learned_addr learned my addr 172.21.15.42:0/1669544130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e99486a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.988+0000 7f9de0ff9640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9dcc0a24a0 0x7f9dcc0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de3fff640 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e9947ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de37fe640 1 -- 172.21.15.42:0/1669544130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 msgr2=0x563e99486a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de37fe640 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e99486a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de3fff640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9dcc0a24a0 0x7f9dcc0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de37fe640 1 -- 172.21.15.42:0/1669544130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 msgr2=0x563e9947ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de37fe640 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e9947ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de37fe640 1 -- 172.21.15.42:0/1669544130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e990f72d0 con 0x563e9947f7e0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de0ff9640 1 -- 172.21.15.42:0/3333676260 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9dd80cee20 con 0x7f9de4101850 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de37fe640 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e9947fc60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40114f0 tx=0x7f9dd40119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24345815405cdeb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9dc9ffb640 1 -- 172.21.15.42:0/1669544130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd401e070 con 0x563e9947f7e0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9de3fff640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9dcc0a24a0 0x7f9dcc0a4960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc005e30 tx=0x7f9ddc032670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9dc9ffb640 1 -- 172.21.15.42:0/1669544130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dd400fac0 con 0x563e9947f7e0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.989+0000 7f9dc9ffb640 1 -- 172.21.15.42:0/1669544130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4019c70 con 0x563e9947f7e0 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 -- 172.21.15.42:0/1669544130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 msgr2=0x563e9947fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e9947fc60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40114f0 tx=0x7f9dd40119b0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 -- 172.21.15.42:0/1669544130 shutdown_connections 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e99486a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e9947fc60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/1669544130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e9947ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 -- 172.21.15.42:0/1669544130 >> 172.21.15.42:0/1669544130 conn(0x563e99479a00 msgr2=0x563e99479e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 -- 172.21.15.42:0/1669544130 shutdown_connections 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 -- 172.21.15.42:0/1669544130 wait complete. 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 -- start start 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.990+0000 7f9dec9fd740 1 Processor -- start 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e9947e610 0x563e99488910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e99488e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 0x563e9948fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563e994871b0 con 0x563e994801a0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563e9939ef70 con 0x563e9947f7e0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563e99487330 con 0x563e9947e610 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 10 client.0 _ll_register_callbacks cb 0x563e990f6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 0x563e9948fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 0x563e9948fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60870/0 (socket says 172.21.15.42:60870) 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 -- 172.21.15.42:0/2148902016 learned_addr learned my addr 172.21.15.42:0/2148902016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de37fe640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e9947e610 0x563e99488910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e99488e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 -- 172.21.15.42:0/2148902016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e9947e610 msgr2=0x563e99488910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e9947e610 0x563e99488910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 -- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 msgr2=0x563e99488e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e99488e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 -- 172.21.15.42:0/2148902016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e991c16b0 con 0x563e994801a0 2024-03-31T23:17:49.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9de3fff640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 0x563e9948fe90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009590 tx=0x7f9ddc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a0aad0c1daac47 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/2148902016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc052060 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/2148902016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9ddc004250 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd400fac0 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.991+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/2148902016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ddc059050 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 10 client.15474 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563e99492f30 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/2148902016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dd400fac0 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/2148902016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9ddc034ba0 con 0x563e994801a0 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 10 client.15474 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 10 client.15474 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 20 client.15474 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99495630 0x563e99496aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 4 client.15474 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:49.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e993f0030 con 0x563e99495630 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.992+0000 7f9de37fe640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99495630 0x563e99496aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.993+0000 7f9de37fe640 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99495630 0x563e99496aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf3073422eff7c17 server_cookie=c37fdb0d701051c7 in_seq=0 out_seq=0 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.993+0000 7f9dc2ffd640 10 client.15474 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/2148902016 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563e993f0030 con 0x563e99495630 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dc2ffd640 10 client.15474 handle_command_reply: tid=0 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 client.15474 shutdown 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 msgr2=0x563e9948fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 0x563e9948fe90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009590 tx=0x7f9ddc0095c0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 shutdown_connections 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99495630 0x563e99496aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e994801a0 0x563e9948fe90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e99488e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dc2ffd640 0 client.15474 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:49.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/2148902016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e9947e610 0x563e99488910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 >> 172.21.15.42:0/2148902016 conn(0x563e99479a00 msgr2=0x563e99478b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 shutdown_connections 2024-03-31T23:17:49.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 1 -- 172.21.15.42:0/2148902016 wait complete. 2024-03-31T23:17:49.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:48.994+0000 7f9dec9fd740 20 client.15474 trim_cache size 0 max 16384 2024-03-31T23:17:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 Processor -- start 2024-03-31T23:17:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 -- start start 2024-03-31T23:17:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e994830e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e99483620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563e99494de0 con 0x563e9947f7e0 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563e994954b0 con 0x563e9947e610 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563e99495b80 con 0x563e994801a0 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e99483620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e99483620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60872/0 (socket says 172.21.15.42:60872) 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3407545321 learned_addr learned my addr 172.21.15.42:0/3407545321 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de3fff640 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de37fe640 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e994830e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3407545321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 msgr2=0x563e9948fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3407545321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 msgr2=0x563e994830e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.012+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e994830e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9de2ffd640 1 -- 172.21.15.42:0/3407545321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9947f260 con 0x563e9947f7e0 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e99483620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80cc590 tx=0x7f9dd8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8560103f36174390 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dc97fa640 1 -- 172.21.15.42:0/3407545321 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8097040 con 0x563e9947f7e0 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dc97fa640 1 -- 172.21.15.42:0/3407545321 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dd809b600 con 0x563e9947f7e0 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dc97fa640 1 -- 172.21.15.42:0/3407545321 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8099990 con 0x563e9947f7e0 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3407545321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 msgr2=0x563e99483620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e99483620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80cc590 tx=0x7f9dd8086040 comp rx=0 tx=0).stop 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3407545321 shutdown_connections 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947f7e0 0x563e99483620 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3407545321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947e610 0x563e994830e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3407545321 >> 172.21.15.42:0/3407545321 conn(0x563e99479a00 msgr2=0x563e99479de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3407545321 shutdown_connections 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.013+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3407545321 wait complete. 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 -- start start 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 Processor -- start 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 0x563e9948bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e9948c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563e99496920 con 0x563e9947e610 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563e99496250 con 0x563e9947f7e0 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563e99496ff0 con 0x563e994801a0 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9dec9fd740 10 client.0 _ll_register_callbacks cb 0x7f9dd4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 0x563e9948bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 0x563e9948bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60876/0 (socket says 172.21.15.42:60876) 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 -- 172.21.15.42:0/3987285256 learned_addr learned my addr 172.21.15.42:0/3987285256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e9948c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de3fff640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 -- 172.21.15.42:0/3987285256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 msgr2=0x563e9948f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 -- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 msgr2=0x563e9948c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e9948c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.014+0000 7f9de37fe640 1 -- 172.21.15.42:0/3987285256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e9948fa40 con 0x563e9947e610 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9de37fe640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 0x563e9948bf60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009230 tx=0x7f9dd40194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c5b9968d2316d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/3987285256 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402b020 con 0x563e9947e610 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/3987285256 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9dd4009c00 con 0x563e9947e610 2024-03-31T23:17:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd809b600 con 0x563e9947e610 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/3987285256 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9dd4036050 con 0x563e9947e610 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563e994fbcd0 con 0x563e9947e610 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/3987285256 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dd809b600 con 0x563e9947e610 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/3987285256 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9dd4027170 con 0x563e9947e610 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 10 client.15480 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 20 client.15480 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99500740 0x563e994ff450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 4 client.15480 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.015+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "status"}) -- 0x563e993ea380 con 0x563e99500740 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99500740 0x563e994ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9de2ffd640 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99500740 0x563e994ff450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eeea24a7e07457c4 server_cookie=8c27375694a99dcf in_seq=0 out_seq=0 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dc2ffd640 10 client.15480 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:49.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dc2ffd640 1 -- 172.21.15.42:0/3987285256 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x563e993ea380 con 0x563e99500740 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dc2ffd640 10 client.15480 handle_command_reply: tid=0 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 client.15480 shutdown 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 msgr2=0x563e9948bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 0x563e9948bf60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009230 tx=0x7f9dd40194a0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 shutdown_connections 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563e99500740 0x563e994ff450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563e994801a0 0x563e9948f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563e9947f7e0 0x563e9948c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dc2ffd640 0 client.15480 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 --2- 172.21.15.42:0/3987285256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563e9947e610 0x563e9948bf60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 >> 172.21.15.42:0/3987285256 conn(0x563e99479a00 msgr2=0x563e994830e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 shutdown_connections 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 1 -- 172.21.15.42:0/3987285256 wait complete. 2024-03-31T23:17:49.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.016+0000 7f9dec9fd740 20 client.15480 trim_cache size 0 max 16384 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24464, 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 109.78467371000001, 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 93, 2024-03-31T23:17:49.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:49.026 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 151.78782773 2024-03-31T23:17:49.026 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:49.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9dcc0a24a0 msgr2=0x7f9dcc0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9dcc0a24a0 0x7f9dcc0a4960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc005e30 tx=0x7f9ddc032670 comp rx=0 tx=0).stop 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 msgr2=0x7f9de419c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 0x7f9de419c890 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800e9f0 tx=0x7f9dd800eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 shutdown_connections 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de4102210 0x7f9de419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9dcc0a24a0 0x7f9dcc0a4960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9de4101850 0x7f9de419c890 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 --2- 172.21.15.42:0/3333676260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9de4100660 0x7f9de406a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 >> 172.21.15.42:0/3333676260 conn(0x7f9de40fbbf0 msgr2=0x7f9de4104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 shutdown_connections 2024-03-31T23:17:49.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.017+0000 7f9dea17a640 1 -- 172.21.15.42:0/3333676260 wait complete. 2024-03-31T23:17:49.029 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.131+0000 7f2809593640 1 -- 172.21.15.42:0/2622019640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804109630 msgr2=0x7f280410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.131+0000 7f2809593640 1 --2- 172.21.15.42:0/2622019640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804109630 0x7f280410bac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009ca0 tx=0x7f27f402c180 comp rx=0 tx=0).stop 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- 172.21.15.42:0/2622019640 shutdown_connections 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 --2- 172.21.15.42:0/2622019640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804109630 0x7f280410bac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 --2- 172.21.15.42:0/2622019640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804074130 0x7f2804074590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 --2- 172.21.15.42:0/2622019640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2804075710 0x7f2804073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- 172.21.15.42:0/2622019640 >> 172.21.15.42:0/2622019640 conn(0x7f28040fccf0 msgr2=0x7f28040ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- 172.21.15.42:0/2622019640 shutdown_connections 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- 172.21.15.42:0/2622019640 wait complete. 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 Processor -- start 2024-03-31T23:17:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- start start 2024-03-31T23:17:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804074130 0x7f2804199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 0x7f280419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2804109630 0x7f28041a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f280410f740 con 0x7f2804075710 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f280410f5c0 con 0x7f2804109630 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.132+0000 7f2809593640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f280410f8c0 con 0x7f2804074130 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 0x7f280419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 0x7f280419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60888/0 (socket says 172.21.15.42:60888) 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 -- 172.21.15.42:0/1180740635 learned_addr learned my addr 172.21.15.42:0/1180740635 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804074130 0x7f2804199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28037fe640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2804109630 0x7f28041a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 -- 172.21.15.42:0/1180740635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804074130 msgr2=0x7f2804199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804074130 0x7f2804199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 -- 172.21.15.42:0/1180740635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2804109630 msgr2=0x7f28041a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2804109630 0x7f28041a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 -- 172.21.15.42:0/1180740635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28041a1940 con 0x7f2804075710 2024-03-31T23:17:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f28027fc640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 0x7f280419a270 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00ea60 tx=0x7f27ec00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f27fbfff640 1 -- 172.21.15.42:0/1180740635 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00cde0 con 0x7f2804075710 2024-03-31T23:17:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28041a1c30 con 0x7f2804075710 2024-03-31T23:17:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f27fbfff640 1 -- 172.21.15.42:0/1180740635 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27ec0035f0 con 0x7f2804075710 2024-03-31T23:17:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f27fbfff640 1 -- 172.21.15.42:0/1180740635 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec010720 con 0x7f2804075710 2024-03-31T23:17:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.133+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28041a2180 con 0x7f2804075710 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.135+0000 7f27fbfff640 1 -- 172.21.15.42:0/1180740635 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f27ec0037a0 con 0x7f2804075710 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 Processor -- start 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 -- start start 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f27fbfff640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f27f00a24a0 0x7f27f00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20857ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20857fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d208586a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d2084e2af0 con 0x55d2085801a0 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55d20848b9d0 con 0x55d20857e610 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f280c170740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d2084deb90 con 0x55d20857f7e0 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f28037fe640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f27f00a24a0 0x7f27f00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f28027fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20857fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f27fbfff640 1 -- 172.21.15.42:0/1180740635 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f27ec0cef10 con 0x7f2804075710 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f2802ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20857ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f28027fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20857fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:39064/0 (socket says 172.21.15.42:39064) 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.136+0000 7f28027fc640 1 -- 172.21.15.42:0/958863951 learned_addr learned my addr 172.21.15.42:0/958863951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f28037fe640 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d208586a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f2802ffd640 1 -- 172.21.15.42:0/958863951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 msgr2=0x55d20857fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f2802ffd640 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20857fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f2802ffd640 1 -- 172.21.15.42:0/958863951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 msgr2=0x55d208586a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f2802ffd640 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d208586a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f2802ffd640 1 -- 172.21.15.42:0/958863951 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2081f72d0 con 0x55d20857e610 2024-03-31T23:17:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f28037fe640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f27f00a24a0 0x7f27f00a4960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f27f4005e30 tx=0x7f27f4032570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f2802ffd640 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20857ea30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009bf0 tx=0x7f27fc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f6052409befce19 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f27f97fa640 1 -- 172.21.15.42:0/958863951 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc01e070 con 0x55d20857e610 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f27f97fa640 1 -- 172.21.15.42:0/958863951 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27fc0035f0 con 0x55d20857e610 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.137+0000 7f27f97fa640 1 -- 172.21.15.42:0/958863951 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0196a0 con 0x55d20857e610 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- 172.21.15.42:0/958863951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 msgr2=0x55d20857ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20857ea30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009bf0 tx=0x7f27fc011810 comp rx=0 tx=0).stop 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- 172.21.15.42:0/958863951 shutdown_connections 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d208586a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20857fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- 172.21.15.42:0/958863951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20857ea30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- 172.21.15.42:0/958863951 >> 172.21.15.42:0/958863951 conn(0x55d208579a00 msgr2=0x55d208579e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- 172.21.15.42:0/958863951 shutdown_connections 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- 172.21.15.42:0/958863951 wait complete. 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- start start 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 Processor -- start 2024-03-31T23:17:49.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208588910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d208588e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d20858fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d2085871b0 con 0x55d20857e610 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55d20849ef70 con 0x55d2085801a0 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d208587330 con 0x55d20857f7e0 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.138+0000 7f280c170740 10 client.0 _ll_register_callbacks cb 0x55d2081f6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208588910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208588910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60914/0 (socket says 172.21.15.42:60914) 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 -- 172.21.15.42:0/1795531809 learned_addr learned my addr 172.21.15.42:0/1795531809 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f28027fc640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d208588e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f28037fe640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d20858fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 -- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 msgr2=0x55d208588e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d208588e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 -- 172.21.15.42:0/1795531809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 msgr2=0x55d20858fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d20858fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 -- 172.21.15.42:0/1795531809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2082c16b0 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208588910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb8ee5daf72d68a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f27ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1795531809 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc027020 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1795531809 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f27fc005040 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27fc0035f0 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1795531809 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27fc032050 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f280c170740 10 client.15492 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.139+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d208592e70 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1795531809 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27fc0035f0 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1795531809 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f27fc0194a0 con 0x55d20857e610 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f280c170740 10 client.15492 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f280c170740 10 client.15492 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f280c170740 20 client.15492 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f280c170740 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d2085952c0 0x55d208596730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f280c170740 4 client.15492 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2084f0030 con 0x55d2085952c0 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f28027fc640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d2085952c0 0x55d208596730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f27ea7fc640 10 client.15492 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.140+0000 7f28027fc640 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d2085952c0 0x55d208596730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2df2d9ae8dc4479 server_cookie=de55828c868916a9 in_seq=0 out_seq=0 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1795531809 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d2084f0030 con 0x55d2085952c0 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f27ea7fc640 10 client.15492 handle_command_reply: tid=0 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 client.15492 shutdown 2024-03-31T23:17:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 msgr2=0x55d208588910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208588910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc009fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 shutdown_connections 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d20858fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d2085952c0 0x55d208596730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d208588e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 --2- 172.21.15.42:0/1795531809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208588910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f27ea7fc640 0 client.15492 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 >> 172.21.15.42:0/1795531809 conn(0x55d208579a00 msgr2=0x55d208578b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 shutdown_connections 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 1 -- 172.21.15.42:0/1795531809 wait complete. 2024-03-31T23:17:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.141+0000 7f280c170740 20 client.15492 trim_cache size 0 max 16384 2024-03-31T23:17:49.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.159+0000 7f280c170740 1 Processor -- start 2024-03-31T23:17:49.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.159+0000 7f280c170740 1 -- start start 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f280c170740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208586760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f280c170740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f280c170740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d208579de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f280c170740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d208594a70 con 0x55d20857e610 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f280c170740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55d208595140 con 0x55d2085801a0 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f280c170740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d208595810 con 0x55d20857f7e0 2024-03-31T23:17:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208586760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208586760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60916/0 (socket says 172.21.15.42:60916) 2024-03-31T23:17:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 -- 172.21.15.42:0/1076040072 learned_addr learned my addr 172.21.15.42:0/1076040072 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f28037fe640 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d208579de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f28027fc640 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 -- 172.21.15.42:0/1076040072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 msgr2=0x55d20858fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 -- 172.21.15.42:0/1076040072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 msgr2=0x55d208579de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d208579de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 -- 172.21.15.42:0/1076040072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d208589a40 con 0x55d20857e610 2024-03-31T23:17:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208586760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0095f0 tx=0x7f27fc009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b25f57e459b1cc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.160+0000 7f27f8ff9640 1 -- 172.21.15.42:0/1076040072 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc027040 con 0x55d20857e610 2024-03-31T23:17:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f27f8ff9640 1 -- 172.21.15.42:0/1076040072 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27fc01f040 con 0x55d20857e610 2024-03-31T23:17:49.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f27f8ff9640 1 -- 172.21.15.42:0/1076040072 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc01e070 con 0x55d20857e610 2024-03-31T23:17:49.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 -- 172.21.15.42:0/1076040072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 msgr2=0x55d208586760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208586760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0095f0 tx=0x7f27fc009390 comp rx=0 tx=0).stop 2024-03-31T23:17:49.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 -- 172.21.15.42:0/1076040072 shutdown_connections 2024-03-31T23:17:49.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d2085801a0 0x55d208579de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 --2- 172.21.15.42:0/1076040072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d20857e610 0x55d208586760 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 -- 172.21.15.42:0/1076040072 >> 172.21.15.42:0/1076040072 conn(0x55d208579a00 msgr2=0x55d20857d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 -- 172.21.15.42:0/1076040072 shutdown_connections 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 -- 172.21.15.42:0/1076040072 wait complete. 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.161+0000 7f280c170740 1 -- start start 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 Processor -- start 2024-03-31T23:17:49.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20858b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d20858ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d2085965b0 con 0x55d2085801a0 2024-03-31T23:17:49.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55d208595ee0 con 0x55d20857e610 2024-03-31T23:17:49.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d208596c80 con 0x55d20857f7e0 2024-03-31T23:17:49.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 10 client.0 _ll_register_callbacks cb 0x7f27fc01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d20858ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f2802ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20858b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d20858ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60922/0 (socket says 172.21.15.42:60922) 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 -- 172.21.15.42:0/1690318983 learned_addr learned my addr 172.21.15.42:0/1690318983 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28027fc640 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 -- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 msgr2=0x55d20858bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 -- 172.21.15.42:0/1690318983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 msgr2=0x55d20858b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20858b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 -- 172.21.15.42:0/1690318983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20858f4f0 con 0x55d2085801a0 2024-03-31T23:17:49.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f28037fe640 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d20858ef00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f27f4032650 tx=0x7f27f4032720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa77886392c8d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f27ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:49.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1690318983 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4049040 con 0x55d2085801a0 2024-03-31T23:17:49.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1690318983 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f27f4034da0 con 0x55d2085801a0 2024-03-31T23:17:49.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.162+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27fc01f040 con 0x55d2085801a0 2024-03-31T23:17:49.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1690318983 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27f4060050 con 0x55d2085801a0 2024-03-31T23:17:49.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 10 client.15498 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:49.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2085fb420 con 0x55d2085801a0 2024-03-31T23:17:49.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1690318983 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27fc01f040 con 0x55d2085801a0 2024-03-31T23:17:49.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1690318983 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f27f403f030 con 0x55d2085801a0 2024-03-31T23:17:49.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:49.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 10 client.15498 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-31T23:17:49.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 20 client.15498 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:49.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d208600120 0x55d2085fee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 4 client.15498 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "status"}) -- 0x55d2084ea380 con 0x55d208600120 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.163+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d208600120 0x55d2085fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f2802ffd640 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d208600120 0x55d2085fee30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23bd1e3a1b2312b9 server_cookie=38371bbef3217f2c in_seq=0 out_seq=0 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f27ea7fc640 10 client.15498 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f27ea7fc640 1 -- 172.21.15.42:0/1690318983 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d2084ea380 con 0x55d208600120 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f27ea7fc640 10 client.15498 handle_command_reply: tid=0 2024-03-31T23:17:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 client.15498 shutdown 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 msgr2=0x55d20858ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d20858ef00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f27f4032650 tx=0x7f27f4032720 comp rx=0 tx=0).stop 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 shutdown_connections 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d2085801a0 0x55d20858ef00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55d208600120 0x55d2085fee30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d20857f7e0 0x55d20858bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 --2- 172.21.15.42:0/1690318983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d20857e610 0x55d20858b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f27ea7fc640 0 client.15498 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:17:49.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 >> 172.21.15.42:0/1690318983 conn(0x55d208579a00 msgr2=0x55d20857cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 shutdown_connections 2024-03-31T23:17:49.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 1 -- 172.21.15.42:0/1690318983 wait complete. 2024-03-31T23:17:49.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.164+0000 7f280c170740 20 client.15498 trim_cache size 0 max 16384 2024-03-31T23:17:49.183 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24472, 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 110.942573333, 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:49.184 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 93, 2024-03-31T23:17:49.185 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:49.185 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 149.16257702300001 2024-03-31T23:17:49.185 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f27f00a24a0 msgr2=0x7f27f00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f27f00a24a0 0x7f27f00a4960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f27f4005e30 tx=0x7f27f4032570 comp rx=0 tx=0).stop 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 msgr2=0x7f280419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 0x7f280419a270 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00ea60 tx=0x7f27ec00ef20 comp rx=0 tx=0).stop 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 shutdown_connections 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2804109630 0x7f28041a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f27f00a24a0 0x7f27f00a4960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804075710 0x7f280419a270 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 --2- 172.21.15.42:0/1180740635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2804074130 0x7f2804199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 >> 172.21.15.42:0/1180740635 conn(0x7f28040fccf0 msgr2=0x7f28041055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 shutdown_connections 2024-03-31T23:17:49.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.165+0000 7f2809593640 1 -- 172.21.15.42:0/1180740635 wait complete. 2024-03-31T23:17:49.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 -- 172.21.15.42:0/2538975839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc107440 msgr2=0x7faecc109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 --2- 172.21.15.42:0/2538975839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc107440 0x7faecc109890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faec4009ca0 tx=0x7faec402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 -- 172.21.15.42:0/2538975839 shutdown_connections 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 --2- 172.21.15.42:0/2538975839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc107440 0x7faecc109890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 --2- 172.21.15.42:0/2538975839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc104b10 0x7faecc106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 --2- 172.21.15.42:0/2538975839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faecc1021e0 0x7faecc1045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 -- 172.21.15.42:0/2538975839 >> 172.21.15.42:0/2538975839 conn(0x7faecc0fbbf0 msgr2=0x7faecc0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 -- 172.21.15.42:0/2538975839 shutdown_connections 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 -- 172.21.15.42:0/2538975839 wait complete. 2024-03-31T23:17:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 Processor -- start 2024-03-31T23:17:49.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.292+0000 7faed2969640 1 -- start start 2024-03-31T23:17:49.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 0x7faecc197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faecc104b10 0x7faecc198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc107440 0x7faecc19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10d530 con 0x7faecc107440 2024-03-31T23:17:49.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10d3b0 con 0x7faecc1021e0 2024-03-31T23:17:49.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10d6b0 con 0x7faecc104b10 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 0x7faecc197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed0f06640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc107440 0x7faecc19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 0x7faecc197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:57606/0 (socket says 172.21.15.42:57606) 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 -- 172.21.15.42:0/1301769903 learned_addr learned my addr 172.21.15.42:0/1301769903 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecb7fe640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faecc104b10 0x7faecc198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 -- 172.21.15.42:0/1301769903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faecc104b10 msgr2=0x7faecc198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faecc104b10 0x7faecc198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 -- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc107440 msgr2=0x7faecc19f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc107440 0x7faecc19f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 -- 172.21.15.42:0/1301769903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc19f760 con 0x7faecc1021e0 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed0f06640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc107440 0x7faecc19f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faecbfff640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 0x7faecc197b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faec000e9f0 tx=0x7faec000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faec97fa640 1 -- 172.21.15.42:0/1301769903 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec000cd80 con 0x7faecc1021e0 2024-03-31T23:17:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc19fa50 con 0x7faecc1021e0 2024-03-31T23:17:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faec97fa640 1 -- 172.21.15.42:0/1301769903 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faec0005520 con 0x7faecc1021e0 2024-03-31T23:17:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faec97fa640 1 -- 172.21.15.42:0/1301769903 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0010690 con 0x7faecc1021e0 2024-03-31T23:17:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.293+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc19ff50 con 0x7faecc1021e0 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.296+0000 7faec97fa640 1 -- 172.21.15.42:0/1301769903 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7faec00046c0 con 0x7faecc1021e0 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.296+0000 7faed5621740 1 Processor -- start 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.296+0000 7faed5621740 1 -- start start 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.296+0000 7faed5621740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f27e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed5621740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3f29070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed5621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3f2fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed5621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570a3e87af0 con 0x5570a3f295b0 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed5621740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5570a3e309d0 con 0x5570a3f27a20 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed5621740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5570a3e83b90 con 0x5570a3f28bf0 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f27e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3f2fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f27e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:57618/0 (socket says 172.21.15.42:57618) 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faecbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3f29070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 -- 172.21.15.42:0/2059056346 learned_addr learned my addr 172.21.15.42:0/2059056346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faec97fa640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faeb40a24a0 0x7faeb40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 -- 172.21.15.42:0/2059056346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 msgr2=0x5570a3f29070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3f29070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 -- 172.21.15.42:0/2059056346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 msgr2=0x5570a3f2fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3f2fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 -- 172.21.15.42:0/2059056346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a3b9c2d0 con 0x5570a3f27a20 2024-03-31T23:17:49.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faecb7fe640 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3f2fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faeb40a24a0 0x7faeb40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faec97fa640 1 -- 172.21.15.42:0/1301769903 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7faec00ceee0 con 0x7faecc1021e0 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faed0f06640 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f27e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faec4009ca0 tx=0x7faec4005f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2380d2a12f05ed41 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faeb27fc640 1 -- 172.21.15.42:0/2059056346 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4039040 con 0x5570a3f27a20 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faeb27fc640 1 -- 172.21.15.42:0/2059056346 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faec4003b70 con 0x5570a3f27a20 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.297+0000 7faeb27fc640 1 -- 172.21.15.42:0/2059056346 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec40352f0 con 0x5570a3f27a20 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 -- 172.21.15.42:0/2059056346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 msgr2=0x5570a3f27e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed0f06640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faeb40a24a0 0x7faeb40a4960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faec404c000 tx=0x7faec4045000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f27e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faec4009ca0 tx=0x7faec4005f70 comp rx=0 tx=0).stop 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 -- 172.21.15.42:0/2059056346 shutdown_connections 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3f2fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3f29070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 --2- 172.21.15.42:0/2059056346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f27e40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 -- 172.21.15.42:0/2059056346 >> 172.21.15.42:0/2059056346 conn(0x5570a3f1ea00 msgr2=0x5570a3f1ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 -- 172.21.15.42:0/2059056346 shutdown_connections 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 -- 172.21.15.42:0/2059056346 wait complete. 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.298+0000 7faed5621740 1 -- start start 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 Processor -- start 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f31dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f32300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f39340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f305c0 con 0x5570a3f28bf0 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5570a3e43f70 con 0x5570a3f27a20 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f30740 con 0x5570a3f295b0 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed5621740 10 client.0 _ll_register_callbacks cb 0x5570a3b9bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f32300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f31dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f32300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60962/0 (socket says 172.21.15.42:60962) 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 -- 172.21.15.42:0/2295404850 learned_addr learned my addr 172.21.15.42:0/2295404850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faed0f06640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f39340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 -- 172.21.15.42:0/2295404850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 msgr2=0x5570a3f39340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f39340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 -- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 msgr2=0x5570a3f31dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f31dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 -- 172.21.15.42:0/2295404850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a3c666b0 con 0x5570a3f28bf0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecbfff640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f31dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faecb7fe640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f32300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faebc0126e0 tx=0x7faebc012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3990cb3fbbdd3ed9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.299+0000 7faeab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faeab7fe640 1 -- 172.21.15.42:0/2295404850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc012190 con 0x5570a3f28bf0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faeab7fe640 1 -- 172.21.15.42:0/2295404850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7faebc00f8c0 con 0x5570a3f28bf0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec4003b70 con 0x5570a3f28bf0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faeab7fe640 1 -- 172.21.15.42:0/2295404850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faebc00fac0 con 0x5570a3f28bf0 2024-03-31T23:17:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570a3f3c420 con 0x5570a3f28bf0 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faeab7fe640 1 -- 172.21.15.42:0/2295404850 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faec4003b70 con 0x5570a3f28bf0 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faeab7fe640 1 -- 172.21.15.42:0/2295404850 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faebc01c420 con 0x5570a3f28bf0 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 10 client.15510 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 20 client.15510 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3f3eb50 0x5570a3f3ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 4 client.15510 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570a3e95030 con 0x5570a3f3eb50 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.300+0000 7faecbfff640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3f3eb50 0x5570a3f3ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.301+0000 7faeab7fe640 10 client.15510 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.301+0000 7faecbfff640 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3f3eb50 0x5570a3f3ffc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=115adc5d03079d56 server_cookie=2bf3e71d83c59769 in_seq=0 out_seq=0 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.301+0000 7faeab7fe640 1 -- 172.21.15.42:0/2295404850 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5570a3e95030 con 0x5570a3f3eb50 2024-03-31T23:17:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.301+0000 7faeab7fe640 10 client.15510 handle_command_reply: tid=0 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.301+0000 7faed5621740 1 client.15510 shutdown 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 msgr2=0x5570a3f32300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f32300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faebc0126e0 tx=0x7faebc012ba0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 shutdown_connections 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3f3eb50 0x5570a3f3ffc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f39340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f32300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faeab7fe640 0 client.15510 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 --2- 172.21.15.42:0/2295404850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f31dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 >> 172.21.15.42:0/2295404850 conn(0x5570a3f1ea00 msgr2=0x5570a3f1db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 shutdown_connections 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 1 -- 172.21.15.42:0/2295404850 wait complete. 2024-03-31T23:17:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.302+0000 7faed5621740 20 client.15510 trim_cache size 0 max 16384 2024-03-31T23:17:49.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 Processor -- start 2024-03-31T23:17:49.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 -- start start 2024-03-31T23:17:49.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f1ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f39300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f2c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f3e300 con 0x5570a3f28bf0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f3e9d0 con 0x5570a3f27a20 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed5621740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f3f0a0 con 0x5570a3f295b0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f39300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f39300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60976/0 (socket says 172.21.15.42:60976) 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f2c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faecb7fe640 1 -- 172.21.15.42:0/4263777138 learned_addr learned my addr 172.21.15.42:0/4263777138 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faecbfff640 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f1ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 -- 172.21.15.42:0/4263777138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 msgr2=0x5570a3f1ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f1ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 -- 172.21.15.42:0/4263777138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 msgr2=0x5570a3f39300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f39300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 -- 172.21.15.42:0/4263777138 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a3f1d040 con 0x5570a3f295b0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faecb7fe640 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f39300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.320+0000 7faed0f06640 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f2c5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faec402c700 tx=0x7faec4009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e546df8f8ae6cb4c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faeb1ffb640 1 -- 172.21.15.42:0/4263777138 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4039040 con 0x5570a3f295b0 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faeb1ffb640 1 -- 172.21.15.42:0/4263777138 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faec4035220 con 0x5570a3f295b0 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faeb1ffb640 1 -- 172.21.15.42:0/4263777138 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4004510 con 0x5570a3f295b0 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 -- 172.21.15.42:0/4263777138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 msgr2=0x5570a3f2c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f2c5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faec402c700 tx=0x7faec4009360 comp rx=0 tx=0).stop 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 -- 172.21.15.42:0/4263777138 shutdown_connections 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f295b0 0x5570a3f2c5f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f28bf0 0x5570a3f39300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 --2- 172.21.15.42:0/4263777138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f1ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 -- 172.21.15.42:0/4263777138 >> 172.21.15.42:0/4263777138 conn(0x5570a3f1ea00 msgr2=0x5570a3f2fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 -- 172.21.15.42:0/4263777138 shutdown_connections 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.321+0000 7faed5621740 1 -- 172.21.15.42:0/4263777138 wait complete. 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 -- start start 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 Processor -- start 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3fa08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3fa2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f3fe40 con 0x5570a3f295b0 2024-03-31T23:17:49.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f3f770 con 0x5570a3f27a20 2024-03-31T23:17:49.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5570a3f40510 con 0x5570a3f28bf0 2024-03-31T23:17:49.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed5621740 10 client.0 _ll_register_callbacks cb 0x7faebc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:17:49.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3fa08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f37250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:57658/0 (socket says 172.21.15.42:57658) 2024-03-31T23:17:49.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed0f06640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3fa2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 -- 172.21.15.42:0/1195766105 learned_addr learned my addr 172.21.15.42:0/1195766105 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:49.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 -- 172.21.15.42:0/1195766105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 msgr2=0x5570a3fa08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3fa08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 -- 172.21.15.42:0/1195766105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 msgr2=0x5570a3fa2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3fa2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecbfff640 1 -- 172.21.15.42:0/1195766105 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a3fa36f0 con 0x5570a3f27a20 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faecb7fe640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3fa08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.322+0000 7faed0f06640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3fa2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faecbfff640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f37250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faec009b310 tx=0x7faec00cf2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cfb342b6c50bd0c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faeab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:17:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faeab7fe640 1 -- 172.21.15.42:0/1195766105 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00af060 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec4035220 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faeab7fe640 1 -- 172.21.15.42:0/1195766105 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7faec00d2650 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faeab7fe640 1 -- 172.21.15.42:0/1195766105 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faec009b150 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 10 client.25346 fetch_fsmap learned FSMap version 28 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570a3fa4ac0 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faeab7fe640 1 -- 172.21.15.42:0/1195766105 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faec4035220 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faeab7fe640 1 -- 172.21.15.42:0/1195766105 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faec00a3b90 con 0x5570a3f27a20 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 10 client.25346 fetch_fsmap finished waiting for FSMap version 28 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 10 client.25346 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 20 client.25346 populate_metadata read hostname 'smithi042' 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3fa9640 0x5570a3fa8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 4 client.25346 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.323+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "status"}) -- 0x5570a3e8f380 con 0x5570a3fa9640 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faecb7fe640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3fa9640 0x5570a3fa8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faecb7fe640 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3fa9640 0x5570a3fa8350 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ec7d64828915fb server_cookie=290ae63ef0f9789c in_seq=0 out_seq=0 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faeab7fe640 10 client.25346 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faeab7fe640 1 -- 172.21.15.42:0/1195766105 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5570a3e8f380 con 0x5570a3fa9640 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faeab7fe640 10 client.25346 handle_command_reply: tid=0 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 client.25346 shutdown 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 msgr2=0x5570a3f37250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f37250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faec009b310 tx=0x7faec00cf2d0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 shutdown_connections 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5570a3fa9640 0x5570a3fa8350 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570a3f295b0 0x5570a3fa2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570a3f28bf0 0x5570a3fa08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faeab7fe640 0 client.25346 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:17:49.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 --2- 172.21.15.42:0/1195766105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5570a3f27a20 0x5570a3f37250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 >> 172.21.15.42:0/1195766105 conn(0x5570a3f1ea00 msgr2=0x5570a3f2c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 shutdown_connections 2024-03-31T23:17:49.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 1 -- 172.21.15.42:0/1195766105 wait complete. 2024-03-31T23:17:49.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.324+0000 7faed5621740 20 client.25346 trim_cache size 0 max 16384 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "5a449cfe-efb3-11ee-b647-cb9ed24678a4", 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24497, 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 135.19123885299999, 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-03-31T23:17:49.335 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 93, 2024-03-31T23:17:49.336 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 89, 2024-03-31T23:17:49.336 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 140.63662152800001 2024-03-31T23:17:49.336 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:17:49.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faeb40a24a0 msgr2=0x7faeb40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faeb40a24a0 0x7faeb40a4960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faec404c000 tx=0x7faec4045000 comp rx=0 tx=0).stop 2024-03-31T23:17:49.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 msgr2=0x7faecc197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:49.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 0x7faecc197b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faec000e9f0 tx=0x7faec000edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 shutdown_connections 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7faeb40a24a0 0x7faeb40a4960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faecc107440 0x7faecc19f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faecc104b10 0x7faecc198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 --2- 172.21.15.42:0/1301769903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faecc1021e0 0x7faecc197b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 >> 172.21.15.42:0/1301769903 conn(0x7faecc0fbbf0 msgr2=0x7faecc102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 shutdown_connections 2024-03-31T23:17:49.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:49.325+0000 7faed2969640 1 -- 172.21.15.42:0/1301769903 wait complete. 2024-03-31T23:17:49.342 INFO:teuthology.run_tasks:Running task kclient... 2024-03-31T23:17:49.355 INFO:tasks.kclient:Mounting kernel clients... 2024-03-31T23:17:49.355 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-31T23:17:49.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:49.356 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-31T23:17:49.370 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-31T23:17:49.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:49.371 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-31T23:17:49.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:49.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-31T23:17:49.541 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-03-31T23:17:49.541 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-31T23:17:49.541 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-31T23:17:49.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph fs ls 2024-03-31T23:17:49.787 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:17:50.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:50 smithi094 ceph-mon[36167]: pgmap v357: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-03-31T23:17:50.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:50 smithi188 ceph-mon[36068]: pgmap v357: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-03-31T23:17:51.044 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:50 smithi042 ceph-mon[32380]: pgmap v357: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-03-31T23:17:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 -- 172.21.15.42:0/3767368326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf74106420 msgr2=0x7fbf7410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3767368326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf74106420 0x7fbf7410dff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00b0d0 tx=0x7fbf6c00b3e0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 -- 172.21.15.42:0/3767368326 shutdown_connections 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3767368326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf74106420 0x7fbf7410dff0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3767368326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf741013d0 0x7fbf741017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3767368326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf74101d80 0x7fbf74105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 -- 172.21.15.42:0/3767368326 >> 172.21.15.42:0/3767368326 conn(0x7fbf74077190 msgr2=0x7fbf740775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 -- 172.21.15.42:0/3767368326 shutdown_connections 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.395+0000 7fbf795d9700 1 -- 172.21.15.42:0/3767368326 wait complete. 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 Processor -- start 2024-03-31T23:17:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 -- start start 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 0x7fbf74102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf74101d80 0x7fbf74103320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf74106420 0x7fbf74103860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74111550 con 0x7fbf741013d0 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbf741113d0 con 0x7fbf74106420 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf795d9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf741116d0 con 0x7fbf74101d80 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf72ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 0x7fbf74102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf72ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 0x7fbf74102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32772/0 (socket says 172.21.15.42:32772) 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf72ffd700 1 -- 172.21.15.42:0/3966622610 learned_addr learned my addr 172.21.15.42:0/3966622610 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf727fc700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf74101d80 0x7fbf74103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.396+0000 7fbf737fe700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf74106420 0x7fbf74103860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf72ffd700 1 -- 172.21.15.42:0/3966622610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf74101d80 msgr2=0x7fbf74103320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf72ffd700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf74101d80 0x7fbf74103320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf72ffd700 1 -- 172.21.15.42:0/3966622610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf74106420 msgr2=0x7fbf74103860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf72ffd700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf74106420 0x7fbf74103860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf72ffd700 1 -- 172.21.15.42:0/3966622610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf741a6f50 con 0x7fbf741013d0 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf72ffd700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 0x7fbf74102de0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400e9a0 tx=0x7fbf6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400ca10 con 0x7fbf741013d0 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf6400cbb0 con 0x7fbf741013d0 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64018710 con 0x7fbf741013d0 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741a7240 con 0x7fbf741013d0 2024-03-31T23:17:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.397+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a7730 con 0x7fbf741013d0 2024-03-31T23:17:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.398+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74068f00 con 0x7fbf741013d0 2024-03-31T23:17:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.399+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fbf64010430 con 0x7fbf741013d0 2024-03-31T23:17:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.400+0000 7fbf6bfff700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf600a2530 0x7fbf600a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.400+0000 7fbf727fc700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf600a2530 0x7fbf600a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.400+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fbf640cec80 con 0x7fbf741013d0 2024-03-31T23:17:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.400+0000 7fbf727fc700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf600a2530 0x7fbf600a49f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbf741079b0 tx=0x7fbf5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.404+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbf6409bab0 con 0x7fbf741013d0 2024-03-31T23:17:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.658+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbf7402dcf0 con 0x7fbf741013d0 2024-03-31T23:17:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.658+0000 7fbf6bfff700 1 -- 172.21.15.42:0/3966622610 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7fbf6409b3b0 con 0x7fbf741013d0 2024-03-31T23:17:51.659 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-31T23:17:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf600a2530 msgr2=0x7fbf600a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf600a2530 0x7fbf600a49f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbf741079b0 tx=0x7fbf5c009260 comp rx=0 tx=0).stop 2024-03-31T23:17:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 msgr2=0x7fbf74102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 0x7fbf74102de0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400e9a0 tx=0x7fbf6400ecb0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 shutdown_connections 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbf600a2530 0x7fbf600a49f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf74106420 0x7fbf74103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf741013d0 0x7fbf74102de0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 --2- 172.21.15.42:0/3966622610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf74101d80 0x7fbf74103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.660+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 >> 172.21.15.42:0/3966622610 conn(0x7fbf74077190 msgr2=0x7fbf7406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.661+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 shutdown_connections 2024-03-31T23:17:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:51.661+0000 7fbf795d9700 1 -- 172.21.15.42:0/3966622610 wait complete. 2024-03-31T23:17:51.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:51 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3966622610' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-31T23:17:51.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:51 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3966622610' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-31T23:17:52.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:51 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3966622610' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T23:17:52.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-31T23:17:52.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:52.286 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-03-31T23:17:52.302 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T23:17:52.302 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T23:17:52.302 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-03-31T23:17:52.303 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-31T23:17:52.304 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42094sec preferred_lft 42094sec 2024-03-31T23:17:52.304 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-03-31T23:17:52.304 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-31T23:17:52.304 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T23:17:52.304 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-03-31T23:17:52.304 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-03-31T23:17:52.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-31T23:17:52.304 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:17:52.304 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:17:52.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-03-31T23:17:52.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-03-31T23:17:52.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-03-31T23:17:52.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-31T23:17:52.305 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:17:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:17:52.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:52.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:52.455 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T23:17:52.480 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-03-31T23:17:52.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:52.482 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-03-31T23:17:52.538 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-03-31T23:17:52.538 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T23:17:52.538 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-31T23:17:52.538 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-31T23:17:52.538 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T23:17:52.538 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:17:52.538 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:17:52.538 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-31T23:17:52.539 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-31T23:17:52.539 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-31T23:17:52.539 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:17:52.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:17:52.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:52.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:52.674 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-31T23:17:52.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:52.689 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-03-31T23:17:52.744 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:17:52.744 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:17:52.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-31T23:17:52.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-31T23:17:52.744 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:17:52.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:17:52.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:52.867 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-31T23:17:52.867 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:17:52.867 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:17:52.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-31T23:17:52.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-31T23:17:52.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-31T23:17:52.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-31T23:17:52.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-31T23:17:52.868 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:17:52.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:17:52.926 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:52 smithi042 ceph-mon[32380]: pgmap v358: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-03-31T23:17:52.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:52 smithi188 ceph-mon[36068]: pgmap v358: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-03-31T23:17:52.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:52.993 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T23:17:52.993 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-31T23:17:52.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-03-31T23:17:52.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-03-31T23:17:52.994 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-31T23:17:53.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:17:53.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:53.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T23:17:53.076 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-31T23:17:53.090 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-31T23:17:53.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T23:17:53.090 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-31T23:17:53.145 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-03-31T23:17:53.145 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-03-31T23:17:53.145 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9 2024-03-31T23:17:53.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:53.145 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-03-31T23:17:53.171 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:52 smithi094 ceph-mon[36167]: pgmap v358: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-03-31T23:17:53.229 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-03-31T23:17:53.229 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-03-31T23:17:53.229 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-03-31T23:17:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-03-31T23:17:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-03-31T23:17:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-03-31T23:17:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.94:6789,172.21.15.188:6789" 2024-03-31T23:17:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.94:6789,172.21.15.188:6789:/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9 2024-03-31T23:17:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,key=0,fsid=5a449cfe-efb3-11ee-b647-cb9ed24678a4" will pass to kernel 2024-03-31T23:17:53.360 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-31T23:17:53.360 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-03-31T23:17:53.360 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-31T23:17:53.360 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-03-31T23:17:53.360 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-31T23:17:53.362 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-31T23:17:53.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:17:53.362 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-31T23:17:53.391 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T23:17:53.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T23:17:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:53.487 INFO:teuthology.orchestra.run.smithi042.stdout:client25315 2024-03-31T23:17:53.487 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:17:53.487 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T23:17:53.503 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T23:17:53.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T23:17:53.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:53.600 INFO:teuthology.orchestra.run.smithi042.stdout:client25315 2024-03-31T23:17:53.600 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T23:17:53.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T23:17:53.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:53.655 INFO:teuthology.orchestra.run.smithi042.stdout:client25315 2024-03-31T23:17:53.655 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4.client25315/status') 2024-03-31T23:17:53.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T23:17:53.717 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.25315 (3)172.21.15.42:0/3315422350 2024-03-31T23:17:53.717 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-03-31T23:17:53.717 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-03-31T23:17:53.717 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-03-31T23:17:53.717 INFO:teuthology.orchestra.run.smithi042.stderr:71 bytes copied, 2.0529e-05 s, 3.5 MB/s 2024-03-31T23:17:53.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T23:17:53.724 INFO:teuthology.run_tasks:Running task exec... 2024-03-31T23:17:53.735 INFO:teuthology.task.exec:Executing custom commands... 2024-03-31T23:17:53.735 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:17:53.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-03-31T23:17:53.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 -- 172.21.15.42:0/1881593047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8101cb0 msgr2=0x7f38b81020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:53.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 --2- 172.21.15.42:0/1881593047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8101cb0 0x7f38b81020d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009900 tx=0x7f38b402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:53.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 -- 172.21.15.42:0/1881593047 shutdown_connections 2024-03-31T23:17:53.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 --2- 172.21.15.42:0/1881593047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b81012c0 0x7f38b8108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 --2- 172.21.15.42:0/1881593047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b8100900 0x7f38b8100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 --2- 172.21.15.42:0/1881593047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8101cb0 0x7f38b81020d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 -- 172.21.15.42:0/1881593047 >> 172.21.15.42:0/1881593047 conn(0x7f38b80fb3b0 msgr2=0x7f38b80fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 -- 172.21.15.42:0/1881593047 shutdown_connections 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.839+0000 7f38c0716640 1 -- 172.21.15.42:0/1881593047 wait complete. 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 Processor -- start 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 -- start start 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 0x7f38b8197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b81012c0 0x7f38b8198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b8101cb0 0x7f38b819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f38b810d530 con 0x7f38b8100900 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f38b810d3b0 con 0x7f38b8101cb0 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38c0716640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f38b810d6b0 con 0x7f38b81012c0 2024-03-31T23:17:53.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 0x7f38b8197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 0x7f38b8197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59320/0 (socket says 172.21.15.42:59320) 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 -- 172.21.15.42:0/443907970 learned_addr learned my addr 172.21.15.42:0/443907970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38bdcb1640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b81012c0 0x7f38b8198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38becb3640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b8101cb0 0x7f38b819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 -- 172.21.15.42:0/443907970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b81012c0 msgr2=0x7f38b8198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b81012c0 0x7f38b8198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 -- 172.21.15.42:0/443907970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b8101cb0 msgr2=0x7f38b819f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b8101cb0 0x7f38b819f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 -- 172.21.15.42:0/443907970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b819f710 con 0x7f38b8100900 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.840+0000 7f38be4b2640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 0x7f38b8197af0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f38b4000c00 tx=0x7f38b4004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.841+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4043020 con 0x7f38b8100900 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.841+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b4004250 con 0x7f38b8100900 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.841+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b819f9a0 con 0x7f38b8100900 2024-03-31T23:17:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.841+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4003b90 con 0x7f38b8100900 2024-03-31T23:17:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.841+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b819ff40 con 0x7f38b8100900 2024-03-31T23:17:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.842+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b81079e0 con 0x7f38b8100900 2024-03-31T23:17:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.843+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f38b4046020 con 0x7f38b8100900 2024-03-31T23:17:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.843+0000 7f38af7fe640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f38a40a25c0 0x7f38a40a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.843+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f38b40f1110 con 0x7f38b8100900 2024-03-31T23:17:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.843+0000 7f38bdcb1640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f38a40a25c0 0x7f38a40a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.844+0000 7f38bdcb1640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f38a40a25c0 0x7f38a40a4a80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f38a80095f0 tx=0x7f38a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:53.847+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f38b404d020 con 0x7f38b8100900 2024-03-31T23:17:54.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.069+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f38b802d3e0 con 0x7f38b8100900 2024-03-31T23:17:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.675+0000 7f38af7fe640 1 -- 172.21.15.42:0/443907970 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f38b40bdf40 con 0x7f38b8100900 2024-03-31T23:17:54.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f38a40a25c0 msgr2=0x7f38a40a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:54.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f38a40a25c0 0x7f38a40a4a80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f38a80095f0 tx=0x7f38a8005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 msgr2=0x7f38b8197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 0x7f38b8197af0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f38b4000c00 tx=0x7f38b4004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 shutdown_connections 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b8101cb0 0x7f38b819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b81012c0 0x7f38b8198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f38a40a25c0 0x7f38a40a4a80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 --2- 172.21.15.42:0/443907970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38b8100900 0x7f38b8197af0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.678+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 >> 172.21.15.42:0/443907970 conn(0x7f38b80fb3b0 msgr2=0x7f38b8104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.679+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 shutdown_connections 2024-03-31T23:17:54.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.679+0000 7f38c0716640 1 -- 172.21.15.42:0/443907970 wait complete. 2024-03-31T23:17:54.691 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-31T23:17:54.703 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-03-31T23:17:54.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 -- 172.21.15.42:0/830723770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078107510 msgr2=0x7fc078109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 --2- 172.21.15.42:0/830723770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078107510 0x7fc078109920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc070009ca0 tx=0x7fc07002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 -- 172.21.15.42:0/830723770 shutdown_connections 2024-03-31T23:17:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 --2- 172.21.15.42:0/830723770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078107510 0x7fc078109920 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 --2- 172.21.15.42:0/830723770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc078104be0 0x7fc078106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 --2- 172.21.15.42:0/830723770 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0781022b0 0x7fc0781046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 -- 172.21.15.42:0/830723770 >> 172.21.15.42:0/830723770 conn(0x7fc0780fbc80 msgr2=0x7fc0780fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 -- 172.21.15.42:0/830723770 shutdown_connections 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.819+0000 7fc07ed48640 1 -- 172.21.15.42:0/830723770 wait complete. 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 Processor -- start 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 -- start start 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0781022b0 0x7fc078197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 0x7fc078198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078107510 0x7fc07819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc07810d550 con 0x7fc078104be0 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc07810d3d0 con 0x7fc0781022b0 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07ed48640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc07810d6d0 con 0x7fc078107510 2024-03-31T23:17:54.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 0x7fc078198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 0x7fc078198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59336/0 (socket says 172.21.15.42:59336) 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 -- 172.21.15.42:0/2859774073 learned_addr learned my addr 172.21.15.42:0/2859774073 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07d2e5640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078107510 0x7fc07819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc07cae4640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0781022b0 0x7fc078197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 -- 172.21.15.42:0/2859774073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078107510 msgr2=0x7fc07819f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078107510 0x7fc07819f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 -- 172.21.15.42:0/2859774073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0781022b0 msgr2=0x7fc078197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0781022b0 0x7fc078197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.820+0000 7fc077fff640 1 -- 172.21.15.42:0/2859774073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07819f720 con 0x7fc078104be0 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.821+0000 7fc077fff640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 0x7fc078198040 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00e9c0 tx=0x7fc06c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.821+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00cd80 con 0x7fc078104be0 2024-03-31T23:17:54.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.821+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc06c005520 con 0x7fc078104be0 2024-03-31T23:17:54.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.821+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07819fa10 con 0x7fc078104be0 2024-03-31T23:17:54.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.821+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c010690 con 0x7fc078104be0 2024-03-31T23:17:54.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.821+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07819ffb0 con 0x7fc078104be0 2024-03-31T23:17:54.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.822+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0780fd770 con 0x7fc078104be0 2024-03-31T23:17:54.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.823+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fc06c0046c0 con 0x7fc078104be0 2024-03-31T23:17:54.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.823+0000 7fc075ffb640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0600a2520 0x7fc0600a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:54.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.824+0000 7fc07cae4640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0600a2520 0x7fc0600a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:54.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.824+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fc06c0cedc0 con 0x7fc078104be0 2024-03-31T23:17:54.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.824+0000 7fc07cae4640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0600a2520 0x7fc0600a49e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc068009bd0 tx=0x7fc068005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:54.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:54.828+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc06c09bbf0 con 0x7fc078104be0 2024-03-31T23:17:54.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:54 smithi188 ceph-mon[36068]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-03-31T23:17:54.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:54 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/443907970' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-31T23:17:55.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.012+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc078062350 con 0x7fc078104be0 2024-03-31T23:17:55.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.014+0000 7fc075ffb640 1 -- 172.21.15.42:0/2859774073 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7fc06c09b4f0 con 0x7fc078104be0 2024-03-31T23:17:55.015 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:55.015 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0600a2520 msgr2=0x7fc0600a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0600a2520 0x7fc0600a49e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc068009bd0 tx=0x7fc068005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 msgr2=0x7fc078198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 0x7fc078198040 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00e9c0 tx=0x7fc06c00ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 shutdown_connections 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078107510 0x7fc07819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc0600a2520 0x7fc0600a49e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc078104be0 0x7fc078198040 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 --2- 172.21.15.42:0/2859774073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0781022b0 0x7fc078197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 >> 172.21.15.42:0/2859774073 conn(0x7fc0780fbc80 msgr2=0x7fc078102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 shutdown_connections 2024-03-31T23:17:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.016+0000 7fc07ed48640 1 -- 172.21.15.42:0/2859774073 wait complete. 2024-03-31T23:17:55.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:54 smithi042 ceph-mon[32380]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-03-31T23:17:55.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:54 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/443907970' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-31T23:17:55.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:55.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:55.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 -- 172.21.15.42:0/1064742111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4481048f0 msgr2=0x7fb448106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/1064742111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4481048f0 0x7fb448106ce0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb438009ca0 tx=0x7fb43802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 -- 172.21.15.42:0/1064742111 shutdown_connections 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/1064742111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb448107220 0x7fb448109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/1064742111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4481048f0 0x7fb448106ce0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/1064742111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb448101fc0 0x7fb4481043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 -- 172.21.15.42:0/1064742111 >> 172.21.15.42:0/1064742111 conn(0x7fb4480fb9f0 msgr2=0x7fb4480fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 -- 172.21.15.42:0/1064742111 shutdown_connections 2024-03-31T23:17:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.133+0000 7fb44dfa0640 1 -- 172.21.15.42:0/1064742111 wait complete. 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 Processor -- start 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 -- start start 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 0x7fb4481978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4481048f0 0x7fb448197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb448107220 0x7fb44819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810d2f0 con 0x7fb448101fc0 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810d170 con 0x7fb4481048f0 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44dfa0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810d470 con 0x7fb448107220 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44cf9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 0x7fb4481978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44cf9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 0x7fb4481978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59362/0 (socket says 172.21.15.42:59362) 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44cf9e640 1 -- 172.21.15.42:0/3227012948 learned_addr learned my addr 172.21.15.42:0/3227012948 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb447fff640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4481048f0 0x7fb448197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.134+0000 7fb44d79f640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb448107220 0x7fb44819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44cf9e640 1 -- 172.21.15.42:0/3227012948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb448107220 msgr2=0x7fb44819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44cf9e640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb448107220 0x7fb44819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44cf9e640 1 -- 172.21.15.42:0/3227012948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4481048f0 msgr2=0x7fb448197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44cf9e640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4481048f0 0x7fb448197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44cf9e640 1 -- 172.21.15.42:0/3227012948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44819f510 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb447fff640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4481048f0 0x7fb448197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44cf9e640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 0x7fb4481978f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e9f0 tx=0x7fb44000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44000cd80 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb440010930 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44819f800 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440018b00 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.135+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44819fd20 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.136+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4480fd4e0 con 0x7fb448101fc0 2024-03-31T23:17:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.137+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fb440018ca0 con 0x7fb448101fc0 2024-03-31T23:17:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.138+0000 7fb445ffb640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb4340a24a0 0x7fb4340a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.138+0000 7fb447fff640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb4340a24a0 0x7fb4340a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.138+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fb4400cee20 con 0x7fb448101fc0 2024-03-31T23:17:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.138+0000 7fb447fff640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb4340a24a0 0x7fb4340a4960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb43802c700 tx=0x7fb438032670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.143+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb44009b600 con 0x7fb448101fc0 2024-03-31T23:17:55.171 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:54 smithi094 ceph-mon[36167]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-03-31T23:17:55.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:54 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/443907970' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-31T23:17:55.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.324+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb448062380 con 0x7fb448101fc0 2024-03-31T23:17:55.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.324+0000 7fb445ffb640 1 -- 172.21.15.42:0/3227012948 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7fb44009f6a0 con 0x7fb448101fc0 2024-03-31T23:17:55.325 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb4340a24a0 msgr2=0x7fb4340a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb4340a24a0 0x7fb4340a4960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb43802c700 tx=0x7fb438032670 comp rx=0 tx=0).stop 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 msgr2=0x7fb4481978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 0x7fb4481978f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e9f0 tx=0x7fb44000eeb0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 shutdown_connections 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb448107220 0x7fb44819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4481048f0 0x7fb448197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb4340a24a0 0x7fb4340a4960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 --2- 172.21.15.42:0/3227012948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb448101fc0 0x7fb4481978f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 >> 172.21.15.42:0/3227012948 conn(0x7fb4480fb9f0 msgr2=0x7fb448102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 shutdown_connections 2024-03-31T23:17:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.327+0000 7fb44dfa0640 1 -- 172.21.15.42:0/3227012948 wait complete. 2024-03-31T23:17:55.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:17:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 -- 172.21.15.42:0/1482532833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c100650 msgr2=0x7fc53c100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 --2- 172.21.15.42:0/1482532833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c100650 0x7fc53c100a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009900 tx=0x7fc52c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 -- 172.21.15.42:0/1482532833 shutdown_connections 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 --2- 172.21.15.42:0/1482532833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c102200 0x7fc53c108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 --2- 172.21.15.42:0/1482532833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c101840 0x7fc53c101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 --2- 172.21.15.42:0/1482532833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c100650 0x7fc53c100a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 -- 172.21.15.42:0/1482532833 >> 172.21.15.42:0/1482532833 conn(0x7fc53c0fbbe0 msgr2=0x7fc53c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 -- 172.21.15.42:0/1482532833 shutdown_connections 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 -- 172.21.15.42:0/1482532833 wait complete. 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.444+0000 7fc541eed640 1 Processor -- start 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 -- start start 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 0x7fc53c1045e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c101840 0x7fc53c102c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c102200 0x7fc53c103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c10c3b0 con 0x7fc53c100650 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c10c230 con 0x7fc53c101840 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc541eed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c10c530 con 0x7fc53c102200 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 0x7fc53c1045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 0x7fc53c1045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59386/0 (socket says 172.21.15.42:59386) 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 -- 172.21.15.42:0/2931757305 learned_addr learned my addr 172.21.15.42:0/2931757305 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53affd640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c101840 0x7fc53c102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53bfff640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c102200 0x7fc53c103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 -- 172.21.15.42:0/2931757305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c102200 msgr2=0x7fc53c103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c102200 0x7fc53c103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 -- 172.21.15.42:0/2931757305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c101840 msgr2=0x7fc53c102c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c101840 0x7fc53c102c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 -- 172.21.15.42:0/2931757305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c1039f0 con 0x7fc53c100650 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53affd640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c101840 0x7fc53c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.445+0000 7fc53b7fe640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 0x7fc53c1045e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc52c000c00 tx=0x7fc52c004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.446+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c043020 con 0x7fc53c100650 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.446+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53c1a1c90 con 0x7fc53c100650 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.446+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc52c004250 con 0x7fc53c100650 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.446+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c003b90 con 0x7fc53c100650 2024-03-31T23:17:55.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.446+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53c1a2190 con 0x7fc53c100650 2024-03-31T23:17:55.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.447+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c1a23c0 con 0x7fc53c100650 2024-03-31T23:17:55.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.448+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fc52c046020 con 0x7fc53c100650 2024-03-31T23:17:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.448+0000 7fc538ff9640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc5240a24a0 0x7fc5240a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.448+0000 7fc53affd640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc5240a24a0 0x7fc5240a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.448+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fc52c0f1190 con 0x7fc53c100650 2024-03-31T23:17:55.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.449+0000 7fc53affd640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc5240a24a0 0x7fc5240a4960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc5300095f0 tx=0x7fc530005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:55.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.452+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc52c04d020 con 0x7fc53c100650 2024-03-31T23:17:55.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.633+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc53c1a26b0 con 0x7fc53c100650 2024-03-31T23:17:55.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.634+0000 7fc538ff9640 1 -- 172.21.15.42:0/2931757305 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fc52c0bdfc0 con 0x7fc53c100650 2024-03-31T23:17:55.635 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:55.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.635+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc5240a24a0 msgr2=0x7fc5240a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.635+0000 7fc541eed640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc5240a24a0 0x7fc5240a4960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc5300095f0 tx=0x7fc530005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.635+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 msgr2=0x7fc53c1045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.635+0000 7fc541eed640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 0x7fc53c1045e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc52c000c00 tx=0x7fc52c004a30 comp rx=0 tx=0).stop 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 shutdown_connections 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc53c102200 0x7fc53c103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc53c101840 0x7fc53c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fc5240a24a0 0x7fc5240a4960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 --2- 172.21.15.42:0/2931757305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc53c100650 0x7fc53c1045e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 >> 172.21.15.42:0/2931757305 conn(0x7fc53c0fbbe0 msgr2=0x7fc53c0fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 shutdown_connections 2024-03-31T23:17:55.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.636+0000 7fc541eed640 1 -- 172.21.15.42:0/2931757305 wait complete. 2024-03-31T23:17:55.648 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:17:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 -- 172.21.15.42:0/1727322758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008102210 msgr2=0x7fc008108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/1727322758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008102210 0x7fc008108aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc000009ca0 tx=0x7fc00002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 -- 172.21.15.42:0/1727322758 shutdown_connections 2024-03-31T23:17:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/1727322758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008102210 0x7fc008108aa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/1727322758 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc008101850 0x7fc008101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/1727322758 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc008100660 0x7fc008100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 -- 172.21.15.42:0/1727322758 >> 172.21.15.42:0/1727322758 conn(0x7fc0080fbbf0 msgr2=0x7fc0080fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 -- 172.21.15.42:0/1727322758 shutdown_connections 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.753+0000 7fc00ce4e640 1 -- 172.21.15.42:0/1727322758 wait complete. 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 Processor -- start 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 -- start start 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 0x7fc00806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc008101850 0x7fc00819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc008102210 0x7fc00819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc00810c410 con 0x7fc008100660 2024-03-31T23:17:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc00810c290 con 0x7fc008101850 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00ce4e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc00810c590 con 0x7fc008102210 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 0x7fc00806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 0x7fc00806a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59412/0 (socket says 172.21.15.42:59412) 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 -- 172.21.15.42:0/3922566675 learned_addr learned my addr 172.21.15.42:0/3922566675 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc005d9b640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc008101850 0x7fc00819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc006d9d640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc008102210 0x7fc00819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 -- 172.21.15.42:0/3922566675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc008102210 msgr2=0x7fc00819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc008102210 0x7fc00819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 -- 172.21.15.42:0/3922566675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc008101850 msgr2=0x7fc00819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc008101850 0x7fc00819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.754+0000 7fc00659c640 1 -- 172.21.15.42:0/3922566675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00819f720 con 0x7fc008100660 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.755+0000 7fc00659c640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 0x7fc00806a950 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e9c0 tx=0x7fbff800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.755+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800cd80 con 0x7fc008100660 2024-03-31T23:17:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.755+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbff80035f0 con 0x7fc008100660 2024-03-31T23:17:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.755+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00819fa10 con 0x7fc008100660 2024-03-31T23:17:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.755+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8010670 con 0x7fc008100660 2024-03-31T23:17:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.755+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00819ff10 con 0x7fc008100660 2024-03-31T23:17:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.756+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0081078b0 con 0x7fc008100660 2024-03-31T23:17:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.757+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fbff80037a0 con 0x7fc008100660 2024-03-31T23:17:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.757+0000 7fbff77fe640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbff00a24a0 0x7fbff00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.758+0000 7fc005d9b640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbff00a24a0 0x7fbff00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.758+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fbff80cee90 con 0x7fc008100660 2024-03-31T23:17:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.758+0000 7fc005d9b640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbff00a24a0 0x7fbff00a4960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc00806a6c0 tx=0x7fbffc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.762+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbff809bc60 con 0x7fc008100660 2024-03-31T23:17:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.945+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc0080623f0 con 0x7fc008100660 2024-03-31T23:17:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.945+0000 7fbff77fe640 1 -- 172.21.15.42:0/3922566675 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fbff809b560 con 0x7fc008100660 2024-03-31T23:17:55.946 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbff00a24a0 msgr2=0x7fbff00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbff00a24a0 0x7fbff00a4960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc00806a6c0 tx=0x7fbffc005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 msgr2=0x7fc00806a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 0x7fc00806a950 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e9c0 tx=0x7fbff800ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 shutdown_connections 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc008102210 0x7fc00819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc008101850 0x7fc00819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fbff00a24a0 0x7fbff00a4960 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 --2- 172.21.15.42:0/3922566675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc008100660 0x7fc00806a950 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 >> 172.21.15.42:0/3922566675 conn(0x7fc0080fbbf0 msgr2=0x7fc008104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 shutdown_connections 2024-03-31T23:17:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:55.947+0000 7fc00ce4e640 1 -- 172.21.15.42:0/3922566675 wait complete. 2024-03-31T23:17:55.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/443907970' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-31T23:17:55.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:55 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:17:55.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2859774073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:55.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3227012948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:55.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2931757305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:55.959 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:17:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/443907970' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-31T23:17:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:55 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:17:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2859774073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3227012948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:55.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2931757305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 -- 172.21.15.42:0/3315790991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2984104b20 msgr2=0x7f2984106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 --2- 172.21.15.42:0/3315790991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2984104b20 0x7f2984106f10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2974009900 tx=0x7f297402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 -- 172.21.15.42:0/3315790991 shutdown_connections 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 --2- 172.21.15.42:0/3315790991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2984107450 0x7f29841098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 --2- 172.21.15.42:0/3315790991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2984104b20 0x7f2984106f10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 --2- 172.21.15.42:0/3315790991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29841021f0 0x7f29841045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 -- 172.21.15.42:0/3315790991 >> 172.21.15.42:0/3315790991 conn(0x7f29840fbc00 msgr2=0x7f29840fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 -- 172.21.15.42:0/3315790991 shutdown_connections 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.064+0000 7f298a3ae640 1 -- 172.21.15.42:0/3315790991 wait complete. 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 Processor -- start 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 -- start start 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 0x7f2984197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2984104b20 0x7f29841980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2984107450 0x7f298419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f298410d4d0 con 0x7f29841021f0 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f298410d350 con 0x7f2984107450 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298a3ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f298410d650 con 0x7f2984104b20 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 0x7f2984197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 0x7f2984197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59430/0 (socket says 172.21.15.42:59430) 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f298894b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2984107450 0x7f298419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 -- 172.21.15.42:0/1186080107 learned_addr learned my addr 172.21.15.42:0/1186080107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f29837fe640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2984104b20 0x7f29841980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 -- 172.21.15.42:0/1186080107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2984104b20 msgr2=0x7f29841980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2984104b20 0x7f29841980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 -- 172.21.15.42:0/1186080107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2984107450 msgr2=0x7f298419f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2984107450 0x7f298419f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.065+0000 7f2983fff640 1 -- 172.21.15.42:0/1186080107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298419f7a0 con 0x7f29841021f0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.066+0000 7f2983fff640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 0x7f2984197b80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f297800e9f0 tx=0x7f297800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.066+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297800cd80 con 0x7f29841021f0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.066+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2978005520 con 0x7f29841021f0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.066+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298419fa90 con 0x7f29841021f0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.066+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978010690 con 0x7f29841021f0 2024-03-31T23:17:56.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.066+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298419ffb0 con 0x7f29841021f0 2024-03-31T23:17:56.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.067+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29840fd6f0 con 0x7f29841021f0 2024-03-31T23:17:56.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.068+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f29780046c0 con 0x7f29841021f0 2024-03-31T23:17:56.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.068+0000 7f29817fa640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f296c0a2520 0x7f296c0a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.069+0000 7f29837fe640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f296c0a2520 0x7f296c0a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.069+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f29780cee30 con 0x7f29841021f0 2024-03-31T23:17:56.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.069+0000 7f29837fe640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f296c0a2520 0x7f296c0a49e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f297402c900 tx=0x7f2974005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:56.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.073+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f297809bc60 con 0x7f29841021f0 2024-03-31T23:17:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/443907970' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-31T23:17:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:55 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:17:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2859774073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3227012948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2931757305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.254+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2984062380 con 0x7f29841021f0 2024-03-31T23:17:56.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.255+0000 7f29817fa640 1 -- 172.21.15.42:0/1186080107 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f297809b560 con 0x7f29841021f0 2024-03-31T23:17:56.256 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f296c0a2520 msgr2=0x7f296c0a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f296c0a2520 0x7f296c0a49e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f297402c900 tx=0x7f2974005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 msgr2=0x7f2984197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 0x7f2984197b80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f297800e9f0 tx=0x7f297800edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 shutdown_connections 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2984107450 0x7f298419f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2984104b20 0x7f29841980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f296c0a2520 0x7f296c0a49e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 --2- 172.21.15.42:0/1186080107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29841021f0 0x7f2984197b80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 >> 172.21.15.42:0/1186080107 conn(0x7f29840fbc00 msgr2=0x7f2984102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:56.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 shutdown_connections 2024-03-31T23:17:56.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.257+0000 7f298a3ae640 1 -- 172.21.15.42:0/1186080107 wait complete. 2024-03-31T23:17:56.269 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:56.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.371+0000 7f785c38a640 1 -- 172.21.15.42:0/3742474094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854102220 msgr2=0x7f7854108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.371+0000 7f785c38a640 1 --2- 172.21.15.42:0/3742474094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854102220 0x7f7854108ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7850009ca0 tx=0x7f785002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- 172.21.15.42:0/3742474094 shutdown_connections 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 --2- 172.21.15.42:0/3742474094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854102220 0x7f7854108ab0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 --2- 172.21.15.42:0/3742474094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7854101860 0x7f7854101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 --2- 172.21.15.42:0/3742474094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7854100670 0x7f7854100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- 172.21.15.42:0/3742474094 >> 172.21.15.42:0/3742474094 conn(0x7f78540fbbe0 msgr2=0x7f78540fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- 172.21.15.42:0/3742474094 shutdown_connections 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- 172.21.15.42:0/3742474094 wait complete. 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 Processor -- start 2024-03-31T23:17:56.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- start start 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7854100670 0x7f7854069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 0x7f785419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7854102220 0x7f785419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f785410c420 con 0x7f7854101860 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f785410c2a0 con 0x7f7854100670 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.372+0000 7f785c38a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f785410c5a0 con 0x7f7854102220 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 0x7f785419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 0x7f785419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59446/0 (socket says 172.21.15.42:59446) 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 -- 172.21.15.42:0/2822218327 learned_addr learned my addr 172.21.15.42:0/2822218327 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f785a126640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7854100670 0x7f7854069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f785a927640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7854102220 0x7f785419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 -- 172.21.15.42:0/2822218327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7854102220 msgr2=0x7f785419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7854102220 0x7f785419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 -- 172.21.15.42:0/2822218327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7854100670 msgr2=0x7f7854069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7854100670 0x7f7854069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 -- 172.21.15.42:0/2822218327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785419f790 con 0x7f7854101860 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f7859925640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 0x7f785419c860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f784400ea60 tx=0x7f784400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784400cde0 con 0x7f7854101860 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78440035f0 con 0x7f7854101860 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785419fa20 con 0x7f7854101860 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844010720 con 0x7f7854101860 2024-03-31T23:17:56.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.373+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785419ff70 con 0x7f7854101860 2024-03-31T23:17:56.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.374+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7854107930 con 0x7f7854101860 2024-03-31T23:17:56.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.375+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f78440037a0 con 0x7f7854101860 2024-03-31T23:17:56.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.376+0000 7f784b7fe640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78400a24a0 0x7f78400a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.376+0000 7f785a126640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78400a24a0 0x7f78400a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.376+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f78440cee80 con 0x7f7854101860 2024-03-31T23:17:56.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.376+0000 7f785a126640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78400a24a0 0x7f78400a4960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f78541016c0 tx=0x7f784c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:56.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.381+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f784409bcb0 con 0x7f7854101860 2024-03-31T23:17:56.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.564+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7854062350 con 0x7f7854101860 2024-03-31T23:17:56.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.565+0000 7f784b7fe640 1 -- 172.21.15.42:0/2822218327 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7f784409b5b0 con 0x7f7854101860 2024-03-31T23:17:56.566 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:56.567 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:56.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78400a24a0 msgr2=0x7f78400a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78400a24a0 0x7f78400a4960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f78541016c0 tx=0x7f784c005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:56.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 msgr2=0x7f785419c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 0x7f785419c860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f784400ea60 tx=0x7f784400ef20 comp rx=0 tx=0).stop 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 shutdown_connections 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7854102220 0x7f785419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f78400a24a0 0x7f78400a4960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7854101860 0x7f785419c860 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 --2- 172.21.15.42:0/2822218327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7854100670 0x7f7854069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 >> 172.21.15.42:0/2822218327 conn(0x7f78540fbbe0 msgr2=0x7f7854104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.567+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 shutdown_connections 2024-03-31T23:17:56.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.568+0000 7f785c38a640 1 -- 172.21.15.42:0/2822218327 wait complete. 2024-03-31T23:17:56.580 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:56.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:56.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 -- 172.21.15.42:0/1415812975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8104b30 msgr2=0x7feab8106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 --2- 172.21.15.42:0/1415812975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8104b30 0x7feab8106f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009860 tx=0x7feaa802bb70 comp rx=0 tx=0).stop 2024-03-31T23:17:56.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 -- 172.21.15.42:0/1415812975 shutdown_connections 2024-03-31T23:17:56.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 --2- 172.21.15.42:0/1415812975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feab8107460 0x7feab81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 --2- 172.21.15.42:0/1415812975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8104b30 0x7feab8106f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 --2- 172.21.15.42:0/1415812975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8102200 0x7feab81045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 -- 172.21.15.42:0/1415812975 >> 172.21.15.42:0/1415812975 conn(0x7feab80fbbf0 msgr2=0x7feab80fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:56.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 -- 172.21.15.42:0/1415812975 shutdown_connections 2024-03-31T23:17:56.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.685+0000 7feabfe84640 1 -- 172.21.15.42:0/1415812975 wait complete. 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 Processor -- start 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 -- start start 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8102200 0x7feab8199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 0x7feab819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feab8107460 0x7feab81a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feab810d510 con 0x7feab8104b30 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feab810d390 con 0x7feab8107460 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabfe84640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feab810d690 con 0x7feab8102200 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 0x7feab819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 0x7feab819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59458/0 (socket says 172.21.15.42:59458) 2024-03-31T23:17:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 -- 172.21.15.42:0/1308143093 learned_addr learned my addr 172.21.15.42:0/1308143093 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabe421640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feab8107460 0x7feab81a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabdc20640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8102200 0x7feab8199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 -- 172.21.15.42:0/1308143093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8102200 msgr2=0x7feab8199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8102200 0x7feab8199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 -- 172.21.15.42:0/1308143093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feab8107460 msgr2=0x7feab81a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feab8107460 0x7feab81a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.686+0000 7feabd41f640 1 -- 172.21.15.42:0/1308143093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab81a1930 con 0x7feab8104b30 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.687+0000 7feabd41f640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 0x7feab819a260 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feaa8034a80 tx=0x7feaa8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.688+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8041020 con 0x7feab8104b30 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.688+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab81a1bc0 con 0x7feab8104b30 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.688+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feaa802ca10 con 0x7feab8104b30 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.688+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab81a2100 con 0x7feab8104b30 2024-03-31T23:17:56.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.688+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8039040 con 0x7feab8104b30 2024-03-31T23:17:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.689+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab8108f50 con 0x7feab8104b30 2024-03-31T23:17:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.690+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7feaa8044020 con 0x7feab8104b30 2024-03-31T23:17:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.690+0000 7feaaeffd640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7feaa40a24a0 0x7feaa40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.691+0000 7feabdc20640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7feaa40a24a0 0x7feaa40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.691+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7feaa80f0390 con 0x7feab8104b30 2024-03-31T23:17:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.691+0000 7feabdc20640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7feaa40a24a0 0x7feaa40a4960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feab819b1f0 tx=0x7feab4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:56.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.695+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7feaa804b020 con 0x7feab8104b30 2024-03-31T23:17:56.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.880+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feab802d170 con 0x7feab8104b30 2024-03-31T23:17:56.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.880+0000 7feaaeffd640 1 -- 172.21.15.42:0/1308143093 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7feaa80bd160 con 0x7feab8104b30 2024-03-31T23:17:56.881 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:56.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.882+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7feaa40a24a0 msgr2=0x7feaa40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.882+0000 7feabfe84640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7feaa40a24a0 0x7feaa40a4960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feab819b1f0 tx=0x7feab4009260 comp rx=0 tx=0).stop 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.882+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 msgr2=0x7feab819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.882+0000 7feabfe84640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 0x7feab819a260 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feaa8034a80 tx=0x7feaa8005dc0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 shutdown_connections 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feab8107460 0x7feab81a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7feaa40a24a0 0x7feaa40a4960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feab8104b30 0x7feab819a260 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 --2- 172.21.15.42:0/1308143093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feab8102200 0x7feab8199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 >> 172.21.15.42:0/1308143093 conn(0x7feab80fbbf0 msgr2=0x7feab8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 shutdown_connections 2024-03-31T23:17:56.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:56.883+0000 7feabfe84640 1 -- 172.21.15.42:0/1308143093 wait complete. 2024-03-31T23:17:56.893 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:56 smithi042 ceph-mon[32380]: pgmap v360: 129 pgs: 129 active+clean; 652 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-03-31T23:17:56.894 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3922566675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.894 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1186080107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.894 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2822218327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:56.895 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:17:56.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:56 smithi188 ceph-mon[36068]: pgmap v360: 129 pgs: 129 active+clean; 652 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-03-31T23:17:56.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3922566675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1186080107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:56.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2822218327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 -- 172.21.15.42:0/699110081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 msgr2=0x7fd7c0101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 --2- 172.21.15.42:0/699110081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c0101cd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009900 tx=0x7fd7b002bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 -- 172.21.15.42:0/699110081 shutdown_connections 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 --2- 172.21.15.42:0/699110081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0102210 0x7fd7c0108aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 --2- 172.21.15.42:0/699110081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c0101cd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 --2- 172.21.15.42:0/699110081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7c0100660 0x7fd7c0100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 -- 172.21.15.42:0/699110081 >> 172.21.15.42:0/699110081 conn(0x7fd7c00fbbf0 msgr2=0x7fd7c00fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 -- 172.21.15.42:0/699110081 shutdown_connections 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.000+0000 7fd7c764e640 1 -- 172.21.15.42:0/699110081 wait complete. 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 Processor -- start 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 -- start start 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7c0100660 0x7fd7c006a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0102210 0x7fd7c019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c010c3c0 con 0x7fd7c0101850 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c010c240 con 0x7fd7c0100660 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c764e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c010c540 con 0x7fd7c0102210 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c019c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59470/0 (socket says 172.21.15.42:59470) 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 -- 172.21.15.42:0/3060864856 learned_addr learned my addr 172.21.15.42:0/3060864856 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c53ea640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7c0100660 0x7fd7c006a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c5beb640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0102210 0x7fd7c019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 -- 172.21.15.42:0/3060864856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0102210 msgr2=0x7fd7c019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0102210 0x7fd7c019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 -- 172.21.15.42:0/3060864856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7c0100660 msgr2=0x7fd7c006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7c0100660 0x7fd7c006a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.001+0000 7fd7c4be9640 1 -- 172.21.15.42:0/3060864856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c019f770 con 0x7fd7c0101850 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.002+0000 7fd7c4be9640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c019c870 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009230 tx=0x7fd7b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.002+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0043020 con 0x7fd7c0101850 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.002+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7b0004250 con 0x7fd7c0101850 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.002+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c019fa00 con 0x7fd7c0101850 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.002+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0003b50 con 0x7fd7c0101850 2024-03-31T23:17:57.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.002+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c019ffa0 con 0x7fd7c0101850 2024-03-31T23:17:57.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.003+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c0068990 con 0x7fd7c0101850 2024-03-31T23:17:57.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.004+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fd7b0046020 con 0x7fd7c0101850 2024-03-31T23:17:57.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.005+0000 7fd7b67fc640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7ac0a2520 0x7fd7ac0a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.005+0000 7fd7c53ea640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7ac0a2520 0x7fd7ac0a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.005+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fd7b00f0b40 con 0x7fd7c0101850 2024-03-31T23:17:57.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.005+0000 7fd7c53ea640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7ac0a2520 0x7fd7ac0a49e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7c01016b0 tx=0x7fd7bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.009+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd7b004d020 con 0x7fd7c0101850 2024-03-31T23:17:57.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:56 smithi094 ceph-mon[36167]: pgmap v360: 129 pgs: 129 active+clean; 652 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-03-31T23:17:57.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3922566675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1186080107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2822218327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:57.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.192+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd7c0062350 con 0x7fd7c0101850 2024-03-31T23:17:57.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.192+0000 7fd7b67fc640 1 -- 172.21.15.42:0/3060864856 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fd7b00bd910 con 0x7fd7c0101850 2024-03-31T23:17:57.193 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7ac0a2520 msgr2=0x7fd7ac0a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7ac0a2520 0x7fd7ac0a49e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7c01016b0 tx=0x7fd7bc005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 msgr2=0x7fd7c019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c019c870 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009230 tx=0x7fd7b0004ab0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 shutdown_connections 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0102210 0x7fd7c019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7ac0a2520 0x7fd7ac0a49e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0101850 0x7fd7c019c870 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 --2- 172.21.15.42:0/3060864856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7c0100660 0x7fd7c006a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 >> 172.21.15.42:0/3060864856 conn(0x7fd7c00fbbf0 msgr2=0x7fd7c0104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 shutdown_connections 2024-03-31T23:17:57.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.195+0000 7fd7c764e640 1 -- 172.21.15.42:0/3060864856 wait complete. 2024-03-31T23:17:57.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 -- 172.21.15.42:0/700468455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4102940 msgr2=0x7fe4d4102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/700468455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4102940 0x7fe4d4102dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009860 tx=0x7fe4c402bb90 comp rx=0 tx=0).stop 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 -- 172.21.15.42:0/700468455 shutdown_connections 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/700468455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d4109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/700468455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4102940 0x7fe4d4102dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/700468455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4101750 0x7fe4d4101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 -- 172.21.15.42:0/700468455 >> 172.21.15.42:0/700468455 conn(0x7fe4d40fccc0 msgr2=0x7fe4d40ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 -- 172.21.15.42:0/700468455 shutdown_connections 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 -- 172.21.15.42:0/700468455 wait complete. 2024-03-31T23:17:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 Processor -- start 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.312+0000 7fe4da9ae640 1 -- start start 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4da9ae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4101750 0x7fe4d4197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4da9ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4102940 0x7fe4d41980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4da9ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4da9ae640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410d500 con 0x7fe4d4103300 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4da9ae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410d380 con 0x7fe4d4101750 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4da9ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410d680 con 0x7fe4d4102940 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d419f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59490/0 (socket says 172.21.15.42:59490) 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4101750 0x7fe4d4197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 -- 172.21.15.42:0/250228001 learned_addr learned my addr 172.21.15.42:0/250228001 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d37fe640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4102940 0x7fe4d41980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 -- 172.21.15.42:0/250228001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4102940 msgr2=0x7fe4d41980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4102940 0x7fe4d41980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 -- 172.21.15.42:0/250228001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4101750 msgr2=0x7fe4d4197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4101750 0x7fe4d4197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 -- 172.21.15.42:0/250228001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d419f790 con 0x7fe4d4103300 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d8f4b640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d419f120 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00efd0 tx=0x7fe4cc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.313+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc003b70 con 0x7fe4d4103300 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.314+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d419fa80 con 0x7fe4d4103300 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.314+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4cc003d10 con 0x7fe4d4103300 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.314+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc010940 con 0x7fe4d4103300 2024-03-31T23:17:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.314+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d419ffa0 con 0x7fe4d4103300 2024-03-31T23:17:57.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.315+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d4108a70 con 0x7fe4d4103300 2024-03-31T23:17:57.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.316+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fe4cc004020 con 0x7fe4d4103300 2024-03-31T23:17:57.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.316+0000 7fe4d17fa640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4bc0a24a0 0x7fe4bc0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.316+0000 7fe4d3fff640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4bc0a24a0 0x7fe4bc0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.316+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fe4cc0cef60 con 0x7fe4d4103300 2024-03-31T23:17:57.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.317+0000 7fe4d3fff640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4bc0a24a0 0x7fe4bc0a4960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe4d41027a0 tx=0x7fe4c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.321+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe4cc09bd90 con 0x7fe4d4103300 2024-03-31T23:17:57.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.503+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4d4062350 con 0x7fe4d4103300 2024-03-31T23:17:57.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.504+0000 7fe4d17fa640 1 -- 172.21.15.42:0/250228001 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fe4cc09b690 con 0x7fe4d4103300 2024-03-31T23:17:57.505 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:17:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.505+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4bc0a24a0 msgr2=0x7fe4bc0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.505+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4bc0a24a0 0x7fe4bc0a4960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe4d41027a0 tx=0x7fe4c8009260 comp rx=0 tx=0).stop 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.505+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 msgr2=0x7fe4d419f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.505+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d419f120 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00efd0 tx=0x7fe4cc00c6a0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 shutdown_connections 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe4bc0a24a0 0x7fe4bc0a4960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4d4103300 0x7fe4d419f120 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d4102940 0x7fe4d41980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 --2- 172.21.15.42:0/250228001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4d4101750 0x7fe4d4197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 >> 172.21.15.42:0/250228001 conn(0x7fe4d40fccc0 msgr2=0x7fe4d4105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 shutdown_connections 2024-03-31T23:17:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.506+0000 7fe4da9ae640 1 -- 172.21.15.42:0/250228001 wait complete. 2024-03-31T23:17:57.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:17:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 -- 172.21.15.42:0/1782399048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6070102ac0 msgr2=0x7f6070102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 --2- 172.21.15.42:0/1782399048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6070102ac0 0x7f6070102f40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f605c009930 tx=0x7f605c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 -- 172.21.15.42:0/1782399048 shutdown_connections 2024-03-31T23:17:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 --2- 172.21.15.42:0/1782399048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6070103480 0x7f6070109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 --2- 172.21.15.42:0/1782399048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6070102ac0 0x7f6070102f40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 --2- 172.21.15.42:0/1782399048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60700ffa50 0x7f60700ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 -- 172.21.15.42:0/1782399048 >> 172.21.15.42:0/1782399048 conn(0x7f60700fb380 msgr2=0x7f60700fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 -- 172.21.15.42:0/1782399048 shutdown_connections 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.623+0000 7f6076eda640 1 -- 172.21.15.42:0/1782399048 wait complete. 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 Processor -- start 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 -- start start 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 0x7f6070197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6070102ac0 0x7f60701980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6070103480 0x7f607019f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f607010d4e0 con 0x7f60700ffa50 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f607010d360 con 0x7f6070103480 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6076eda640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f607010d660 con 0x7f6070102ac0 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 0x7f6070197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 0x7f6070197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59504/0 (socket says 172.21.15.42:59504) 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 -- 172.21.15.42:0/3077236385 learned_addr learned my addr 172.21.15.42:0/3077236385 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f606ffff640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6070102ac0 0x7f60701980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6075477640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6070103480 0x7f607019f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 -- 172.21.15.42:0/3077236385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6070102ac0 msgr2=0x7f60701980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6070102ac0 0x7f60701980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 -- 172.21.15.42:0/3077236385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6070103480 msgr2=0x7f607019f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6070103480 0x7f607019f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.624+0000 7f6074c76640 1 -- 172.21.15.42:0/3077236385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607019f780 con 0x7f60700ffa50 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.625+0000 7f6074c76640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 0x7f6070197b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f606400e9c0 tx=0x7f606400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.625+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606400cde0 con 0x7f60700ffa50 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.625+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607019fa70 con 0x7f60700ffa50 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.625+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6064010930 con 0x7f60700ffa50 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.625+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064018a60 con 0x7f60700ffa50 2024-03-31T23:17:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.625+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607019ff90 con 0x7f60700ffa50 2024-03-31T23:17:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.626+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6070108bf0 con 0x7f60700ffa50 2024-03-31T23:17:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.627+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f606401f020 con 0x7f60700ffa50 2024-03-31T23:17:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.628+0000 7f606dffb640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f60600a24a0 0x7f60600a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.628+0000 7f606ffff640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f60600a24a0 0x7f60600a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.628+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f60640ced10 con 0x7f60700ffa50 2024-03-31T23:17:57.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.628+0000 7f606ffff640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f60600a24a0 0x7f60600a4960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f605c009900 tx=0x7f605c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.632+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f60640d4020 con 0x7f60700ffa50 2024-03-31T23:17:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.819+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6070062350 con 0x7f60700ffa50 2024-03-31T23:17:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.820+0000 7f606dffb640 1 -- 172.21.15.42:0/3077236385 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f606409bae0 con 0x7f60700ffa50 2024-03-31T23:17:57.821 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f60600a24a0 msgr2=0x7f60600a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f60600a24a0 0x7f60600a4960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f605c009900 tx=0x7f605c005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 msgr2=0x7f6070197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 0x7f6070197b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f606400e9c0 tx=0x7f606400ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 shutdown_connections 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6070103480 0x7f607019f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6070102ac0 0x7f60701980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f60600a24a0 0x7f60600a4960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 --2- 172.21.15.42:0/3077236385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60700ffa50 0x7f6070197b60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 >> 172.21.15.42:0/3077236385 conn(0x7f60700fb380 msgr2=0x7f6070105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 shutdown_connections 2024-03-31T23:17:57.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.822+0000 7f6076eda640 1 -- 172.21.15.42:0/3077236385 wait complete. 2024-03-31T23:17:57.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1308143093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3060864856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/250228001' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.834 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-03-31T23:17:57.834 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:17:57.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 -- 172.21.15.42:0/1888157376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580100670 msgr2=0x7f2580100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 --2- 172.21.15.42:0/1888157376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580100670 0x7f2580100a90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2578009900 tx=0x7f257802bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 -- 172.21.15.42:0/1888157376 shutdown_connections 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 --2- 172.21.15.42:0/1888157376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2580102220 0x7f2580108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 --2- 172.21.15.42:0/1888157376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2580101860 0x7f2580101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 --2- 172.21.15.42:0/1888157376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580100670 0x7f2580100a90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 -- 172.21.15.42:0/1888157376 >> 172.21.15.42:0/1888157376 conn(0x7f25800fbbe0 msgr2=0x7f25800fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 -- 172.21.15.42:0/1888157376 shutdown_connections 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.937+0000 7f258531e640 1 -- 172.21.15.42:0/1888157376 wait complete. 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 Processor -- start 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 -- start start 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2580100670 0x7f2580197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 0x7f25801980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2580102220 0x7f258019f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f258010c3d0 con 0x7f2580101860 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f258010c250 con 0x7f2580102220 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f258531e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f258010c550 con 0x7f2580100670 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f257e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 0x7f25801980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f257e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 0x7f25801980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59514/0 (socket says 172.21.15.42:59514) 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.938+0000 7f257e7fc640 1 -- 172.21.15.42:0/1467285586 learned_addr learned my addr 172.21.15.42:0/1467285586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257effd640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2580100670 0x7f2580197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257f7fe640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2580102220 0x7f258019f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257e7fc640 1 -- 172.21.15.42:0/1467285586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2580100670 msgr2=0x7f2580197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257e7fc640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2580100670 0x7f2580197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257e7fc640 1 -- 172.21.15.42:0/1467285586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2580102220 msgr2=0x7f258019f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:57.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257e7fc640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2580102220 0x7f258019f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257e7fc640 1 -- 172.21.15.42:0/1467285586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258019f780 con 0x7f2580101860 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f257e7fc640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 0x7f25801980a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f257400e9f0 tx=0x7f257400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257400cd80 con 0x7f2580101860 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2574005520 con 0x7f2580101860 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258019fa70 con 0x7f2580101860 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574010690 con 0x7f2580101860 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.939+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258019ff70 con 0x7f2580101860 2024-03-31T23:17:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.940+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25801a0200 con 0x7f2580101860 2024-03-31T23:17:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.941+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f25740046c0 con 0x7f2580101860 2024-03-31T23:17:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.942+0000 7f2567fff640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25680a24a0 0x7f25680a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.942+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f25740ceee0 con 0x7f2580101860 2024-03-31T23:17:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.942+0000 7f257effd640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25680a24a0 0x7f25680a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.942+0000 7f257effd640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25680a24a0 0x7f25680a4960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2578000c00 tx=0x7f2578005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:57.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:57.946+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f257409bd10 con 0x7f2580101860 2024-03-31T23:17:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1308143093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3060864856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/250228001' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:58.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.166+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25801a03d0 con 0x7f2580101860 2024-03-31T23:17:58.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.166+0000 7f2567fff640 1 -- 172.21.15.42:0/1467285586 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11923 (secure 0 0 0) 0x7f257409b610 con 0x7f2580101860 2024-03-31T23:17:58.167 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:58.167 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:17:54.070406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:17:58.168 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-03-31T23:17:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25680a24a0 msgr2=0x7f25680a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25680a24a0 0x7f25680a4960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2578000c00 tx=0x7f2578005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 msgr2=0x7f25801980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 0x7f25801980a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f257400e9f0 tx=0x7f257400edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 shutdown_connections 2024-03-31T23:17:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2580102220 0x7f258019f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f25680a24a0 0x7f25680a4960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2580101860 0x7f25801980a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 --2- 172.21.15.42:0/1467285586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2580100670 0x7f2580197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 >> 172.21.15.42:0/1467285586 conn(0x7f25800fbbe0 msgr2=0x7f25800fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 shutdown_connections 2024-03-31T23:17:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.168+0000 7f258531e640 1 -- 172.21.15.42:0/1467285586 wait complete. 2024-03-31T23:17:58.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1308143093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:17:58.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3060864856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:17:58.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/250228001' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:17:58.180 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-03-31T23:17:58.181 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-03-31T23:17:58.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T23:17:58.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 -- 172.21.15.42:0/4280768575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 msgr2=0x7f627c104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 --2- 172.21.15.42:0/4280768575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c104720 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f626c009900 tx=0x7f626c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:58.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 -- 172.21.15.42:0/4280768575 shutdown_connections 2024-03-31T23:17:58.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 --2- 172.21.15.42:0/4280768575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f627c107590 0x7f627c109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 --2- 172.21.15.42:0/4280768575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 0x7f627c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 --2- 172.21.15.42:0/4280768575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c104720 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 -- 172.21.15.42:0/4280768575 >> 172.21.15.42:0/4280768575 conn(0x7f627c0fbc80 msgr2=0x7f627c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 -- 172.21.15.42:0/4280768575 shutdown_connections 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 -- 172.21.15.42:0/4280768575 wait complete. 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.283+0000 7f6281b16640 1 Processor -- start 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 -- start start 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 0x7f627c1002e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f627c107590 0x7f627c100820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f627c10d4f0 con 0x7f627c102330 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f627c10d370 con 0x7f627c104c60 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6281b16640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f627c10d670 con 0x7f627c107590 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c101ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59536/0 (socket says 172.21.15.42:59536) 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 0x7f627c1002e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 -- 172.21.15.42:0/570292430 learned_addr learned my addr 172.21.15.42:0/570292430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627bfff640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f627c107590 0x7f627c100820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 -- 172.21.15.42:0/570292430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f627c107590 msgr2=0x7f627c100820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f627c107590 0x7f627c100820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 -- 172.21.15.42:0/570292430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 msgr2=0x7f627c1002e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 0x7f627c1002e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 -- 172.21.15.42:0/570292430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c1010b0 con 0x7f627c102330 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627affd640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 0x7f627c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f627b7fe640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c101ca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f626c005ab0 tx=0x7f626c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c043020 con 0x7f627c102330 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.284+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f626c004250 con 0x7f627c102330 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.285+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c1a1cb0 con 0x7f627c102330 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.285+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c003c00 con 0x7f627c102330 2024-03-31T23:17:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.285+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c1a21a0 con 0x7f627c102330 2024-03-31T23:17:58.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.286+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c0fd770 con 0x7f627c102330 2024-03-31T23:17:58.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.287+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f626c046020 con 0x7f627c102330 2024-03-31T23:17:58.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.287+0000 7f6278ff9640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62680a2520 0x7f62680a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.287+0000 7f627affd640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62680a2520 0x7f62680a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.287+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f626c0f0ee0 con 0x7f627c102330 2024-03-31T23:17:58.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.288+0000 7f627affd640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62680a2520 0x7f62680a49e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f627c101a10 tx=0x7f6264005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:58.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.291+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f626c04d020 con 0x7f627c102330 2024-03-31T23:17:58.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.469+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f627c061b90 con 0x7f62680a2520 2024-03-31T23:17:58.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.479+0000 7f6278ff9640 1 -- 172.21.15.42:0/570292430 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340829 (secure 0 0 0) 0x7f627c061b90 con 0x7f62680a2520 2024-03-31T23:17:58.484 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:58.486 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:17:58.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.482+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62680a2520 msgr2=0x7f62680a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.482+0000 7f6281b16640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62680a2520 0x7f62680a49e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f627c101a10 tx=0x7f6264005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.482+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 msgr2=0x7f627c101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.482+0000 7f6281b16640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c101ca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f626c005ab0 tx=0x7f626c004a50 comp rx=0 tx=0).stop 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 shutdown_connections 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f627c107590 0x7f627c100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627c104c60 0x7f627c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f62680a2520 0x7f62680a49e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 --2- 172.21.15.42:0/570292430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f627c102330 0x7f627c101ca0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 >> 172.21.15.42:0/570292430 conn(0x7f627c0fbc80 msgr2=0x7f627c102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 shutdown_connections 2024-03-31T23:17:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.483+0000 7f6281b16640 1 -- 172.21.15.42:0/570292430 wait complete. 2024-03-31T23:17:58.495 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-03-31T23:17:56.799571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667906,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1294,"num_read_kb":777,"num_write":441,"num_write_kb":3100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361796,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580028,"statfs":{"total":1151940427776,"available":1151569948672,"internally_reserved":0,"allocated":12890112,"data_stored":8204278,"data_compressed":431238,"data_compressed_allocated":589824,"data_compressed_original":2678784,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003198"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792007+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:17:42.792007+0000","last_peered":"2024-03-31T23:17:42.792007+0000","last_clean":"2024-03-31T23:17:42.792007+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:17:42.792007+0000","last_undegraded":"2024-03-31T23:17:42.792007+0000","last_fullsized":"2024-03-31T23:17:42.792007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791655+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:17:42.791655+0000","last_peered":"2024-03-31T23:17:42.791655+0000","last_clean":"2024-03-31T23:17:42.791655+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:17:42.791655+0000","last_undegraded":"2024-03-31T23:17:42.791655+0000","last_fullsized":"2024-03-31T23:17:42.791655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791063+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:17:42.791063+0000","last_peered":"2024-03-31T23:17:42.791063+0000","last_clean":"2024-03-31T23:17:42.791063+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:17:42.791063+0000","last_undegraded":"2024-03-31T23:17:42.791063+0000","last_fullsized":"2024-03-31T23:17:42.791063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644456+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:17:42.644456+0000","last_peered":"2024-03-31T23:17:42.644456+0000","last_clean":"2024-03-31T23:17:42.644456+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:17:42.644456+0000","last_undegraded":"2024-03-31T23:17:42.644456+0000","last_fullsized":"2024-03-31T23:17:42.644456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373753+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:17:43.373753+0000","last_peered":"2024-03-31T23:17:43.373753+0000","last_clean":"2024-03-31T23:17:43.373753+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:17:43.373753+0000","last_undegraded":"2024-03-31T23:17:43.373753+0000","last_fullsized":"2024-03-31T23:17:43.373753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790791+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:17:42.790791+0000","last_peered":"2024-03-31T23:17:42.790791+0000","last_clean":"2024-03-31T23:17:42.790791+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:17:42.790791+0000","last_undegraded":"2024-03-31T23:17:42.790791+0000","last_fullsized":"2024-03-31T23:17:42.790791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647197+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:17:42.647197+0000","last_peered":"2024-03-31T23:17:42.647197+0000","last_clean":"2024-03-31T23:17:42.647197+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:17:42.647197+0000","last_undegraded":"2024-03-31T23:17:42.647197+0000","last_fullsized":"2024-03-31T23:17:42.647197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645161+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:17:42.645161+0000","last_peered":"2024-03-31T23:17:42.645161+0000","last_clean":"2024-03-31T23:17:42.645161+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:17:42.645161+0000","last_undegraded":"2024-03-31T23:17:42.645161+0000","last_fullsized":"2024-03-31T23:17:42.645161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649316+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:17:42.649316+0000","last_peered":"2024-03-31T23:17:42.649316+0000","last_clean":"2024-03-31T23:17:42.649316+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:17:42.649316+0000","last_undegraded":"2024-03-31T23:17:42.649316+0000","last_fullsized":"2024-03-31T23:17:42.649316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791231+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:17:42.791231+0000","last_peered":"2024-03-31T23:17:42.791231+0000","last_clean":"2024-03-31T23:17:42.791231+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:17:42.791231+0000","last_undegraded":"2024-03-31T23:17:42.791231+0000","last_fullsized":"2024-03-31T23:17:42.791231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647616+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:17:42.647616+0000","last_peered":"2024-03-31T23:17:42.647616+0000","last_clean":"2024-03-31T23:17:42.647616+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:17:42.647616+0000","last_undegraded":"2024-03-31T23:17:42.647616+0000","last_fullsized":"2024-03-31T23:17:42.647616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644595+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:17:42.644595+0000","last_peered":"2024-03-31T23:17:42.644595+0000","last_clean":"2024-03-31T23:17:42.644595+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:17:42.644595+0000","last_undegraded":"2024-03-31T23:17:42.644595+0000","last_fullsized":"2024-03-31T23:17:42.644595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644187+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:17:42.644187+0000","last_peered":"2024-03-31T23:17:42.644187+0000","last_clean":"2024-03-31T23:17:42.644187+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:17:42.644187+0000","last_undegraded":"2024-03-31T23:17:42.644187+0000","last_fullsized":"2024-03-31T23:17:42.644187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790910+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:17:42.790910+0000","last_peered":"2024-03-31T23:17:42.790910+0000","last_clean":"2024-03-31T23:17:42.790910+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:17:42.790910+0000","last_undegraded":"2024-03-31T23:17:42.790910+0000","last_fullsized":"2024-03-31T23:17:42.790910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790921+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:17:42.790921+0000","last_peered":"2024-03-31T23:17:42.790921+0000","last_clean":"2024-03-31T23:17:42.790921+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:17:42.790921+0000","last_undegraded":"2024-03-31T23:17:42.790921+0000","last_fullsized":"2024-03-31T23:17:42.790921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648652+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:17:42.648652+0000","last_peered":"2024-03-31T23:17:42.648652+0000","last_clean":"2024-03-31T23:17:42.648652+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:17:42.648652+0000","last_undegraded":"2024-03-31T23:17:42.648652+0000","last_fullsized":"2024-03-31T23:17:42.648652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792004+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:17:42.792004+0000","last_peered":"2024-03-31T23:17:42.792004+0000","last_clean":"2024-03-31T23:17:42.792004+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:17:42.792004+0000","last_undegraded":"2024-03-31T23:17:42.792004+0000","last_fullsized":"2024-03-31T23:17:42.792004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792007+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:17:42.792007+0000","last_peered":"2024-03-31T23:17:42.792007+0000","last_clean":"2024-03-31T23:17:42.792007+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:17:42.792007+0000","last_undegraded":"2024-03-31T23:17:42.792007+0000","last_fullsized":"2024-03-31T23:17:42.792007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791431+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:17:42.791431+0000","last_peered":"2024-03-31T23:17:42.791431+0000","last_clean":"2024-03-31T23:17:42.791431+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:17:42.791431+0000","last_undegraded":"2024-03-31T23:17:42.791431+0000","last_fullsized":"2024-03-31T23:17:42.791431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791095+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:17:42.791095+0000","last_peered":"2024-03-31T23:17:42.791095+0000","last_clean":"2024-03-31T23:17:42.791095+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:17:42.791095+0000","last_undegraded":"2024-03-31T23:17:42.791095+0000","last_fullsized":"2024-03-31T23:17:42.791095+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"93'14","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.361487+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:17:53.361487+0000","last_peered":"2024-03-31T23:17:53.361487+0000","last_clean":"2024-03-31T23:17:53.361487+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:17:53.361487+0000","last_undegraded":"2024-03-31T23:17:53.361487+0000","last_fullsized":"2024-03-31T23:17:53.361487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645851+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:17:42.645851+0000","last_peered":"2024-03-31T23:17:42.645851+0000","last_clean":"2024-03-31T23:17:42.645851+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:17:42.645851+0000","last_undegraded":"2024-03-31T23:17:42.645851+0000","last_fullsized":"2024-03-31T23:17:42.645851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644143+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:17:42.644143+0000","last_peered":"2024-03-31T23:17:42.644143+0000","last_clean":"2024-03-31T23:17:42.644143+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:17:42.644143+0000","last_undegraded":"2024-03-31T23:17:42.644143+0000","last_fullsized":"2024-03-31T23:17:42.644143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645942+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:17:42.645942+0000","last_peered":"2024-03-31T23:17:42.645942+0000","last_clean":"2024-03-31T23:17:42.645942+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:17:42.645942+0000","last_undegraded":"2024-03-31T23:17:42.645942+0000","last_fullsized":"2024-03-31T23:17:42.645942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791841+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:17:42.791841+0000","last_peered":"2024-03-31T23:17:42.791841+0000","last_clean":"2024-03-31T23:17:42.791841+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:17:42.791841+0000","last_undegraded":"2024-03-31T23:17:42.791841+0000","last_fullsized":"2024-03-31T23:17:42.791841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644285+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:17:42.644285+0000","last_peered":"2024-03-31T23:17:42.644285+0000","last_clean":"2024-03-31T23:17:42.644285+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:17:42.644285+0000","last_undegraded":"2024-03-31T23:17:42.644285+0000","last_fullsized":"2024-03-31T23:17:42.644285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374095+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:17:43.374095+0000","last_peered":"2024-03-31T23:17:43.374095+0000","last_clean":"2024-03-31T23:17:43.374095+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:17:43.374095+0000","last_undegraded":"2024-03-31T23:17:43.374095+0000","last_fullsized":"2024-03-31T23:17:43.374095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648931+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:17:42.648931+0000","last_peered":"2024-03-31T23:17:42.648931+0000","last_clean":"2024-03-31T23:17:42.648931+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:17:42.648931+0000","last_undegraded":"2024-03-31T23:17:42.648931+0000","last_fullsized":"2024-03-31T23:17:42.648931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644073+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:17:42.644073+0000","last_peered":"2024-03-31T23:17:42.644073+0000","last_clean":"2024-03-31T23:17:42.644073+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:17:42.644073+0000","last_undegraded":"2024-03-31T23:17:42.644073+0000","last_fullsized":"2024-03-31T23:17:42.644073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373980+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:17:43.373980+0000","last_peered":"2024-03-31T23:17:43.373980+0000","last_clean":"2024-03-31T23:17:43.373980+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:17:43.373980+0000","last_undegraded":"2024-03-31T23:17:43.373980+0000","last_fullsized":"2024-03-31T23:17:43.373980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.650165+0000","last_change":"2024-03-31T23:17:42.650165+0000","last_active":"2024-03-31T23:17:42.650165+0000","last_peered":"2024-03-31T23:17:42.650165+0000","last_clean":"2024-03-31T23:17:42.650165+0000","last_became_active":"2024-03-31T23:17:42.649717+0000","last_became_peered":"2024-03-31T23:17:42.649717+0000","last_unstale":"2024-03-31T23:17:42.650165+0000","last_undegraded":"2024-03-31T23:17:42.650165+0000","last_fullsized":"2024-03-31T23:17:42.650165+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:33:29.555834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791224+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:17:42.791224+0000","last_peered":"2024-03-31T23:17:42.791224+0000","last_clean":"2024-03-31T23:17:42.791224+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:17:42.791224+0000","last_undegraded":"2024-03-31T23:17:42.791224+0000","last_fullsized":"2024-03-31T23:17:42.791224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:51.373707+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:17:51.373707+0000","last_peered":"2024-03-31T23:17:51.373707+0000","last_clean":"2024-03-31T23:17:51.373707+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:17:51.373707+0000","last_undegraded":"2024-03-31T23:17:51.373707+0000","last_fullsized":"2024-03-31T23:17:51.373707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373720+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:17:43.373720+0000","last_peered":"2024-03-31T23:17:43.373720+0000","last_clean":"2024-03-31T23:17:43.373720+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:17:43.373720+0000","last_undegraded":"2024-03-31T23:17:43.373720+0000","last_fullsized":"2024-03-31T23:17:43.373720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790931+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:17:42.790931+0000","last_peered":"2024-03-31T23:17:42.790931+0000","last_clean":"2024-03-31T23:17:42.790931+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:17:42.790931+0000","last_undegraded":"2024-03-31T23:17:42.790931+0000","last_fullsized":"2024-03-31T23:17:42.790931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790772+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:17:42.790772+0000","last_peered":"2024-03-31T23:17:42.790772+0000","last_clean":"2024-03-31T23:17:42.790772+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:17:42.790772+0000","last_undegraded":"2024-03-31T23:17:42.790772+0000","last_fullsized":"2024-03-31T23:17:42.790772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646141+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:17:42.646141+0000","last_peered":"2024-03-31T23:17:42.646141+0000","last_clean":"2024-03-31T23:17:42.646141+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:17:42.646141+0000","last_undegraded":"2024-03-31T23:17:42.646141+0000","last_fullsized":"2024-03-31T23:17:42.646141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791952+0000","last_change":"2024-03-31T23:16:42.482887+0000","last_active":"2024-03-31T23:17:42.791952+0000","last_peered":"2024-03-31T23:17:42.791952+0000","last_clean":"2024-03-31T23:17:42.791952+0000","last_became_active":"2024-03-31T23:16:42.482434+0000","last_became_peered":"2024-03-31T23:16:42.482434+0000","last_unstale":"2024-03-31T23:17:42.791952+0000","last_undegraded":"2024-03-31T23:17:42.791952+0000","last_fullsized":"2024-03-31T23:17:42.791952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:17.721985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643778+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:17:42.643778+0000","last_peered":"2024-03-31T23:17:42.643778+0000","last_clean":"2024-03-31T23:17:42.643778+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:17:42.643778+0000","last_undegraded":"2024-03-31T23:17:42.643778+0000","last_fullsized":"2024-03-31T23:17:42.643778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645041+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:17:42.645041+0000","last_peered":"2024-03-31T23:17:42.645041+0000","last_clean":"2024-03-31T23:17:42.645041+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:17:42.645041+0000","last_undegraded":"2024-03-31T23:17:42.645041+0000","last_fullsized":"2024-03-31T23:17:42.645041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791444+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:17:42.791444+0000","last_peered":"2024-03-31T23:17:42.791444+0000","last_clean":"2024-03-31T23:17:42.791444+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:17:42.791444+0000","last_undegraded":"2024-03-31T23:17:42.791444+0000","last_fullsized":"2024-03-31T23:17:42.791444+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645918+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:17:42.645918+0000","last_peered":"2024-03-31T23:17:42.645918+0000","last_clean":"2024-03-31T23:17:42.645918+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:17:42.645918+0000","last_undegraded":"2024-03-31T23:17:42.645918+0000","last_fullsized":"2024-03-31T23:17:42.645918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791577+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:17:42.791577+0000","last_peered":"2024-03-31T23:17:42.791577+0000","last_clean":"2024-03-31T23:17:42.791577+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:17:42.791577+0000","last_undegraded":"2024-03-31T23:17:42.791577+0000","last_fullsized":"2024-03-31T23:17:42.791577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645255+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:17:42.645255+0000","last_peered":"2024-03-31T23:17:42.645255+0000","last_clean":"2024-03-31T23:17:42.645255+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:17:42.645255+0000","last_undegraded":"2024-03-31T23:17:42.645255+0000","last_fullsized":"2024-03-31T23:17:42.645255+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":261,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.375159+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:17:53.375159+0000","last_peered":"2024-03-31T23:17:53.375159+0000","last_clean":"2024-03-31T23:17:53.375159+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:17:53.375159+0000","last_undegraded":"2024-03-31T23:17:53.375159+0000","last_fullsized":"2024-03-31T23:17:53.375159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649221+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:17:42.649221+0000","last_peered":"2024-03-31T23:17:42.649221+0000","last_clean":"2024-03-31T23:17:42.649221+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:17:42.649221+0000","last_undegraded":"2024-03-31T23:17:42.649221+0000","last_fullsized":"2024-03-31T23:17:42.649221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791276+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:17:42.791276+0000","last_peered":"2024-03-31T23:17:42.791276+0000","last_clean":"2024-03-31T23:17:42.791276+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:17:42.791276+0000","last_undegraded":"2024-03-31T23:17:42.791276+0000","last_fullsized":"2024-03-31T23:17:42.791276+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647748+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:17:42.647748+0000","last_peered":"2024-03-31T23:17:42.647748+0000","last_clean":"2024-03-31T23:17:42.647748+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:17:42.647748+0000","last_undegraded":"2024-03-31T23:17:42.647748+0000","last_fullsized":"2024-03-31T23:17:42.647748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792003+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:17:42.792003+0000","last_peered":"2024-03-31T23:17:42.792003+0000","last_clean":"2024-03-31T23:17:42.792003+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:17:42.792003+0000","last_undegraded":"2024-03-31T23:17:42.792003+0000","last_fullsized":"2024-03-31T23:17:42.792003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644449+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:17:42.644449+0000","last_peered":"2024-03-31T23:17:42.644449+0000","last_clean":"2024-03-31T23:17:42.644449+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:17:42.644449+0000","last_undegraded":"2024-03-31T23:17:42.644449+0000","last_fullsized":"2024-03-31T23:17:42.644449+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646383+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:17:42.646383+0000","last_peered":"2024-03-31T23:17:42.646383+0000","last_clean":"2024-03-31T23:17:42.646383+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:17:42.646383+0000","last_undegraded":"2024-03-31T23:17:42.646383+0000","last_fullsized":"2024-03-31T23:17:42.646383+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649125+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:17:42.649125+0000","last_peered":"2024-03-31T23:17:42.649125+0000","last_clean":"2024-03-31T23:17:42.649125+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:17:42.649125+0000","last_undegraded":"2024-03-31T23:17:42.649125+0000","last_fullsized":"2024-03-31T23:17:42.649125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791281+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:17:42.791281+0000","last_peered":"2024-03-31T23:17:42.791281+0000","last_clean":"2024-03-31T23:17:42.791281+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:17:42.791281+0000","last_undegraded":"2024-03-31T23:17:42.791281+0000","last_fullsized":"2024-03-31T23:17:42.791281+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'41","reported_seq":306,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.693448+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:17:53.693448+0000","last_peered":"2024-03-31T23:17:53.693448+0000","last_clean":"2024-03-31T23:17:53.693448+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:17:53.693448+0000","last_undegraded":"2024-03-31T23:17:53.693448+0000","last_fullsized":"2024-03-31T23:17:53.693448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69286,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":179,"num_write":43,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373963+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:17:43.373963+0000","last_peered":"2024-03-31T23:17:43.373963+0000","last_clean":"2024-03-31T23:17:43.373963+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:17:43.373963+0000","last_undegraded":"2024-03-31T23:17:43.373963+0000","last_fullsized":"2024-03-31T23:17:43.373963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646796+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:17:42.646796+0000","last_peered":"2024-03-31T23:17:42.646796+0000","last_clean":"2024-03-31T23:17:42.646796+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:17:42.646796+0000","last_undegraded":"2024-03-31T23:17:42.646796+0000","last_fullsized":"2024-03-31T23:17:42.646796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791094+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:17:42.791094+0000","last_peered":"2024-03-31T23:17:42.791094+0000","last_clean":"2024-03-31T23:17:42.791094+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:17:42.791094+0000","last_undegraded":"2024-03-31T23:17:42.791094+0000","last_fullsized":"2024-03-31T23:17:42.791094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643889+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:17:42.643889+0000","last_peered":"2024-03-31T23:17:42.643889+0000","last_clean":"2024-03-31T23:17:42.643889+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:17:42.643889+0000","last_undegraded":"2024-03-31T23:17:42.643889+0000","last_fullsized":"2024-03-31T23:17:42.643889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791346+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:17:42.791346+0000","last_peered":"2024-03-31T23:17:42.791346+0000","last_clean":"2024-03-31T23:17:42.791346+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:17:42.791346+0000","last_undegraded":"2024-03-31T23:17:42.791346+0000","last_fullsized":"2024-03-31T23:17:42.791346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646725+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:17:42.646725+0000","last_peered":"2024-03-31T23:17:42.646725+0000","last_clean":"2024-03-31T23:17:42.646725+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:17:42.646725+0000","last_undegraded":"2024-03-31T23:17:42.646725+0000","last_fullsized":"2024-03-31T23:17:42.646725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647620+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:17:42.647620+0000","last_peered":"2024-03-31T23:17:42.647620+0000","last_clean":"2024-03-31T23:17:42.647620+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:17:42.647620+0000","last_undegraded":"2024-03-31T23:17:42.647620+0000","last_fullsized":"2024-03-31T23:17:42.647620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791670+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:17:42.791670+0000","last_peered":"2024-03-31T23:17:42.791670+0000","last_clean":"2024-03-31T23:17:42.791670+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:17:42.791670+0000","last_undegraded":"2024-03-31T23:17:42.791670+0000","last_fullsized":"2024-03-31T23:17:42.791670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:52.382461+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:17:52.382461+0000","last_peered":"2024-03-31T23:17:52.382461+0000","last_clean":"2024-03-31T23:17:52.382461+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:17:52.382461+0000","last_undegraded":"2024-03-31T23:17:52.382461+0000","last_fullsized":"2024-03-31T23:17:52.382461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647487+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:17:42.647487+0000","last_peered":"2024-03-31T23:17:42.647487+0000","last_clean":"2024-03-31T23:17:42.647487+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:17:42.647487+0000","last_undegraded":"2024-03-31T23:17:42.647487+0000","last_fullsized":"2024-03-31T23:17:42.647487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644361+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:17:42.644361+0000","last_peered":"2024-03-31T23:17:42.644361+0000","last_clean":"2024-03-31T23:17:42.644361+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:17:42.644361+0000","last_undegraded":"2024-03-31T23:17:42.644361+0000","last_fullsized":"2024-03-31T23:17:42.644361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373550+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:17:43.373550+0000","last_peered":"2024-03-31T23:17:43.373550+0000","last_clean":"2024-03-31T23:17:43.373550+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:17:43.373550+0000","last_undegraded":"2024-03-31T23:17:43.373550+0000","last_fullsized":"2024-03-31T23:17:43.373550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791377+0000","last_change":"2024-03-31T23:16:42.520338+0000","last_active":"2024-03-31T23:17:42.791377+0000","last_peered":"2024-03-31T23:17:42.791377+0000","last_clean":"2024-03-31T23:17:42.791377+0000","last_became_active":"2024-03-31T23:16:42.519941+0000","last_became_peered":"2024-03-31T23:16:42.519941+0000","last_unstale":"2024-03-31T23:17:42.791377+0000","last_undegraded":"2024-03-31T23:17:42.791377+0000","last_fullsized":"2024-03-31T23:17:42.791377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:49:47.173204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790729+0000","last_change":"2024-03-31T23:16:42.520660+0000","last_active":"2024-03-31T23:17:42.790729+0000","last_peered":"2024-03-31T23:17:42.790729+0000","last_clean":"2024-03-31T23:17:42.790729+0000","last_became_active":"2024-03-31T23:16:42.520061+0000","last_became_peered":"2024-03-31T23:16:42.520061+0000","last_unstale":"2024-03-31T23:17:42.790729+0000","last_undegraded":"2024-03-31T23:17:42.790729+0000","last_fullsized":"2024-03-31T23:17:42.790729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:18:20.495238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791828+0000","last_change":"2024-03-31T23:16:42.486185+0000","last_active":"2024-03-31T23:17:42.791828+0000","last_peered":"2024-03-31T23:17:42.791828+0000","last_clean":"2024-03-31T23:17:42.791828+0000","last_became_active":"2024-03-31T23:16:42.480591+0000","last_became_peered":"2024-03-31T23:16:42.480591+0000","last_unstale":"2024-03-31T23:17:42.791828+0000","last_undegraded":"2024-03-31T23:17:42.791828+0000","last_fullsized":"2024-03-31T23:17:42.791828+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:01:32.270666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791853+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:17:42.791853+0000","last_peered":"2024-03-31T23:17:42.791853+0000","last_clean":"2024-03-31T23:17:42.791853+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:17:42.791853+0000","last_undegraded":"2024-03-31T23:17:42.791853+0000","last_fullsized":"2024-03-31T23:17:42.791853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373695+0000","last_change":"2024-03-31T23:16:42.520508+0000","last_active":"2024-03-31T23:17:43.373695+0000","last_peered":"2024-03-31T23:17:43.373695+0000","last_clean":"2024-03-31T23:17:43.373695+0000","last_became_active":"2024-03-31T23:16:42.520076+0000","last_became_peered":"2024-03-31T23:16:42.520076+0000","last_unstale":"2024-03-31T23:17:43.373695+0000","last_undegraded":"2024-03-31T23:17:43.373695+0000","last_fullsized":"2024-03-31T23:17:43.373695+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:32:07.192476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791702+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:17:42.791702+0000","last_peered":"2024-03-31T23:17:42.791702+0000","last_clean":"2024-03-31T23:17:42.791702+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:17:42.791702+0000","last_undegraded":"2024-03-31T23:17:42.791702+0000","last_fullsized":"2024-03-31T23:17:42.791702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791054+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:17:42.791054+0000","last_peered":"2024-03-31T23:17:42.791054+0000","last_clean":"2024-03-31T23:17:42.791054+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:17:42.791054+0000","last_undegraded":"2024-03-31T23:17:42.791054+0000","last_fullsized":"2024-03-31T23:17:42.791054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644490+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:17:42.644490+0000","last_peered":"2024-03-31T23:17:42.644490+0000","last_clean":"2024-03-31T23:17:42.644490+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:17:42.644490+0000","last_undegraded":"2024-03-31T23:17:42.644490+0000","last_fullsized":"2024-03-31T23:17:42.644490+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:51.381150+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:17:51.381150+0000","last_peered":"2024-03-31T23:17:51.381150+0000","last_clean":"2024-03-31T23:17:51.381150+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:17:51.381150+0000","last_undegraded":"2024-03-31T23:17:51.381150+0000","last_fullsized":"2024-03-31T23:17:51.381150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790917+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:17:42.790917+0000","last_peered":"2024-03-31T23:17:42.790917+0000","last_clean":"2024-03-31T23:17:42.790917+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:17:42.790917+0000","last_undegraded":"2024-03-31T23:17:42.790917+0000","last_fullsized":"2024-03-31T23:17:42.790917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644372+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:17:42.644372+0000","last_peered":"2024-03-31T23:17:42.644372+0000","last_clean":"2024-03-31T23:17:42.644372+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:17:42.644372+0000","last_undegraded":"2024-03-31T23:17:42.644372+0000","last_fullsized":"2024-03-31T23:17:42.644372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646100+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:17:42.646100+0000","last_peered":"2024-03-31T23:17:42.646100+0000","last_clean":"2024-03-31T23:17:42.646100+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:17:42.646100+0000","last_undegraded":"2024-03-31T23:17:42.646100+0000","last_fullsized":"2024-03-31T23:17:42.646100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:51.380977+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:17:51.380977+0000","last_peered":"2024-03-31T23:17:51.380977+0000","last_clean":"2024-03-31T23:17:51.380977+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:17:51.380977+0000","last_undegraded":"2024-03-31T23:17:51.380977+0000","last_fullsized":"2024-03-31T23:17:51.380977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648003+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:17:42.648003+0000","last_peered":"2024-03-31T23:17:42.648003+0000","last_clean":"2024-03-31T23:17:42.648003+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:17:42.648003+0000","last_undegraded":"2024-03-31T23:17:42.648003+0000","last_fullsized":"2024-03-31T23:17:42.648003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645220+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:17:42.645220+0000","last_peered":"2024-03-31T23:17:42.645220+0000","last_clean":"2024-03-31T23:17:42.645220+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:17:42.645220+0000","last_undegraded":"2024-03-31T23:17:42.645220+0000","last_fullsized":"2024-03-31T23:17:42.645220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644385+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:17:42.644385+0000","last_peered":"2024-03-31T23:17:42.644385+0000","last_clean":"2024-03-31T23:17:42.644385+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:17:42.644385+0000","last_undegraded":"2024-03-31T23:17:42.644385+0000","last_fullsized":"2024-03-31T23:17:42.644385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":367,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647230+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:17:42.647230+0000","last_peered":"2024-03-31T23:17:42.647230+0000","last_clean":"2024-03-31T23:17:42.647230+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:17:42.647230+0000","last_undegraded":"2024-03-31T23:17:42.647230+0000","last_fullsized":"2024-03-31T23:17:42.647230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646242+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:17:42.646242+0000","last_peered":"2024-03-31T23:17:42.646242+0000","last_clean":"2024-03-31T23:17:42.646242+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:17:42.646242+0000","last_undegraded":"2024-03-31T23:17:42.646242+0000","last_fullsized":"2024-03-31T23:17:42.646242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643534+0000","last_change":"2024-03-31T23:16:42.478674+0000","last_active":"2024-03-31T23:17:42.643534+0000","last_peered":"2024-03-31T23:17:42.643534+0000","last_clean":"2024-03-31T23:17:42.643534+0000","last_became_active":"2024-03-31T23:16:42.478317+0000","last_became_peered":"2024-03-31T23:16:42.478317+0000","last_unstale":"2024-03-31T23:17:42.643534+0000","last_undegraded":"2024-03-31T23:17:42.643534+0000","last_fullsized":"2024-03-31T23:17:42.643534+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:43.917393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647240+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:17:42.647240+0000","last_peered":"2024-03-31T23:17:42.647240+0000","last_clean":"2024-03-31T23:17:42.647240+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:17:42.647240+0000","last_undegraded":"2024-03-31T23:17:42.647240+0000","last_fullsized":"2024-03-31T23:17:42.647240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791381+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:17:42.791381+0000","last_peered":"2024-03-31T23:17:42.791381+0000","last_clean":"2024-03-31T23:17:42.791381+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:17:42.791381+0000","last_undegraded":"2024-03-31T23:17:42.791381+0000","last_fullsized":"2024-03-31T23:17:42.791381+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374029+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:17:43.374029+0000","last_peered":"2024-03-31T23:17:43.374029+0000","last_clean":"2024-03-31T23:17:43.374029+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:17:43.374029+0000","last_undegraded":"2024-03-31T23:17:43.374029+0000","last_fullsized":"2024-03-31T23:17:43.374029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644171+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:17:42.644171+0000","last_peered":"2024-03-31T23:17:42.644171+0000","last_clean":"2024-03-31T23:17:42.644171+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:17:42.644171+0000","last_undegraded":"2024-03-31T23:17:42.644171+0000","last_fullsized":"2024-03-31T23:17:42.644171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645029+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:17:42.645029+0000","last_peered":"2024-03-31T23:17:42.645029+0000","last_clean":"2024-03-31T23:17:42.645029+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:17:42.645029+0000","last_undegraded":"2024-03-31T23:17:42.645029+0000","last_fullsized":"2024-03-31T23:17:42.645029+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792071+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:17:42.792071+0000","last_peered":"2024-03-31T23:17:42.792071+0000","last_clean":"2024-03-31T23:17:42.792071+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:17:42.792071+0000","last_undegraded":"2024-03-31T23:17:42.792071+0000","last_fullsized":"2024-03-31T23:17:42.792071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645913+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:17:42.645913+0000","last_peered":"2024-03-31T23:17:42.645913+0000","last_clean":"2024-03-31T23:17:42.645913+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:17:42.645913+0000","last_undegraded":"2024-03-31T23:17:42.645913+0000","last_fullsized":"2024-03-31T23:17:42.645913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790772+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:17:42.790772+0000","last_peered":"2024-03-31T23:17:42.790772+0000","last_clean":"2024-03-31T23:17:42.790772+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:17:42.790772+0000","last_undegraded":"2024-03-31T23:17:42.790772+0000","last_fullsized":"2024-03-31T23:17:42.790772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644625+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:17:42.644625+0000","last_peered":"2024-03-31T23:17:42.644625+0000","last_clean":"2024-03-31T23:17:42.644625+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:17:42.644625+0000","last_undegraded":"2024-03-31T23:17:42.644625+0000","last_fullsized":"2024-03-31T23:17:42.644625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791595+0000","last_change":"2024-03-31T23:16:42.479778+0000","last_active":"2024-03-31T23:17:42.791595+0000","last_peered":"2024-03-31T23:17:42.791595+0000","last_clean":"2024-03-31T23:17:42.791595+0000","last_became_active":"2024-03-31T23:16:42.479401+0000","last_became_peered":"2024-03-31T23:16:42.479401+0000","last_unstale":"2024-03-31T23:17:42.791595+0000","last_undegraded":"2024-03-31T23:17:42.791595+0000","last_fullsized":"2024-03-31T23:17:42.791595+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:01:58.138818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644321+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:17:42.644321+0000","last_peered":"2024-03-31T23:17:42.644321+0000","last_clean":"2024-03-31T23:17:42.644321+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:17:42.644321+0000","last_undegraded":"2024-03-31T23:17:42.644321+0000","last_fullsized":"2024-03-31T23:17:42.644321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648541+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:17:42.648541+0000","last_peered":"2024-03-31T23:17:42.648541+0000","last_clean":"2024-03-31T23:17:42.648541+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:17:42.648541+0000","last_undegraded":"2024-03-31T23:17:42.648541+0000","last_fullsized":"2024-03-31T23:17:42.648541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373522+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:17:43.373522+0000","last_peered":"2024-03-31T23:17:43.373522+0000","last_clean":"2024-03-31T23:17:43.373522+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:17:43.373522+0000","last_undegraded":"2024-03-31T23:17:43.373522+0000","last_fullsized":"2024-03-31T23:17:43.373522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374228+0000","last_change":"2024-03-31T23:16:42.483336+0000","last_active":"2024-03-31T23:17:43.374228+0000","last_peered":"2024-03-31T23:17:43.374228+0000","last_clean":"2024-03-31T23:17:43.374228+0000","last_became_active":"2024-03-31T23:16:42.482909+0000","last_became_peered":"2024-03-31T23:16:42.482909+0000","last_unstale":"2024-03-31T23:17:43.374228+0000","last_undegraded":"2024-03-31T23:17:43.374228+0000","last_fullsized":"2024-03-31T23:17:43.374228+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:38:02.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645179+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:17:42.645179+0000","last_peered":"2024-03-31T23:17:42.645179+0000","last_clean":"2024-03-31T23:17:42.645179+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:17:42.645179+0000","last_undegraded":"2024-03-31T23:17:42.645179+0000","last_fullsized":"2024-03-31T23:17:42.645179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790666+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:17:42.790666+0000","last_peered":"2024-03-31T23:17:42.790666+0000","last_clean":"2024-03-31T23:17:42.790666+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:17:42.790666+0000","last_undegraded":"2024-03-31T23:17:42.790666+0000","last_fullsized":"2024-03-31T23:17:42.790666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644223+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:17:42.644223+0000","last_peered":"2024-03-31T23:17:42.644223+0000","last_clean":"2024-03-31T23:17:42.644223+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:17:42.644223+0000","last_undegraded":"2024-03-31T23:17:42.644223+0000","last_fullsized":"2024-03-31T23:17:42.644223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790630+0000","last_change":"2024-03-31T23:16:42.489599+0000","last_active":"2024-03-31T23:17:42.790630+0000","last_peered":"2024-03-31T23:17:42.790630+0000","last_clean":"2024-03-31T23:17:42.790630+0000","last_became_active":"2024-03-31T23:16:42.483090+0000","last_became_peered":"2024-03-31T23:16:42.483090+0000","last_unstale":"2024-03-31T23:17:42.790630+0000","last_undegraded":"2024-03-31T23:17:42.790630+0000","last_fullsized":"2024-03-31T23:17:42.790630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:31:32.544161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645995+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:17:42.645995+0000","last_peered":"2024-03-31T23:17:42.645995+0000","last_clean":"2024-03-31T23:17:42.645995+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:17:42.645995+0000","last_undegraded":"2024-03-31T23:17:42.645995+0000","last_fullsized":"2024-03-31T23:17:42.645995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644229+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:17:42.644229+0000","last_peered":"2024-03-31T23:17:42.644229+0000","last_clean":"2024-03-31T23:17:42.644229+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:17:42.644229+0000","last_undegraded":"2024-03-31T23:17:42.644229+0000","last_fullsized":"2024-03-31T23:17:42.644229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373779+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:17:43.373779+0000","last_peered":"2024-03-31T23:17:43.373779+0000","last_clean":"2024-03-31T23:17:43.373779+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:17:43.373779+0000","last_undegraded":"2024-03-31T23:17:43.373779+0000","last_fullsized":"2024-03-31T23:17:43.373779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647593+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:17:42.647593+0000","last_peered":"2024-03-31T23:17:42.647593+0000","last_clean":"2024-03-31T23:17:42.647593+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:17:42.647593+0000","last_undegraded":"2024-03-31T23:17:42.647593+0000","last_fullsized":"2024-03-31T23:17:42.647593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648943+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:17:42.648943+0000","last_peered":"2024-03-31T23:17:42.648943+0000","last_clean":"2024-03-31T23:17:42.648943+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:17:42.648943+0000","last_undegraded":"2024-03-31T23:17:42.648943+0000","last_fullsized":"2024-03-31T23:17:42.648943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'7","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.383753+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:17:53.383753+0000","last_peered":"2024-03-31T23:17:53.383753+0000","last_clean":"2024-03-31T23:17:53.383753+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:17:53.383753+0000","last_undegraded":"2024-03-31T23:17:53.383753+0000","last_fullsized":"2024-03-31T23:17:53.383753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647801+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:17:42.647801+0000","last_peered":"2024-03-31T23:17:42.647801+0000","last_clean":"2024-03-31T23:17:42.647801+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:17:42.647801+0000","last_undegraded":"2024-03-31T23:17:42.647801+0000","last_fullsized":"2024-03-31T23:17:42.647801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790881+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:17:42.790881+0000","last_peered":"2024-03-31T23:17:42.790881+0000","last_clean":"2024-03-31T23:17:42.790881+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:17:42.790881+0000","last_undegraded":"2024-03-31T23:17:42.790881+0000","last_fullsized":"2024-03-31T23:17:42.790881+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646717+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:17:42.646717+0000","last_peered":"2024-03-31T23:17:42.646717+0000","last_clean":"2024-03-31T23:17:42.646717+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:17:42.646717+0000","last_undegraded":"2024-03-31T23:17:42.646717+0000","last_fullsized":"2024-03-31T23:17:42.646717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.793479+0000","last_change":"2024-03-31T23:17:42.793114+0000","last_active":"2024-03-31T23:17:42.793479+0000","last_peered":"2024-03-31T23:17:42.793479+0000","last_clean":"2024-03-31T23:17:42.793479+0000","last_became_active":"2024-03-31T23:17:42.792584+0000","last_became_peered":"2024-03-31T23:17:42.792584+0000","last_unstale":"2024-03-31T23:17:42.793479+0000","last_undegraded":"2024-03-31T23:17:42.793479+0000","last_fullsized":"2024-03-31T23:17:42.793479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:55:22.779316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645834+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:17:42.645834+0000","last_peered":"2024-03-31T23:17:42.645834+0000","last_clean":"2024-03-31T23:17:42.645834+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:17:42.645834+0000","last_undegraded":"2024-03-31T23:17:42.645834+0000","last_fullsized":"2024-03-31T23:17:42.645834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644349+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:17:42.644349+0000","last_peered":"2024-03-31T23:17:42.644349+0000","last_clean":"2024-03-31T23:17:42.644349+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:17:42.644349+0000","last_undegraded":"2024-03-31T23:17:42.644349+0000","last_fullsized":"2024-03-31T23:17:42.644349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647903+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:17:42.647903+0000","last_peered":"2024-03-31T23:17:42.647903+0000","last_clean":"2024-03-31T23:17:42.647903+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:17:42.647903+0000","last_undegraded":"2024-03-31T23:17:42.647903+0000","last_fullsized":"2024-03-31T23:17:42.647903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790673+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:17:42.790673+0000","last_peered":"2024-03-31T23:17:42.790673+0000","last_clean":"2024-03-31T23:17:42.790673+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:17:42.790673+0000","last_undegraded":"2024-03-31T23:17:42.790673+0000","last_fullsized":"2024-03-31T23:17:42.790673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791180+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:17:42.791180+0000","last_peered":"2024-03-31T23:17:42.791180+0000","last_clean":"2024-03-31T23:17:42.791180+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:17:42.791180+0000","last_undegraded":"2024-03-31T23:17:42.791180+0000","last_fullsized":"2024-03-31T23:17:42.791180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790746+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:17:42.790746+0000","last_peered":"2024-03-31T23:17:42.790746+0000","last_clean":"2024-03-31T23:17:42.790746+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:17:42.790746+0000","last_undegraded":"2024-03-31T23:17:42.790746+0000","last_fullsized":"2024-03-31T23:17:42.790746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791088+0000","last_change":"2024-03-31T23:16:42.480375+0000","last_active":"2024-03-31T23:17:42.791088+0000","last_peered":"2024-03-31T23:17:42.791088+0000","last_clean":"2024-03-31T23:17:42.791088+0000","last_became_active":"2024-03-31T23:16:42.480005+0000","last_became_peered":"2024-03-31T23:16:42.480005+0000","last_unstale":"2024-03-31T23:17:42.791088+0000","last_undegraded":"2024-03-31T23:17:42.791088+0000","last_fullsized":"2024-03-31T23:17:42.791088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:31:15.217708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644114+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:17:42.644114+0000","last_peered":"2024-03-31T23:17:42.644114+0000","last_clean":"2024-03-31T23:17:42.644114+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:17:42.644114+0000","last_undegraded":"2024-03-31T23:17:42.644114+0000","last_fullsized":"2024-03-31T23:17:42.644114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791722+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:17:42.791722+0000","last_peered":"2024-03-31T23:17:42.791722+0000","last_clean":"2024-03-31T23:17:42.791722+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:17:42.791722+0000","last_undegraded":"2024-03-31T23:17:42.791722+0000","last_fullsized":"2024-03-31T23:17:42.791722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791259+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:17:42.791259+0000","last_peered":"2024-03-31T23:17:42.791259+0000","last_clean":"2024-03-31T23:17:42.791259+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:17:42.791259+0000","last_undegraded":"2024-03-31T23:17:42.791259+0000","last_fullsized":"2024-03-31T23:17:42.791259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646100+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:17:42.646100+0000","last_peered":"2024-03-31T23:17:42.646100+0000","last_clean":"2024-03-31T23:17:42.646100+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:17:42.646100+0000","last_undegraded":"2024-03-31T23:17:42.646100+0000","last_fullsized":"2024-03-31T23:17:42.646100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646019+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:17:42.646019+0000","last_peered":"2024-03-31T23:17:42.646019+0000","last_clean":"2024-03-31T23:17:42.646019+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:17:42.646019+0000","last_undegraded":"2024-03-31T23:17:42.646019+0000","last_fullsized":"2024-03-31T23:17:42.646019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645158+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:17:42.645158+0000","last_peered":"2024-03-31T23:17:42.645158+0000","last_clean":"2024-03-31T23:17:42.645158+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:17:42.645158+0000","last_undegraded":"2024-03-31T23:17:42.645158+0000","last_fullsized":"2024-03-31T23:17:42.645158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648905+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:17:42.648905+0000","last_peered":"2024-03-31T23:17:42.648905+0000","last_clean":"2024-03-31T23:17:42.648905+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:17:42.648905+0000","last_undegraded":"2024-03-31T23:17:42.648905+0000","last_fullsized":"2024-03-31T23:17:42.648905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644318+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:17:42.644318+0000","last_peered":"2024-03-31T23:17:42.644318+0000","last_clean":"2024-03-31T23:17:42.644318+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:17:42.644318+0000","last_undegraded":"2024-03-31T23:17:42.644318+0000","last_fullsized":"2024-03-31T23:17:42.644318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791498+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:17:42.791498+0000","last_peered":"2024-03-31T23:17:42.791498+0000","last_clean":"2024-03-31T23:17:42.791498+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:17:42.791498+0000","last_undegraded":"2024-03-31T23:17:42.791498+0000","last_fullsized":"2024-03-31T23:17:42.791498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77304,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1158,"num_read_kb":658,"num_write":258,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":232220,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":520753,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1171460,"data_compressed":64039,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":524225,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070520,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":520485,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":1117677,"data_compressed":62432,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495683,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":515633,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":586257,"data_compressed":28176,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":517621,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":581860,"data_compressed":28176,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":515341,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":520239,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":1112727,"data_compressed":62432,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71346,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72322,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":71554,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:17:58.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T23:17:58.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 -- 172.21.15.42:0/1839528002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1006f0 msgr2=0x7ffbdc100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/1839528002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1006f0 0x7ffbdc100b10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009900 tx=0x7ffbd802bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:58.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 -- 172.21.15.42:0/1839528002 shutdown_connections 2024-03-31T23:17:58.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/1839528002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/1839528002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbdc1018e0 0x7ffbdc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/1839528002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1006f0 0x7ffbdc100b10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 -- 172.21.15.42:0/1839528002 >> 172.21.15.42:0/1839528002 conn(0x7ffbdc0fbc60 msgr2=0x7ffbdc0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 -- 172.21.15.42:0/1839528002 shutdown_connections 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.637+0000 7ffbe35b5640 1 -- 172.21.15.42:0/1839528002 wait complete. 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 Processor -- start 2024-03-31T23:17:58.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 -- start start 2024-03-31T23:17:58.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbdc1006f0 0x7ffbdc197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbdc1018e0 0x7ffbdc198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc10c3d0 con 0x7ffbdc1022a0 2024-03-31T23:17:58.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc10c250 con 0x7ffbdc1006f0 2024-03-31T23:17:58.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe35b5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc10c550 con 0x7ffbdc1018e0 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc19f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59550/0 (socket says 172.21.15.42:59550) 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 -- 172.21.15.42:0/175970203 learned_addr learned my addr 172.21.15.42:0/175970203 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1351640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbdc1006f0 0x7ffbdc197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe0b50640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbdc1018e0 0x7ffbdc198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 -- 172.21.15.42:0/175970203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbdc1018e0 msgr2=0x7ffbdc198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbdc1018e0 0x7ffbdc198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 -- 172.21.15.42:0/175970203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbdc1006f0 msgr2=0x7ffbdc197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbdc1006f0 0x7ffbdc197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.638+0000 7ffbe1b52640 1 -- 172.21.15.42:0/175970203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc19f850 con 0x7ffbdc1022a0 2024-03-31T23:17:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.639+0000 7ffbe1b52640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc19f1b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400efd0 tx=0x7ffbd400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.639+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4003b70 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.639+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffbd4003d10 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.639+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc19fb40 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.639+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4010a90 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.639+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc1a0060 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.640+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc1a0290 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.641+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7ffbd4004020 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.641+0000 7ffbce7fc640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffbc80a2520 0x7ffbc80a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.641+0000 7ffbe1351640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffbc80a2520 0x7ffbc80a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.641+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7ffbd40ceed0 con 0x7ffbdc1022a0 2024-03-31T23:17:58.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.642+0000 7ffbe1351640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffbc80a2520 0x7ffbc80a49e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8005ab0 tx=0x7ffbd8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:58.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.646+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ffbd409bd00 con 0x7ffbdc1022a0 2024-03-31T23:17:58.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:58 smithi042 ceph-mon[32380]: pgmap v361: 129 pgs: 129 active+clean; 652 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-31T23:17:58.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:58 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3077236385' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:58.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:58 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1467285586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:58.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.827+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbdc1a0460 con 0x7ffbc80a2520 2024-03-31T23:17:58.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.836+0000 7ffbce7fc640 1 -- 172.21.15.42:0/175970203 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340829 (secure 0 0 0) 0x7ffbdc1a0460 con 0x7ffbc80a2520 2024-03-31T23:17:58.840 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffbc80a2520 msgr2=0x7ffbc80a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffbc80a2520 0x7ffbc80a49e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8005ab0 tx=0x7ffbd8005fd0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 msgr2=0x7ffbdc19f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc19f1b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400efd0 tx=0x7ffbd400c6a0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 shutdown_connections 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7ffbc80a2520 0x7ffbc80a49e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbdc1022a0 0x7ffbdc19f1b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbdc1018e0 0x7ffbdc198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 --2- 172.21.15.42:0/175970203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbdc1006f0 0x7ffbdc197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 >> 172.21.15.42:0/175970203 conn(0x7ffbdc0fbc60 msgr2=0x7ffbdc0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 shutdown_connections 2024-03-31T23:17:58.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.839+0000 7ffbe35b5640 1 -- 172.21.15.42:0/175970203 wait complete. 2024-03-31T23:17:58.851 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-03-31T23:17:58.799960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668214,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":788,"num_write":444,"num_write_kb":3102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361780,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580044,"statfs":{"total":1151940427776,"available":1151569965056,"internally_reserved":0,"allocated":12890112,"data_stored":8204894,"data_compressed":431238,"data_compressed_allocated":589824,"data_compressed_original":2678784,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":62,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792007+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:17:42.792007+0000","last_peered":"2024-03-31T23:17:42.792007+0000","last_clean":"2024-03-31T23:17:42.792007+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:17:42.792007+0000","last_undegraded":"2024-03-31T23:17:42.792007+0000","last_fullsized":"2024-03-31T23:17:42.792007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791655+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:17:42.791655+0000","last_peered":"2024-03-31T23:17:42.791655+0000","last_clean":"2024-03-31T23:17:42.791655+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:17:42.791655+0000","last_undegraded":"2024-03-31T23:17:42.791655+0000","last_fullsized":"2024-03-31T23:17:42.791655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791063+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:17:42.791063+0000","last_peered":"2024-03-31T23:17:42.791063+0000","last_clean":"2024-03-31T23:17:42.791063+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:17:42.791063+0000","last_undegraded":"2024-03-31T23:17:42.791063+0000","last_fullsized":"2024-03-31T23:17:42.791063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644456+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:17:42.644456+0000","last_peered":"2024-03-31T23:17:42.644456+0000","last_clean":"2024-03-31T23:17:42.644456+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:17:42.644456+0000","last_undegraded":"2024-03-31T23:17:42.644456+0000","last_fullsized":"2024-03-31T23:17:42.644456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373753+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:17:43.373753+0000","last_peered":"2024-03-31T23:17:43.373753+0000","last_clean":"2024-03-31T23:17:43.373753+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:17:43.373753+0000","last_undegraded":"2024-03-31T23:17:43.373753+0000","last_fullsized":"2024-03-31T23:17:43.373753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790791+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:17:42.790791+0000","last_peered":"2024-03-31T23:17:42.790791+0000","last_clean":"2024-03-31T23:17:42.790791+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:17:42.790791+0000","last_undegraded":"2024-03-31T23:17:42.790791+0000","last_fullsized":"2024-03-31T23:17:42.790791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647197+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:17:42.647197+0000","last_peered":"2024-03-31T23:17:42.647197+0000","last_clean":"2024-03-31T23:17:42.647197+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:17:42.647197+0000","last_undegraded":"2024-03-31T23:17:42.647197+0000","last_fullsized":"2024-03-31T23:17:42.647197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645161+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:17:42.645161+0000","last_peered":"2024-03-31T23:17:42.645161+0000","last_clean":"2024-03-31T23:17:42.645161+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:17:42.645161+0000","last_undegraded":"2024-03-31T23:17:42.645161+0000","last_fullsized":"2024-03-31T23:17:42.645161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649316+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:17:42.649316+0000","last_peered":"2024-03-31T23:17:42.649316+0000","last_clean":"2024-03-31T23:17:42.649316+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:17:42.649316+0000","last_undegraded":"2024-03-31T23:17:42.649316+0000","last_fullsized":"2024-03-31T23:17:42.649316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791231+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:17:42.791231+0000","last_peered":"2024-03-31T23:17:42.791231+0000","last_clean":"2024-03-31T23:17:42.791231+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:17:42.791231+0000","last_undegraded":"2024-03-31T23:17:42.791231+0000","last_fullsized":"2024-03-31T23:17:42.791231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647681+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:17:42.647681+0000","last_peered":"2024-03-31T23:17:42.647681+0000","last_clean":"2024-03-31T23:17:42.647681+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:17:42.647681+0000","last_undegraded":"2024-03-31T23:17:42.647681+0000","last_fullsized":"2024-03-31T23:17:42.647681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644642+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:17:42.644642+0000","last_peered":"2024-03-31T23:17:42.644642+0000","last_clean":"2024-03-31T23:17:42.644642+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:17:42.644642+0000","last_undegraded":"2024-03-31T23:17:42.644642+0000","last_fullsized":"2024-03-31T23:17:42.644642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644243+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:17:42.644243+0000","last_peered":"2024-03-31T23:17:42.644243+0000","last_clean":"2024-03-31T23:17:42.644243+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:17:42.644243+0000","last_undegraded":"2024-03-31T23:17:42.644243+0000","last_fullsized":"2024-03-31T23:17:42.644243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790910+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:17:42.790910+0000","last_peered":"2024-03-31T23:17:42.790910+0000","last_clean":"2024-03-31T23:17:42.790910+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:17:42.790910+0000","last_undegraded":"2024-03-31T23:17:42.790910+0000","last_fullsized":"2024-03-31T23:17:42.790910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790921+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:17:42.790921+0000","last_peered":"2024-03-31T23:17:42.790921+0000","last_clean":"2024-03-31T23:17:42.790921+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:17:42.790921+0000","last_undegraded":"2024-03-31T23:17:42.790921+0000","last_fullsized":"2024-03-31T23:17:42.790921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648652+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:17:42.648652+0000","last_peered":"2024-03-31T23:17:42.648652+0000","last_clean":"2024-03-31T23:17:42.648652+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:17:42.648652+0000","last_undegraded":"2024-03-31T23:17:42.648652+0000","last_fullsized":"2024-03-31T23:17:42.648652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792004+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:17:42.792004+0000","last_peered":"2024-03-31T23:17:42.792004+0000","last_clean":"2024-03-31T23:17:42.792004+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:17:42.792004+0000","last_undegraded":"2024-03-31T23:17:42.792004+0000","last_fullsized":"2024-03-31T23:17:42.792004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792007+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:17:42.792007+0000","last_peered":"2024-03-31T23:17:42.792007+0000","last_clean":"2024-03-31T23:17:42.792007+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:17:42.792007+0000","last_undegraded":"2024-03-31T23:17:42.792007+0000","last_fullsized":"2024-03-31T23:17:42.792007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791431+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:17:42.791431+0000","last_peered":"2024-03-31T23:17:42.791431+0000","last_clean":"2024-03-31T23:17:42.791431+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:17:42.791431+0000","last_undegraded":"2024-03-31T23:17:42.791431+0000","last_fullsized":"2024-03-31T23:17:42.791431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791095+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:17:42.791095+0000","last_peered":"2024-03-31T23:17:42.791095+0000","last_clean":"2024-03-31T23:17:42.791095+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:17:42.791095+0000","last_undegraded":"2024-03-31T23:17:42.791095+0000","last_fullsized":"2024-03-31T23:17:42.791095+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"93'14","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:57.387567+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:17:57.387567+0000","last_peered":"2024-03-31T23:17:57.387567+0000","last_clean":"2024-03-31T23:17:57.387567+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:17:57.387567+0000","last_undegraded":"2024-03-31T23:17:57.387567+0000","last_fullsized":"2024-03-31T23:17:57.387567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645851+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:17:42.645851+0000","last_peered":"2024-03-31T23:17:42.645851+0000","last_clean":"2024-03-31T23:17:42.645851+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:17:42.645851+0000","last_undegraded":"2024-03-31T23:17:42.645851+0000","last_fullsized":"2024-03-31T23:17:42.645851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644143+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:17:42.644143+0000","last_peered":"2024-03-31T23:17:42.644143+0000","last_clean":"2024-03-31T23:17:42.644143+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:17:42.644143+0000","last_undegraded":"2024-03-31T23:17:42.644143+0000","last_fullsized":"2024-03-31T23:17:42.644143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645942+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:17:42.645942+0000","last_peered":"2024-03-31T23:17:42.645942+0000","last_clean":"2024-03-31T23:17:42.645942+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:17:42.645942+0000","last_undegraded":"2024-03-31T23:17:42.645942+0000","last_fullsized":"2024-03-31T23:17:42.645942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791841+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:17:42.791841+0000","last_peered":"2024-03-31T23:17:42.791841+0000","last_clean":"2024-03-31T23:17:42.791841+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:17:42.791841+0000","last_undegraded":"2024-03-31T23:17:42.791841+0000","last_fullsized":"2024-03-31T23:17:42.791841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644285+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:17:42.644285+0000","last_peered":"2024-03-31T23:17:42.644285+0000","last_clean":"2024-03-31T23:17:42.644285+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:17:42.644285+0000","last_undegraded":"2024-03-31T23:17:42.644285+0000","last_fullsized":"2024-03-31T23:17:42.644285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374095+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:17:43.374095+0000","last_peered":"2024-03-31T23:17:43.374095+0000","last_clean":"2024-03-31T23:17:43.374095+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:17:43.374095+0000","last_undegraded":"2024-03-31T23:17:43.374095+0000","last_fullsized":"2024-03-31T23:17:43.374095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648931+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:17:42.648931+0000","last_peered":"2024-03-31T23:17:42.648931+0000","last_clean":"2024-03-31T23:17:42.648931+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:17:42.648931+0000","last_undegraded":"2024-03-31T23:17:42.648931+0000","last_fullsized":"2024-03-31T23:17:42.648931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644073+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:17:42.644073+0000","last_peered":"2024-03-31T23:17:42.644073+0000","last_clean":"2024-03-31T23:17:42.644073+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:17:42.644073+0000","last_undegraded":"2024-03-31T23:17:42.644073+0000","last_fullsized":"2024-03-31T23:17:42.644073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373980+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:17:43.373980+0000","last_peered":"2024-03-31T23:17:43.373980+0000","last_clean":"2024-03-31T23:17:43.373980+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:17:43.373980+0000","last_undegraded":"2024-03-31T23:17:43.373980+0000","last_fullsized":"2024-03-31T23:17:43.373980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.650165+0000","last_change":"2024-03-31T23:17:42.650165+0000","last_active":"2024-03-31T23:17:42.650165+0000","last_peered":"2024-03-31T23:17:42.650165+0000","last_clean":"2024-03-31T23:17:42.650165+0000","last_became_active":"2024-03-31T23:17:42.649717+0000","last_became_peered":"2024-03-31T23:17:42.649717+0000","last_unstale":"2024-03-31T23:17:42.650165+0000","last_undegraded":"2024-03-31T23:17:42.650165+0000","last_fullsized":"2024-03-31T23:17:42.650165+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:33:29.555834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791224+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:17:42.791224+0000","last_peered":"2024-03-31T23:17:42.791224+0000","last_clean":"2024-03-31T23:17:42.791224+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:17:42.791224+0000","last_undegraded":"2024-03-31T23:17:42.791224+0000","last_fullsized":"2024-03-31T23:17:42.791224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.378864+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:17:56.378864+0000","last_peered":"2024-03-31T23:17:56.378864+0000","last_clean":"2024-03-31T23:17:56.378864+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:17:56.378864+0000","last_undegraded":"2024-03-31T23:17:56.378864+0000","last_fullsized":"2024-03-31T23:17:56.378864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373720+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:17:43.373720+0000","last_peered":"2024-03-31T23:17:43.373720+0000","last_clean":"2024-03-31T23:17:43.373720+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:17:43.373720+0000","last_undegraded":"2024-03-31T23:17:43.373720+0000","last_fullsized":"2024-03-31T23:17:43.373720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790931+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:17:42.790931+0000","last_peered":"2024-03-31T23:17:42.790931+0000","last_clean":"2024-03-31T23:17:42.790931+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:17:42.790931+0000","last_undegraded":"2024-03-31T23:17:42.790931+0000","last_fullsized":"2024-03-31T23:17:42.790931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790772+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:17:42.790772+0000","last_peered":"2024-03-31T23:17:42.790772+0000","last_clean":"2024-03-31T23:17:42.790772+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:17:42.790772+0000","last_undegraded":"2024-03-31T23:17:42.790772+0000","last_fullsized":"2024-03-31T23:17:42.790772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646141+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:17:42.646141+0000","last_peered":"2024-03-31T23:17:42.646141+0000","last_clean":"2024-03-31T23:17:42.646141+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:17:42.646141+0000","last_undegraded":"2024-03-31T23:17:42.646141+0000","last_fullsized":"2024-03-31T23:17:42.646141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791952+0000","last_change":"2024-03-31T23:16:42.482887+0000","last_active":"2024-03-31T23:17:42.791952+0000","last_peered":"2024-03-31T23:17:42.791952+0000","last_clean":"2024-03-31T23:17:42.791952+0000","last_became_active":"2024-03-31T23:16:42.482434+0000","last_became_peered":"2024-03-31T23:16:42.482434+0000","last_unstale":"2024-03-31T23:17:42.791952+0000","last_undegraded":"2024-03-31T23:17:42.791952+0000","last_fullsized":"2024-03-31T23:17:42.791952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:17.721985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643849+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:17:42.643849+0000","last_peered":"2024-03-31T23:17:42.643849+0000","last_clean":"2024-03-31T23:17:42.643849+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:17:42.643849+0000","last_undegraded":"2024-03-31T23:17:42.643849+0000","last_fullsized":"2024-03-31T23:17:42.643849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645096+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:17:42.645096+0000","last_peered":"2024-03-31T23:17:42.645096+0000","last_clean":"2024-03-31T23:17:42.645096+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:17:42.645096+0000","last_undegraded":"2024-03-31T23:17:42.645096+0000","last_fullsized":"2024-03-31T23:17:42.645096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791444+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:17:42.791444+0000","last_peered":"2024-03-31T23:17:42.791444+0000","last_clean":"2024-03-31T23:17:42.791444+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:17:42.791444+0000","last_undegraded":"2024-03-31T23:17:42.791444+0000","last_fullsized":"2024-03-31T23:17:42.791444+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646012+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:17:42.646012+0000","last_peered":"2024-03-31T23:17:42.646012+0000","last_clean":"2024-03-31T23:17:42.646012+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:17:42.646012+0000","last_undegraded":"2024-03-31T23:17:42.646012+0000","last_fullsized":"2024-03-31T23:17:42.646012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791632+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:17:42.791632+0000","last_peered":"2024-03-31T23:17:42.791632+0000","last_clean":"2024-03-31T23:17:42.791632+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:17:42.791632+0000","last_undegraded":"2024-03-31T23:17:42.791632+0000","last_fullsized":"2024-03-31T23:17:42.791632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645308+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:17:42.645308+0000","last_peered":"2024-03-31T23:17:42.645308+0000","last_clean":"2024-03-31T23:17:42.645308+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:17:42.645308+0000","last_undegraded":"2024-03-31T23:17:42.645308+0000","last_fullsized":"2024-03-31T23:17:42.645308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":261,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.375159+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:17:53.375159+0000","last_peered":"2024-03-31T23:17:53.375159+0000","last_clean":"2024-03-31T23:17:53.375159+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:17:53.375159+0000","last_undegraded":"2024-03-31T23:17:53.375159+0000","last_fullsized":"2024-03-31T23:17:53.375159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649221+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:17:42.649221+0000","last_peered":"2024-03-31T23:17:42.649221+0000","last_clean":"2024-03-31T23:17:42.649221+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:17:42.649221+0000","last_undegraded":"2024-03-31T23:17:42.649221+0000","last_fullsized":"2024-03-31T23:17:42.649221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791336+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:17:42.791336+0000","last_peered":"2024-03-31T23:17:42.791336+0000","last_clean":"2024-03-31T23:17:42.791336+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:17:42.791336+0000","last_undegraded":"2024-03-31T23:17:42.791336+0000","last_fullsized":"2024-03-31T23:17:42.791336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647777+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:17:42.647777+0000","last_peered":"2024-03-31T23:17:42.647777+0000","last_clean":"2024-03-31T23:17:42.647777+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:17:42.647777+0000","last_undegraded":"2024-03-31T23:17:42.647777+0000","last_fullsized":"2024-03-31T23:17:42.647777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792041+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:17:42.792041+0000","last_peered":"2024-03-31T23:17:42.792041+0000","last_clean":"2024-03-31T23:17:42.792041+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:17:42.792041+0000","last_undegraded":"2024-03-31T23:17:42.792041+0000","last_fullsized":"2024-03-31T23:17:42.792041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644494+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:17:42.644494+0000","last_peered":"2024-03-31T23:17:42.644494+0000","last_clean":"2024-03-31T23:17:42.644494+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:17:42.644494+0000","last_undegraded":"2024-03-31T23:17:42.644494+0000","last_fullsized":"2024-03-31T23:17:42.644494+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646433+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:17:42.646433+0000","last_peered":"2024-03-31T23:17:42.646433+0000","last_clean":"2024-03-31T23:17:42.646433+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:17:42.646433+0000","last_undegraded":"2024-03-31T23:17:42.646433+0000","last_fullsized":"2024-03-31T23:17:42.646433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649125+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:17:42.649125+0000","last_peered":"2024-03-31T23:17:42.649125+0000","last_clean":"2024-03-31T23:17:42.649125+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:17:42.649125+0000","last_undegraded":"2024-03-31T23:17:42.649125+0000","last_fullsized":"2024-03-31T23:17:42.649125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791336+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:17:42.791336+0000","last_peered":"2024-03-31T23:17:42.791336+0000","last_clean":"2024-03-31T23:17:42.791336+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:17:42.791336+0000","last_undegraded":"2024-03-31T23:17:42.791336+0000","last_fullsized":"2024-03-31T23:17:42.791336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'41","reported_seq":306,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.693448+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:17:53.693448+0000","last_peered":"2024-03-31T23:17:53.693448+0000","last_clean":"2024-03-31T23:17:53.693448+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:17:53.693448+0000","last_undegraded":"2024-03-31T23:17:53.693448+0000","last_fullsized":"2024-03-31T23:17:53.693448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69286,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":179,"num_write":43,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374011+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:17:43.374011+0000","last_peered":"2024-03-31T23:17:43.374011+0000","last_clean":"2024-03-31T23:17:43.374011+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:17:43.374011+0000","last_undegraded":"2024-03-31T23:17:43.374011+0000","last_fullsized":"2024-03-31T23:17:43.374011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646796+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:17:42.646796+0000","last_peered":"2024-03-31T23:17:42.646796+0000","last_clean":"2024-03-31T23:17:42.646796+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:17:42.646796+0000","last_undegraded":"2024-03-31T23:17:42.646796+0000","last_fullsized":"2024-03-31T23:17:42.646796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791094+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:17:42.791094+0000","last_peered":"2024-03-31T23:17:42.791094+0000","last_clean":"2024-03-31T23:17:42.791094+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:17:42.791094+0000","last_undegraded":"2024-03-31T23:17:42.791094+0000","last_fullsized":"2024-03-31T23:17:42.791094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643889+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:17:42.643889+0000","last_peered":"2024-03-31T23:17:42.643889+0000","last_clean":"2024-03-31T23:17:42.643889+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:17:42.643889+0000","last_undegraded":"2024-03-31T23:17:42.643889+0000","last_fullsized":"2024-03-31T23:17:42.643889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791346+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:17:42.791346+0000","last_peered":"2024-03-31T23:17:42.791346+0000","last_clean":"2024-03-31T23:17:42.791346+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:17:42.791346+0000","last_undegraded":"2024-03-31T23:17:42.791346+0000","last_fullsized":"2024-03-31T23:17:42.791346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646725+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:17:42.646725+0000","last_peered":"2024-03-31T23:17:42.646725+0000","last_clean":"2024-03-31T23:17:42.646725+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:17:42.646725+0000","last_undegraded":"2024-03-31T23:17:42.646725+0000","last_fullsized":"2024-03-31T23:17:42.646725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647620+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:17:42.647620+0000","last_peered":"2024-03-31T23:17:42.647620+0000","last_clean":"2024-03-31T23:17:42.647620+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:17:42.647620+0000","last_undegraded":"2024-03-31T23:17:42.647620+0000","last_fullsized":"2024-03-31T23:17:42.647620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791670+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:17:42.791670+0000","last_peered":"2024-03-31T23:17:42.791670+0000","last_clean":"2024-03-31T23:17:42.791670+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:17:42.791670+0000","last_undegraded":"2024-03-31T23:17:42.791670+0000","last_fullsized":"2024-03-31T23:17:42.791670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.387169+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:17:56.387169+0000","last_peered":"2024-03-31T23:17:56.387169+0000","last_clean":"2024-03-31T23:17:56.387169+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:17:56.387169+0000","last_undegraded":"2024-03-31T23:17:56.387169+0000","last_fullsized":"2024-03-31T23:17:56.387169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647487+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:17:42.647487+0000","last_peered":"2024-03-31T23:17:42.647487+0000","last_clean":"2024-03-31T23:17:42.647487+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:17:42.647487+0000","last_undegraded":"2024-03-31T23:17:42.647487+0000","last_fullsized":"2024-03-31T23:17:42.647487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644361+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:17:42.644361+0000","last_peered":"2024-03-31T23:17:42.644361+0000","last_clean":"2024-03-31T23:17:42.644361+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:17:42.644361+0000","last_undegraded":"2024-03-31T23:17:42.644361+0000","last_fullsized":"2024-03-31T23:17:42.644361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373550+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:17:43.373550+0000","last_peered":"2024-03-31T23:17:43.373550+0000","last_clean":"2024-03-31T23:17:43.373550+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:17:43.373550+0000","last_undegraded":"2024-03-31T23:17:43.373550+0000","last_fullsized":"2024-03-31T23:17:43.373550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791377+0000","last_change":"2024-03-31T23:16:42.520338+0000","last_active":"2024-03-31T23:17:42.791377+0000","last_peered":"2024-03-31T23:17:42.791377+0000","last_clean":"2024-03-31T23:17:42.791377+0000","last_became_active":"2024-03-31T23:16:42.519941+0000","last_became_peered":"2024-03-31T23:16:42.519941+0000","last_unstale":"2024-03-31T23:17:42.791377+0000","last_undegraded":"2024-03-31T23:17:42.791377+0000","last_fullsized":"2024-03-31T23:17:42.791377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:49:47.173204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790729+0000","last_change":"2024-03-31T23:16:42.520660+0000","last_active":"2024-03-31T23:17:42.790729+0000","last_peered":"2024-03-31T23:17:42.790729+0000","last_clean":"2024-03-31T23:17:42.790729+0000","last_became_active":"2024-03-31T23:16:42.520061+0000","last_became_peered":"2024-03-31T23:16:42.520061+0000","last_unstale":"2024-03-31T23:17:42.790729+0000","last_undegraded":"2024-03-31T23:17:42.790729+0000","last_fullsized":"2024-03-31T23:17:42.790729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:18:20.495238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791828+0000","last_change":"2024-03-31T23:16:42.486185+0000","last_active":"2024-03-31T23:17:42.791828+0000","last_peered":"2024-03-31T23:17:42.791828+0000","last_clean":"2024-03-31T23:17:42.791828+0000","last_became_active":"2024-03-31T23:16:42.480591+0000","last_became_peered":"2024-03-31T23:16:42.480591+0000","last_unstale":"2024-03-31T23:17:42.791828+0000","last_undegraded":"2024-03-31T23:17:42.791828+0000","last_fullsized":"2024-03-31T23:17:42.791828+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:01:32.270666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791853+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:17:42.791853+0000","last_peered":"2024-03-31T23:17:42.791853+0000","last_clean":"2024-03-31T23:17:42.791853+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:17:42.791853+0000","last_undegraded":"2024-03-31T23:17:42.791853+0000","last_fullsized":"2024-03-31T23:17:42.791853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373695+0000","last_change":"2024-03-31T23:16:42.520508+0000","last_active":"2024-03-31T23:17:43.373695+0000","last_peered":"2024-03-31T23:17:43.373695+0000","last_clean":"2024-03-31T23:17:43.373695+0000","last_became_active":"2024-03-31T23:16:42.520076+0000","last_became_peered":"2024-03-31T23:16:42.520076+0000","last_unstale":"2024-03-31T23:17:43.373695+0000","last_undegraded":"2024-03-31T23:17:43.373695+0000","last_fullsized":"2024-03-31T23:17:43.373695+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:32:07.192476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791702+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:17:42.791702+0000","last_peered":"2024-03-31T23:17:42.791702+0000","last_clean":"2024-03-31T23:17:42.791702+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:17:42.791702+0000","last_undegraded":"2024-03-31T23:17:42.791702+0000","last_fullsized":"2024-03-31T23:17:42.791702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791054+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:17:42.791054+0000","last_peered":"2024-03-31T23:17:42.791054+0000","last_clean":"2024-03-31T23:17:42.791054+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:17:42.791054+0000","last_undegraded":"2024-03-31T23:17:42.791054+0000","last_fullsized":"2024-03-31T23:17:42.791054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644490+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:17:42.644490+0000","last_peered":"2024-03-31T23:17:42.644490+0000","last_clean":"2024-03-31T23:17:42.644490+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:17:42.644490+0000","last_undegraded":"2024-03-31T23:17:42.644490+0000","last_fullsized":"2024-03-31T23:17:42.644490+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.386900+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:17:56.386900+0000","last_peered":"2024-03-31T23:17:56.386900+0000","last_clean":"2024-03-31T23:17:56.386900+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:17:56.386900+0000","last_undegraded":"2024-03-31T23:17:56.386900+0000","last_fullsized":"2024-03-31T23:17:56.386900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790917+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:17:42.790917+0000","last_peered":"2024-03-31T23:17:42.790917+0000","last_clean":"2024-03-31T23:17:42.790917+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:17:42.790917+0000","last_undegraded":"2024-03-31T23:17:42.790917+0000","last_fullsized":"2024-03-31T23:17:42.790917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644372+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:17:42.644372+0000","last_peered":"2024-03-31T23:17:42.644372+0000","last_clean":"2024-03-31T23:17:42.644372+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:17:42.644372+0000","last_undegraded":"2024-03-31T23:17:42.644372+0000","last_fullsized":"2024-03-31T23:17:42.644372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646100+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:17:42.646100+0000","last_peered":"2024-03-31T23:17:42.646100+0000","last_clean":"2024-03-31T23:17:42.646100+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:17:42.646100+0000","last_undegraded":"2024-03-31T23:17:42.646100+0000","last_fullsized":"2024-03-31T23:17:42.646100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.386607+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:17:56.386607+0000","last_peered":"2024-03-31T23:17:56.386607+0000","last_clean":"2024-03-31T23:17:56.386607+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:17:56.386607+0000","last_undegraded":"2024-03-31T23:17:56.386607+0000","last_fullsized":"2024-03-31T23:17:56.386607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648003+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:17:42.648003+0000","last_peered":"2024-03-31T23:17:42.648003+0000","last_clean":"2024-03-31T23:17:42.648003+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:17:42.648003+0000","last_undegraded":"2024-03-31T23:17:42.648003+0000","last_fullsized":"2024-03-31T23:17:42.648003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645220+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:17:42.645220+0000","last_peered":"2024-03-31T23:17:42.645220+0000","last_clean":"2024-03-31T23:17:42.645220+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:17:42.645220+0000","last_undegraded":"2024-03-31T23:17:42.645220+0000","last_fullsized":"2024-03-31T23:17:42.645220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644385+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:17:42.644385+0000","last_peered":"2024-03-31T23:17:42.644385+0000","last_clean":"2024-03-31T23:17:42.644385+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:17:42.644385+0000","last_undegraded":"2024-03-31T23:17:42.644385+0000","last_fullsized":"2024-03-31T23:17:42.644385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":367,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647230+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:17:42.647230+0000","last_peered":"2024-03-31T23:17:42.647230+0000","last_clean":"2024-03-31T23:17:42.647230+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:17:42.647230+0000","last_undegraded":"2024-03-31T23:17:42.647230+0000","last_fullsized":"2024-03-31T23:17:42.647230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646242+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:17:42.646242+0000","last_peered":"2024-03-31T23:17:42.646242+0000","last_clean":"2024-03-31T23:17:42.646242+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:17:42.646242+0000","last_undegraded":"2024-03-31T23:17:42.646242+0000","last_fullsized":"2024-03-31T23:17:42.646242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643534+0000","last_change":"2024-03-31T23:16:42.478674+0000","last_active":"2024-03-31T23:17:42.643534+0000","last_peered":"2024-03-31T23:17:42.643534+0000","last_clean":"2024-03-31T23:17:42.643534+0000","last_became_active":"2024-03-31T23:16:42.478317+0000","last_became_peered":"2024-03-31T23:16:42.478317+0000","last_unstale":"2024-03-31T23:17:42.643534+0000","last_undegraded":"2024-03-31T23:17:42.643534+0000","last_fullsized":"2024-03-31T23:17:42.643534+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:43.917393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647240+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:17:42.647240+0000","last_peered":"2024-03-31T23:17:42.647240+0000","last_clean":"2024-03-31T23:17:42.647240+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:17:42.647240+0000","last_undegraded":"2024-03-31T23:17:42.647240+0000","last_fullsized":"2024-03-31T23:17:42.647240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791381+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:17:42.791381+0000","last_peered":"2024-03-31T23:17:42.791381+0000","last_clean":"2024-03-31T23:17:42.791381+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:17:42.791381+0000","last_undegraded":"2024-03-31T23:17:42.791381+0000","last_fullsized":"2024-03-31T23:17:42.791381+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374029+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:17:43.374029+0000","last_peered":"2024-03-31T23:17:43.374029+0000","last_clean":"2024-03-31T23:17:43.374029+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:17:43.374029+0000","last_undegraded":"2024-03-31T23:17:43.374029+0000","last_fullsized":"2024-03-31T23:17:43.374029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644171+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:17:42.644171+0000","last_peered":"2024-03-31T23:17:42.644171+0000","last_clean":"2024-03-31T23:17:42.644171+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:17:42.644171+0000","last_undegraded":"2024-03-31T23:17:42.644171+0000","last_fullsized":"2024-03-31T23:17:42.644171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645029+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:17:42.645029+0000","last_peered":"2024-03-31T23:17:42.645029+0000","last_clean":"2024-03-31T23:17:42.645029+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:17:42.645029+0000","last_undegraded":"2024-03-31T23:17:42.645029+0000","last_fullsized":"2024-03-31T23:17:42.645029+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.600500+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:17:43.600500+0000","last_peered":"2024-03-31T23:17:43.600500+0000","last_clean":"2024-03-31T23:17:43.600500+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:17:43.600500+0000","last_undegraded":"2024-03-31T23:17:43.600500+0000","last_fullsized":"2024-03-31T23:17:43.600500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645913+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:17:42.645913+0000","last_peered":"2024-03-31T23:17:42.645913+0000","last_clean":"2024-03-31T23:17:42.645913+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:17:42.645913+0000","last_undegraded":"2024-03-31T23:17:42.645913+0000","last_fullsized":"2024-03-31T23:17:42.645913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790772+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:17:42.790772+0000","last_peered":"2024-03-31T23:17:42.790772+0000","last_clean":"2024-03-31T23:17:42.790772+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:17:42.790772+0000","last_undegraded":"2024-03-31T23:17:42.790772+0000","last_fullsized":"2024-03-31T23:17:42.790772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644625+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:17:42.644625+0000","last_peered":"2024-03-31T23:17:42.644625+0000","last_clean":"2024-03-31T23:17:42.644625+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:17:42.644625+0000","last_undegraded":"2024-03-31T23:17:42.644625+0000","last_fullsized":"2024-03-31T23:17:42.644625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791595+0000","last_change":"2024-03-31T23:16:42.479778+0000","last_active":"2024-03-31T23:17:42.791595+0000","last_peered":"2024-03-31T23:17:42.791595+0000","last_clean":"2024-03-31T23:17:42.791595+0000","last_became_active":"2024-03-31T23:16:42.479401+0000","last_became_peered":"2024-03-31T23:16:42.479401+0000","last_unstale":"2024-03-31T23:17:42.791595+0000","last_undegraded":"2024-03-31T23:17:42.791595+0000","last_fullsized":"2024-03-31T23:17:42.791595+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:01:58.138818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644321+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:17:42.644321+0000","last_peered":"2024-03-31T23:17:42.644321+0000","last_clean":"2024-03-31T23:17:42.644321+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:17:42.644321+0000","last_undegraded":"2024-03-31T23:17:42.644321+0000","last_fullsized":"2024-03-31T23:17:42.644321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648541+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:17:42.648541+0000","last_peered":"2024-03-31T23:17:42.648541+0000","last_clean":"2024-03-31T23:17:42.648541+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:17:42.648541+0000","last_undegraded":"2024-03-31T23:17:42.648541+0000","last_fullsized":"2024-03-31T23:17:42.648541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373522+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:17:43.373522+0000","last_peered":"2024-03-31T23:17:43.373522+0000","last_clean":"2024-03-31T23:17:43.373522+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:17:43.373522+0000","last_undegraded":"2024-03-31T23:17:43.373522+0000","last_fullsized":"2024-03-31T23:17:43.373522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374228+0000","last_change":"2024-03-31T23:16:42.483336+0000","last_active":"2024-03-31T23:17:43.374228+0000","last_peered":"2024-03-31T23:17:43.374228+0000","last_clean":"2024-03-31T23:17:43.374228+0000","last_became_active":"2024-03-31T23:16:42.482909+0000","last_became_peered":"2024-03-31T23:16:42.482909+0000","last_unstale":"2024-03-31T23:17:43.374228+0000","last_undegraded":"2024-03-31T23:17:43.374228+0000","last_fullsized":"2024-03-31T23:17:43.374228+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:38:02.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645179+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:17:42.645179+0000","last_peered":"2024-03-31T23:17:42.645179+0000","last_clean":"2024-03-31T23:17:42.645179+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:17:42.645179+0000","last_undegraded":"2024-03-31T23:17:42.645179+0000","last_fullsized":"2024-03-31T23:17:42.645179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790666+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:17:42.790666+0000","last_peered":"2024-03-31T23:17:42.790666+0000","last_clean":"2024-03-31T23:17:42.790666+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:17:42.790666+0000","last_undegraded":"2024-03-31T23:17:42.790666+0000","last_fullsized":"2024-03-31T23:17:42.790666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644223+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:17:42.644223+0000","last_peered":"2024-03-31T23:17:42.644223+0000","last_clean":"2024-03-31T23:17:42.644223+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:17:42.644223+0000","last_undegraded":"2024-03-31T23:17:42.644223+0000","last_fullsized":"2024-03-31T23:17:42.644223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790630+0000","last_change":"2024-03-31T23:16:42.489599+0000","last_active":"2024-03-31T23:17:42.790630+0000","last_peered":"2024-03-31T23:17:42.790630+0000","last_clean":"2024-03-31T23:17:42.790630+0000","last_became_active":"2024-03-31T23:16:42.483090+0000","last_became_peered":"2024-03-31T23:16:42.483090+0000","last_unstale":"2024-03-31T23:17:42.790630+0000","last_undegraded":"2024-03-31T23:17:42.790630+0000","last_fullsized":"2024-03-31T23:17:42.790630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:31:32.544161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645995+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:17:42.645995+0000","last_peered":"2024-03-31T23:17:42.645995+0000","last_clean":"2024-03-31T23:17:42.645995+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:17:42.645995+0000","last_undegraded":"2024-03-31T23:17:42.645995+0000","last_fullsized":"2024-03-31T23:17:42.645995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644229+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:17:42.644229+0000","last_peered":"2024-03-31T23:17:42.644229+0000","last_clean":"2024-03-31T23:17:42.644229+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:17:42.644229+0000","last_undegraded":"2024-03-31T23:17:42.644229+0000","last_fullsized":"2024-03-31T23:17:42.644229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373779+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:17:43.373779+0000","last_peered":"2024-03-31T23:17:43.373779+0000","last_clean":"2024-03-31T23:17:43.373779+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:17:43.373779+0000","last_undegraded":"2024-03-31T23:17:43.373779+0000","last_fullsized":"2024-03-31T23:17:43.373779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647593+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:17:42.647593+0000","last_peered":"2024-03-31T23:17:42.647593+0000","last_clean":"2024-03-31T23:17:42.647593+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:17:42.647593+0000","last_undegraded":"2024-03-31T23:17:42.647593+0000","last_fullsized":"2024-03-31T23:17:42.647593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648943+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:17:42.648943+0000","last_peered":"2024-03-31T23:17:42.648943+0000","last_clean":"2024-03-31T23:17:42.648943+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:17:42.648943+0000","last_undegraded":"2024-03-31T23:17:42.648943+0000","last_fullsized":"2024-03-31T23:17:42.648943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'7","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.383753+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:17:53.383753+0000","last_peered":"2024-03-31T23:17:53.383753+0000","last_clean":"2024-03-31T23:17:53.383753+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:17:53.383753+0000","last_undegraded":"2024-03-31T23:17:53.383753+0000","last_fullsized":"2024-03-31T23:17:53.383753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647801+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:17:42.647801+0000","last_peered":"2024-03-31T23:17:42.647801+0000","last_clean":"2024-03-31T23:17:42.647801+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:17:42.647801+0000","last_undegraded":"2024-03-31T23:17:42.647801+0000","last_fullsized":"2024-03-31T23:17:42.647801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790881+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:17:42.790881+0000","last_peered":"2024-03-31T23:17:42.790881+0000","last_clean":"2024-03-31T23:17:42.790881+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:17:42.790881+0000","last_undegraded":"2024-03-31T23:17:42.790881+0000","last_fullsized":"2024-03-31T23:17:42.790881+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646717+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:17:42.646717+0000","last_peered":"2024-03-31T23:17:42.646717+0000","last_clean":"2024-03-31T23:17:42.646717+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:17:42.646717+0000","last_undegraded":"2024-03-31T23:17:42.646717+0000","last_fullsized":"2024-03-31T23:17:42.646717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.793479+0000","last_change":"2024-03-31T23:17:42.793114+0000","last_active":"2024-03-31T23:17:42.793479+0000","last_peered":"2024-03-31T23:17:42.793479+0000","last_clean":"2024-03-31T23:17:42.793479+0000","last_became_active":"2024-03-31T23:17:42.792584+0000","last_became_peered":"2024-03-31T23:17:42.792584+0000","last_unstale":"2024-03-31T23:17:42.793479+0000","last_undegraded":"2024-03-31T23:17:42.793479+0000","last_fullsized":"2024-03-31T23:17:42.793479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:55:22.779316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645834+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:17:42.645834+0000","last_peered":"2024-03-31T23:17:42.645834+0000","last_clean":"2024-03-31T23:17:42.645834+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:17:42.645834+0000","last_undegraded":"2024-03-31T23:17:42.645834+0000","last_fullsized":"2024-03-31T23:17:42.645834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644349+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:17:42.644349+0000","last_peered":"2024-03-31T23:17:42.644349+0000","last_clean":"2024-03-31T23:17:42.644349+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:17:42.644349+0000","last_undegraded":"2024-03-31T23:17:42.644349+0000","last_fullsized":"2024-03-31T23:17:42.644349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647903+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:17:42.647903+0000","last_peered":"2024-03-31T23:17:42.647903+0000","last_clean":"2024-03-31T23:17:42.647903+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:17:42.647903+0000","last_undegraded":"2024-03-31T23:17:42.647903+0000","last_fullsized":"2024-03-31T23:17:42.647903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790673+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:17:42.790673+0000","last_peered":"2024-03-31T23:17:42.790673+0000","last_clean":"2024-03-31T23:17:42.790673+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:17:42.790673+0000","last_undegraded":"2024-03-31T23:17:42.790673+0000","last_fullsized":"2024-03-31T23:17:42.790673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791180+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:17:42.791180+0000","last_peered":"2024-03-31T23:17:42.791180+0000","last_clean":"2024-03-31T23:17:42.791180+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:17:42.791180+0000","last_undegraded":"2024-03-31T23:17:42.791180+0000","last_fullsized":"2024-03-31T23:17:42.791180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790746+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:17:42.790746+0000","last_peered":"2024-03-31T23:17:42.790746+0000","last_clean":"2024-03-31T23:17:42.790746+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:17:42.790746+0000","last_undegraded":"2024-03-31T23:17:42.790746+0000","last_fullsized":"2024-03-31T23:17:42.790746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791088+0000","last_change":"2024-03-31T23:16:42.480375+0000","last_active":"2024-03-31T23:17:42.791088+0000","last_peered":"2024-03-31T23:17:42.791088+0000","last_clean":"2024-03-31T23:17:42.791088+0000","last_became_active":"2024-03-31T23:16:42.480005+0000","last_became_peered":"2024-03-31T23:16:42.480005+0000","last_unstale":"2024-03-31T23:17:42.791088+0000","last_undegraded":"2024-03-31T23:17:42.791088+0000","last_fullsized":"2024-03-31T23:17:42.791088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:31:15.217708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644114+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:17:42.644114+0000","last_peered":"2024-03-31T23:17:42.644114+0000","last_clean":"2024-03-31T23:17:42.644114+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:17:42.644114+0000","last_undegraded":"2024-03-31T23:17:42.644114+0000","last_fullsized":"2024-03-31T23:17:42.644114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791722+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:17:42.791722+0000","last_peered":"2024-03-31T23:17:42.791722+0000","last_clean":"2024-03-31T23:17:42.791722+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:17:42.791722+0000","last_undegraded":"2024-03-31T23:17:42.791722+0000","last_fullsized":"2024-03-31T23:17:42.791722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791259+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:17:42.791259+0000","last_peered":"2024-03-31T23:17:42.791259+0000","last_clean":"2024-03-31T23:17:42.791259+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:17:42.791259+0000","last_undegraded":"2024-03-31T23:17:42.791259+0000","last_fullsized":"2024-03-31T23:17:42.791259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646100+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:17:42.646100+0000","last_peered":"2024-03-31T23:17:42.646100+0000","last_clean":"2024-03-31T23:17:42.646100+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:17:42.646100+0000","last_undegraded":"2024-03-31T23:17:42.646100+0000","last_fullsized":"2024-03-31T23:17:42.646100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646019+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:17:42.646019+0000","last_peered":"2024-03-31T23:17:42.646019+0000","last_clean":"2024-03-31T23:17:42.646019+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:17:42.646019+0000","last_undegraded":"2024-03-31T23:17:42.646019+0000","last_fullsized":"2024-03-31T23:17:42.646019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645158+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:17:42.645158+0000","last_peered":"2024-03-31T23:17:42.645158+0000","last_clean":"2024-03-31T23:17:42.645158+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:17:42.645158+0000","last_undegraded":"2024-03-31T23:17:42.645158+0000","last_fullsized":"2024-03-31T23:17:42.645158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648905+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:17:42.648905+0000","last_peered":"2024-03-31T23:17:42.648905+0000","last_clean":"2024-03-31T23:17:42.648905+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:17:42.648905+0000","last_undegraded":"2024-03-31T23:17:42.648905+0000","last_fullsized":"2024-03-31T23:17:42.648905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644318+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:17:42.644318+0000","last_peered":"2024-03-31T23:17:42.644318+0000","last_clean":"2024-03-31T23:17:42.644318+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:17:42.644318+0000","last_undegraded":"2024-03-31T23:17:42.644318+0000","last_fullsized":"2024-03-31T23:17:42.644318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791498+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:17:42.791498+0000","last_peered":"2024-03-31T23:17:42.791498+0000","last_clean":"2024-03-31T23:17:42.791498+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:17:42.791498+0000","last_undegraded":"2024-03-31T23:17:42.791498+0000","last_fullsized":"2024-03-31T23:17:42.791498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77612,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1184,"num_read_kb":669,"num_write":261,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":232836,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":520753,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1171460,"data_compressed":64039,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":524225,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":520485,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1101824,"data_stored":1117985,"data_compressed":62432,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":515941,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":586257,"data_compressed":28176,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":517621,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":581860,"data_compressed":28176,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":515341,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":520239,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":1112727,"data_compressed":62432,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71346,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72322,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":71554,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:17:58.856 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-03-31T23:17:58.857 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T23:17:58.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:58 smithi188 ceph-mon[36068]: pgmap v361: 129 pgs: 129 active+clean; 652 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-31T23:17:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:58 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3077236385' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:58.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:58 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1467285586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:58.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 -- 172.21.15.42:0/1637490156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8102220 msgr2=0x7f53d8108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- 172.21.15.42:0/1637490156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8102220 0x7f53d8108ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009ca0 tx=0x7f53d002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 -- 172.21.15.42:0/1637490156 shutdown_connections 2024-03-31T23:17:58.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- 172.21.15.42:0/1637490156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8102220 0x7f53d8108ab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- 172.21.15.42:0/1637490156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d8101860 0x7f53d8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- 172.21.15.42:0/1637490156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53d8100670 0x7f53d8100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 -- 172.21.15.42:0/1637490156 >> 172.21.15.42:0/1637490156 conn(0x7f53d80fbbe0 msgr2=0x7f53d80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 -- 172.21.15.42:0/1637490156 shutdown_connections 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 -- 172.21.15.42:0/1637490156 wait complete. 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 Processor -- start 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 -- start start 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d8100670 0x7f53d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 0x7f53d819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.994+0000 7f53e0276640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53d8102220 0x7f53d819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:58.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53e0276640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53d810c420 con 0x7f53d8101860 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53e0276640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53d810c2a0 con 0x7f53d8102220 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53e0276640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53d810c5a0 con 0x7f53d8100670 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 0x7f53d819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 0x7f53d819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59572/0 (socket says 172.21.15.42:59572) 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 -- 172.21.15.42:0/820216971 learned_addr learned my addr 172.21.15.42:0/820216971 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53de813640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53d8102220 0x7f53d819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53de012640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d8100670 0x7f53d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 -- 172.21.15.42:0/820216971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d8100670 msgr2=0x7f53d8069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d8100670 0x7f53d8069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 -- 172.21.15.42:0/820216971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53d8102220 msgr2=0x7f53d819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53d8102220 0x7f53d819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:58.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 -- 172.21.15.42:0/820216971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d819f730 con 0x7f53d8101860 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53dd811640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 0x7f53d819c800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e9f0 tx=0x7f53c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c800cd80 con 0x7f53d8101860 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53c8005520 con 0x7f53d8101860 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d819f9c0 con 0x7f53d8101860 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8010690 con 0x7f53d8101860 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.995+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d819ff10 con 0x7f53d8101860 2024-03-31T23:17:59.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.996+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d81078c0 con 0x7f53d8101860 2024-03-31T23:17:59.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.997+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f53c80046c0 con 0x7f53d8101860 2024-03-31T23:17:59.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.998+0000 7f53cf7fe640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f53c40a2520 0x7f53c40a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.998+0000 7f53de012640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f53c40a2520 0x7f53c40a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.998+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f53c80ceeb0 con 0x7f53d8101860 2024-03-31T23:17:59.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:58.998+0000 7f53de012640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f53c40a2520 0x7f53c40a49e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f53d81016c0 tx=0x7f53d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:59.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.002+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f53c809bc80 con 0x7f53d8101860 2024-03-31T23:17:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:58 smithi094 ceph-mon[36167]: pgmap v361: 129 pgs: 129 active+clean; 652 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-31T23:17:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:58 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3077236385' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:17:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:58 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1467285586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:17:59.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.182+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53d8061b90 con 0x7f53c40a2520 2024-03-31T23:17:59.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.191+0000 7f53cf7fe640 1 -- 172.21.15.42:0/820216971 <== mgr.14152 v2:172.21.15.42:6800/2637331812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340829 (secure 0 0 0) 0x7f53d8061b90 con 0x7f53c40a2520 2024-03-31T23:17:59.196 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:59.197 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f53c40a2520 msgr2=0x7f53c40a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f53c40a2520 0x7f53c40a49e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f53d81016c0 tx=0x7f53d4005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 msgr2=0x7f53d819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 0x7f53d819c800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e9f0 tx=0x7f53c800edf0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 shutdown_connections 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53d8102220 0x7f53d819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f53c40a2520 0x7f53c40a49e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53d8101860 0x7f53d819c800 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 --2- 172.21.15.42:0/820216971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d8100670 0x7f53d8069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 >> 172.21.15.42:0/820216971 conn(0x7f53d80fbbe0 msgr2=0x7f53d8104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:59.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 shutdown_connections 2024-03-31T23:17:59.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.195+0000 7f53e0276640 1 -- 172.21.15.42:0/820216971 wait complete. 2024-03-31T23:17:59.206 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-03-31T23:17:58.799960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668214,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":788,"num_write":444,"num_write_kb":3102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361780,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580044,"statfs":{"total":1151940427776,"available":1151569965056,"internally_reserved":0,"allocated":12890112,"data_stored":8204894,"data_compressed":431238,"data_compressed_allocated":589824,"data_compressed_original":2678784,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":62,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792007+0000","last_change":"2024-03-31T23:15:33.848188+0000","last_active":"2024-03-31T23:17:42.792007+0000","last_peered":"2024-03-31T23:17:42.792007+0000","last_clean":"2024-03-31T23:17:42.792007+0000","last_became_active":"2024-03-31T23:15:33.847799+0000","last_became_peered":"2024-03-31T23:15:33.847799+0000","last_unstale":"2024-03-31T23:17:42.792007+0000","last_undegraded":"2024-03-31T23:17:42.792007+0000","last_fullsized":"2024-03-31T23:17:42.792007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:29.397819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791655+0000","last_change":"2024-03-31T23:15:33.839146+0000","last_active":"2024-03-31T23:17:42.791655+0000","last_peered":"2024-03-31T23:17:42.791655+0000","last_clean":"2024-03-31T23:17:42.791655+0000","last_became_active":"2024-03-31T23:15:33.837907+0000","last_became_peered":"2024-03-31T23:15:33.837907+0000","last_unstale":"2024-03-31T23:17:42.791655+0000","last_undegraded":"2024-03-31T23:17:42.791655+0000","last_fullsized":"2024-03-31T23:17:42.791655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:30.521035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791063+0000","last_change":"2024-03-31T23:15:33.845375+0000","last_active":"2024-03-31T23:17:42.791063+0000","last_peered":"2024-03-31T23:17:42.791063+0000","last_clean":"2024-03-31T23:17:42.791063+0000","last_became_active":"2024-03-31T23:15:33.844658+0000","last_became_peered":"2024-03-31T23:15:33.844658+0000","last_unstale":"2024-03-31T23:17:42.791063+0000","last_undegraded":"2024-03-31T23:17:42.791063+0000","last_fullsized":"2024-03-31T23:17:42.791063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:15.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644456+0000","last_change":"2024-03-31T23:15:33.846417+0000","last_active":"2024-03-31T23:17:42.644456+0000","last_peered":"2024-03-31T23:17:42.644456+0000","last_clean":"2024-03-31T23:17:42.644456+0000","last_became_active":"2024-03-31T23:15:33.845872+0000","last_became_peered":"2024-03-31T23:15:33.845872+0000","last_unstale":"2024-03-31T23:17:42.644456+0000","last_undegraded":"2024-03-31T23:17:42.644456+0000","last_fullsized":"2024-03-31T23:17:42.644456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:39.293239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373753+0000","last_change":"2024-03-31T23:15:33.842812+0000","last_active":"2024-03-31T23:17:43.373753+0000","last_peered":"2024-03-31T23:17:43.373753+0000","last_clean":"2024-03-31T23:17:43.373753+0000","last_became_active":"2024-03-31T23:15:33.842402+0000","last_became_peered":"2024-03-31T23:15:33.842402+0000","last_unstale":"2024-03-31T23:17:43.373753+0000","last_undegraded":"2024-03-31T23:17:43.373753+0000","last_fullsized":"2024-03-31T23:17:43.373753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:41:02.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790791+0000","last_change":"2024-03-31T23:15:33.838402+0000","last_active":"2024-03-31T23:17:42.790791+0000","last_peered":"2024-03-31T23:17:42.790791+0000","last_clean":"2024-03-31T23:17:42.790791+0000","last_became_active":"2024-03-31T23:15:33.837844+0000","last_became_peered":"2024-03-31T23:15:33.837844+0000","last_unstale":"2024-03-31T23:17:42.790791+0000","last_undegraded":"2024-03-31T23:17:42.790791+0000","last_fullsized":"2024-03-31T23:17:42.790791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:45.670082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647197+0000","last_change":"2024-03-31T23:15:33.840094+0000","last_active":"2024-03-31T23:17:42.647197+0000","last_peered":"2024-03-31T23:17:42.647197+0000","last_clean":"2024-03-31T23:17:42.647197+0000","last_became_active":"2024-03-31T23:15:33.839723+0000","last_became_peered":"2024-03-31T23:15:33.839723+0000","last_unstale":"2024-03-31T23:17:42.647197+0000","last_undegraded":"2024-03-31T23:17:42.647197+0000","last_fullsized":"2024-03-31T23:17:42.647197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:42.833903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645161+0000","last_change":"2024-03-31T23:15:33.852981+0000","last_active":"2024-03-31T23:17:42.645161+0000","last_peered":"2024-03-31T23:17:42.645161+0000","last_clean":"2024-03-31T23:17:42.645161+0000","last_became_active":"2024-03-31T23:15:33.851190+0000","last_became_peered":"2024-03-31T23:15:33.851190+0000","last_unstale":"2024-03-31T23:17:42.645161+0000","last_undegraded":"2024-03-31T23:17:42.645161+0000","last_fullsized":"2024-03-31T23:17:42.645161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:29:48.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649316+0000","last_change":"2024-03-31T23:15:33.847133+0000","last_active":"2024-03-31T23:17:42.649316+0000","last_peered":"2024-03-31T23:17:42.649316+0000","last_clean":"2024-03-31T23:17:42.649316+0000","last_became_active":"2024-03-31T23:15:33.844270+0000","last_became_peered":"2024-03-31T23:15:33.844270+0000","last_unstale":"2024-03-31T23:17:42.649316+0000","last_undegraded":"2024-03-31T23:17:42.649316+0000","last_fullsized":"2024-03-31T23:17:42.649316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:43.637672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791231+0000","last_change":"2024-03-31T23:15:33.845151+0000","last_active":"2024-03-31T23:17:42.791231+0000","last_peered":"2024-03-31T23:17:42.791231+0000","last_clean":"2024-03-31T23:17:42.791231+0000","last_became_active":"2024-03-31T23:15:33.844811+0000","last_became_peered":"2024-03-31T23:15:33.844811+0000","last_unstale":"2024-03-31T23:17:42.791231+0000","last_undegraded":"2024-03-31T23:17:42.791231+0000","last_fullsized":"2024-03-31T23:17:42.791231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:43.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647681+0000","last_change":"2024-03-31T23:15:33.842258+0000","last_active":"2024-03-31T23:17:42.647681+0000","last_peered":"2024-03-31T23:17:42.647681+0000","last_clean":"2024-03-31T23:17:42.647681+0000","last_became_active":"2024-03-31T23:15:33.841917+0000","last_became_peered":"2024-03-31T23:15:33.841917+0000","last_unstale":"2024-03-31T23:17:42.647681+0000","last_undegraded":"2024-03-31T23:17:42.647681+0000","last_fullsized":"2024-03-31T23:17:42.647681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:56.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644642+0000","last_change":"2024-03-31T23:15:33.840987+0000","last_active":"2024-03-31T23:17:42.644642+0000","last_peered":"2024-03-31T23:17:42.644642+0000","last_clean":"2024-03-31T23:17:42.644642+0000","last_became_active":"2024-03-31T23:15:33.840480+0000","last_became_peered":"2024-03-31T23:15:33.840480+0000","last_unstale":"2024-03-31T23:17:42.644642+0000","last_undegraded":"2024-03-31T23:17:42.644642+0000","last_fullsized":"2024-03-31T23:17:42.644642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:51:09.359121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644243+0000","last_change":"2024-03-31T23:15:33.835430+0000","last_active":"2024-03-31T23:17:42.644243+0000","last_peered":"2024-03-31T23:17:42.644243+0000","last_clean":"2024-03-31T23:17:42.644243+0000","last_became_active":"2024-03-31T23:15:33.833883+0000","last_became_peered":"2024-03-31T23:15:33.833883+0000","last_unstale":"2024-03-31T23:17:42.644243+0000","last_undegraded":"2024-03-31T23:17:42.644243+0000","last_fullsized":"2024-03-31T23:17:42.644243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:03.387199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790910+0000","last_change":"2024-03-31T23:15:33.836499+0000","last_active":"2024-03-31T23:17:42.790910+0000","last_peered":"2024-03-31T23:17:42.790910+0000","last_clean":"2024-03-31T23:17:42.790910+0000","last_became_active":"2024-03-31T23:15:33.836124+0000","last_became_peered":"2024-03-31T23:15:33.836124+0000","last_unstale":"2024-03-31T23:17:42.790910+0000","last_undegraded":"2024-03-31T23:17:42.790910+0000","last_fullsized":"2024-03-31T23:17:42.790910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:33:07.473322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790921+0000","last_change":"2024-03-31T23:15:33.847680+0000","last_active":"2024-03-31T23:17:42.790921+0000","last_peered":"2024-03-31T23:17:42.790921+0000","last_clean":"2024-03-31T23:17:42.790921+0000","last_became_active":"2024-03-31T23:15:33.844764+0000","last_became_peered":"2024-03-31T23:15:33.844764+0000","last_unstale":"2024-03-31T23:17:42.790921+0000","last_undegraded":"2024-03-31T23:17:42.790921+0000","last_fullsized":"2024-03-31T23:17:42.790921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:45:59.929031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648652+0000","last_change":"2024-03-31T23:15:33.846874+0000","last_active":"2024-03-31T23:17:42.648652+0000","last_peered":"2024-03-31T23:17:42.648652+0000","last_clean":"2024-03-31T23:17:42.648652+0000","last_became_active":"2024-03-31T23:15:33.845111+0000","last_became_peered":"2024-03-31T23:15:33.845111+0000","last_unstale":"2024-03-31T23:17:42.648652+0000","last_undegraded":"2024-03-31T23:17:42.648652+0000","last_fullsized":"2024-03-31T23:17:42.648652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:53:22.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792004+0000","last_change":"2024-03-31T23:15:33.849014+0000","last_active":"2024-03-31T23:17:42.792004+0000","last_peered":"2024-03-31T23:17:42.792004+0000","last_clean":"2024-03-31T23:17:42.792004+0000","last_became_active":"2024-03-31T23:15:33.848688+0000","last_became_peered":"2024-03-31T23:15:33.848688+0000","last_unstale":"2024-03-31T23:17:42.792004+0000","last_undegraded":"2024-03-31T23:17:42.792004+0000","last_fullsized":"2024-03-31T23:17:42.792004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:41:13.992595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792007+0000","last_change":"2024-03-31T23:15:33.838819+0000","last_active":"2024-03-31T23:17:42.792007+0000","last_peered":"2024-03-31T23:17:42.792007+0000","last_clean":"2024-03-31T23:17:42.792007+0000","last_became_active":"2024-03-31T23:15:33.838483+0000","last_became_peered":"2024-03-31T23:15:33.838483+0000","last_unstale":"2024-03-31T23:17:42.792007+0000","last_undegraded":"2024-03-31T23:17:42.792007+0000","last_fullsized":"2024-03-31T23:17:42.792007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:00:03.690273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791431+0000","last_change":"2024-03-31T23:15:33.848652+0000","last_active":"2024-03-31T23:17:42.791431+0000","last_peered":"2024-03-31T23:17:42.791431+0000","last_clean":"2024-03-31T23:17:42.791431+0000","last_became_active":"2024-03-31T23:15:33.848276+0000","last_became_peered":"2024-03-31T23:15:33.848276+0000","last_unstale":"2024-03-31T23:17:42.791431+0000","last_undegraded":"2024-03-31T23:17:42.791431+0000","last_fullsized":"2024-03-31T23:17:42.791431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:25:56.138631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791095+0000","last_change":"2024-03-31T23:15:38.182537+0000","last_active":"2024-03-31T23:17:42.791095+0000","last_peered":"2024-03-31T23:17:42.791095+0000","last_clean":"2024-03-31T23:17:42.791095+0000","last_became_active":"2024-03-31T23:15:38.182091+0000","last_became_peered":"2024-03-31T23:15:38.182091+0000","last_unstale":"2024-03-31T23:17:42.791095+0000","last_undegraded":"2024-03-31T23:17:42.791095+0000","last_fullsized":"2024-03-31T23:17:42.791095+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:59.761472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"93'14","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:57.387567+0000","last_change":"2024-03-31T23:15:32.830738+0000","last_active":"2024-03-31T23:17:57.387567+0000","last_peered":"2024-03-31T23:17:57.387567+0000","last_clean":"2024-03-31T23:17:57.387567+0000","last_became_active":"2024-03-31T23:15:32.830428+0000","last_became_peered":"2024-03-31T23:15:32.830428+0000","last_unstale":"2024-03-31T23:17:57.387567+0000","last_undegraded":"2024-03-31T23:17:57.387567+0000","last_fullsized":"2024-03-31T23:17:57.387567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:47:21.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645851+0000","last_change":"2024-03-31T23:15:33.851854+0000","last_active":"2024-03-31T23:17:42.645851+0000","last_peered":"2024-03-31T23:17:42.645851+0000","last_clean":"2024-03-31T23:17:42.645851+0000","last_became_active":"2024-03-31T23:15:33.850387+0000","last_became_peered":"2024-03-31T23:15:33.850387+0000","last_unstale":"2024-03-31T23:17:42.645851+0000","last_undegraded":"2024-03-31T23:17:42.645851+0000","last_fullsized":"2024-03-31T23:17:42.645851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:51:31.831756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644143+0000","last_change":"2024-03-31T23:15:38.176039+0000","last_active":"2024-03-31T23:17:42.644143+0000","last_peered":"2024-03-31T23:17:42.644143+0000","last_clean":"2024-03-31T23:17:42.644143+0000","last_became_active":"2024-03-31T23:15:38.174219+0000","last_became_peered":"2024-03-31T23:15:38.174219+0000","last_unstale":"2024-03-31T23:17:42.644143+0000","last_undegraded":"2024-03-31T23:17:42.644143+0000","last_fullsized":"2024-03-31T23:17:42.644143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:21.826798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645942+0000","last_change":"2024-03-31T23:15:32.841326+0000","last_active":"2024-03-31T23:17:42.645942+0000","last_peered":"2024-03-31T23:17:42.645942+0000","last_clean":"2024-03-31T23:17:42.645942+0000","last_became_active":"2024-03-31T23:15:32.840981+0000","last_became_peered":"2024-03-31T23:15:32.840981+0000","last_unstale":"2024-03-31T23:17:42.645942+0000","last_undegraded":"2024-03-31T23:17:42.645942+0000","last_fullsized":"2024-03-31T23:17:42.645942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:51:45.078876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791841+0000","last_change":"2024-03-31T23:15:33.847826+0000","last_active":"2024-03-31T23:17:42.791841+0000","last_peered":"2024-03-31T23:17:42.791841+0000","last_clean":"2024-03-31T23:17:42.791841+0000","last_became_active":"2024-03-31T23:15:33.845416+0000","last_became_peered":"2024-03-31T23:15:33.845416+0000","last_unstale":"2024-03-31T23:17:42.791841+0000","last_undegraded":"2024-03-31T23:17:42.791841+0000","last_fullsized":"2024-03-31T23:17:42.791841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:29:56.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644285+0000","last_change":"2024-03-31T23:15:38.182070+0000","last_active":"2024-03-31T23:17:42.644285+0000","last_peered":"2024-03-31T23:17:42.644285+0000","last_clean":"2024-03-31T23:17:42.644285+0000","last_became_active":"2024-03-31T23:15:38.181679+0000","last_became_peered":"2024-03-31T23:15:38.181679+0000","last_unstale":"2024-03-31T23:17:42.644285+0000","last_undegraded":"2024-03-31T23:17:42.644285+0000","last_fullsized":"2024-03-31T23:17:42.644285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:26.013609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374095+0000","last_change":"2024-03-31T23:15:32.843035+0000","last_active":"2024-03-31T23:17:43.374095+0000","last_peered":"2024-03-31T23:17:43.374095+0000","last_clean":"2024-03-31T23:17:43.374095+0000","last_became_active":"2024-03-31T23:15:32.842674+0000","last_became_peered":"2024-03-31T23:15:32.842674+0000","last_unstale":"2024-03-31T23:17:43.374095+0000","last_undegraded":"2024-03-31T23:17:43.374095+0000","last_fullsized":"2024-03-31T23:17:43.374095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:17:54.808378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648931+0000","last_change":"2024-03-31T23:15:33.847197+0000","last_active":"2024-03-31T23:17:42.648931+0000","last_peered":"2024-03-31T23:17:42.648931+0000","last_clean":"2024-03-31T23:17:42.648931+0000","last_became_active":"2024-03-31T23:15:33.844504+0000","last_became_peered":"2024-03-31T23:15:33.844504+0000","last_unstale":"2024-03-31T23:17:42.648931+0000","last_undegraded":"2024-03-31T23:17:42.648931+0000","last_fullsized":"2024-03-31T23:17:42.648931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:05:52.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644073+0000","last_change":"2024-03-31T23:15:38.173242+0000","last_active":"2024-03-31T23:17:42.644073+0000","last_peered":"2024-03-31T23:17:42.644073+0000","last_clean":"2024-03-31T23:17:42.644073+0000","last_became_active":"2024-03-31T23:15:38.172670+0000","last_became_peered":"2024-03-31T23:15:38.172670+0000","last_unstale":"2024-03-31T23:17:42.644073+0000","last_undegraded":"2024-03-31T23:17:42.644073+0000","last_fullsized":"2024-03-31T23:17:42.644073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:15.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373980+0000","last_change":"2024-03-31T23:15:32.845825+0000","last_active":"2024-03-31T23:17:43.373980+0000","last_peered":"2024-03-31T23:17:43.373980+0000","last_clean":"2024-03-31T23:17:43.373980+0000","last_became_active":"2024-03-31T23:15:32.845059+0000","last_became_peered":"2024-03-31T23:15:32.845059+0000","last_unstale":"2024-03-31T23:17:43.373980+0000","last_undegraded":"2024-03-31T23:17:43.373980+0000","last_fullsized":"2024-03-31T23:17:43.373980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:33:17.016271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.650165+0000","last_change":"2024-03-31T23:17:42.650165+0000","last_active":"2024-03-31T23:17:42.650165+0000","last_peered":"2024-03-31T23:17:42.650165+0000","last_clean":"2024-03-31T23:17:42.650165+0000","last_became_active":"2024-03-31T23:17:42.649717+0000","last_became_peered":"2024-03-31T23:17:42.649717+0000","last_unstale":"2024-03-31T23:17:42.650165+0000","last_undegraded":"2024-03-31T23:17:42.650165+0000","last_fullsized":"2024-03-31T23:17:42.650165+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:33:29.555834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791224+0000","last_change":"2024-03-31T23:15:38.170354+0000","last_active":"2024-03-31T23:17:42.791224+0000","last_peered":"2024-03-31T23:17:42.791224+0000","last_clean":"2024-03-31T23:17:42.791224+0000","last_became_active":"2024-03-31T23:15:38.169235+0000","last_became_peered":"2024-03-31T23:15:38.169235+0000","last_unstale":"2024-03-31T23:17:42.791224+0000","last_undegraded":"2024-03-31T23:17:42.791224+0000","last_fullsized":"2024-03-31T23:17:42.791224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:28:53.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.378864+0000","last_change":"2024-03-31T23:15:32.839973+0000","last_active":"2024-03-31T23:17:56.378864+0000","last_peered":"2024-03-31T23:17:56.378864+0000","last_clean":"2024-03-31T23:17:56.378864+0000","last_became_active":"2024-03-31T23:15:32.839105+0000","last_became_peered":"2024-03-31T23:15:32.839105+0000","last_unstale":"2024-03-31T23:17:56.378864+0000","last_undegraded":"2024-03-31T23:17:56.378864+0000","last_fullsized":"2024-03-31T23:17:56.378864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:10:19.742783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373720+0000","last_change":"2024-03-31T23:15:33.838605+0000","last_active":"2024-03-31T23:17:43.373720+0000","last_peered":"2024-03-31T23:17:43.373720+0000","last_clean":"2024-03-31T23:17:43.373720+0000","last_became_active":"2024-03-31T23:15:33.838277+0000","last_became_peered":"2024-03-31T23:15:33.838277+0000","last_unstale":"2024-03-31T23:17:43.373720+0000","last_undegraded":"2024-03-31T23:17:43.373720+0000","last_fullsized":"2024-03-31T23:17:43.373720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:49:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790931+0000","last_change":"2024-03-31T23:15:38.182469+0000","last_active":"2024-03-31T23:17:42.790931+0000","last_peered":"2024-03-31T23:17:42.790931+0000","last_clean":"2024-03-31T23:17:42.790931+0000","last_became_active":"2024-03-31T23:15:38.182043+0000","last_became_peered":"2024-03-31T23:15:38.182043+0000","last_unstale":"2024-03-31T23:17:42.790931+0000","last_undegraded":"2024-03-31T23:17:42.790931+0000","last_fullsized":"2024-03-31T23:17:42.790931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:26.988393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790772+0000","last_change":"2024-03-31T23:15:32.846157+0000","last_active":"2024-03-31T23:17:42.790772+0000","last_peered":"2024-03-31T23:17:42.790772+0000","last_clean":"2024-03-31T23:17:42.790772+0000","last_became_active":"2024-03-31T23:15:32.845876+0000","last_became_peered":"2024-03-31T23:15:32.845876+0000","last_unstale":"2024-03-31T23:17:42.790772+0000","last_undegraded":"2024-03-31T23:17:42.790772+0000","last_fullsized":"2024-03-31T23:17:42.790772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:56:46.047283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646141+0000","last_change":"2024-03-31T23:15:33.840607+0000","last_active":"2024-03-31T23:17:42.646141+0000","last_peered":"2024-03-31T23:17:42.646141+0000","last_clean":"2024-03-31T23:17:42.646141+0000","last_became_active":"2024-03-31T23:15:33.840284+0000","last_became_peered":"2024-03-31T23:15:33.840284+0000","last_unstale":"2024-03-31T23:17:42.646141+0000","last_undegraded":"2024-03-31T23:17:42.646141+0000","last_fullsized":"2024-03-31T23:17:42.646141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:24.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791952+0000","last_change":"2024-03-31T23:16:42.482887+0000","last_active":"2024-03-31T23:17:42.791952+0000","last_peered":"2024-03-31T23:17:42.791952+0000","last_clean":"2024-03-31T23:17:42.791952+0000","last_became_active":"2024-03-31T23:16:42.482434+0000","last_became_peered":"2024-03-31T23:16:42.482434+0000","last_unstale":"2024-03-31T23:17:42.791952+0000","last_undegraded":"2024-03-31T23:17:42.791952+0000","last_fullsized":"2024-03-31T23:17:42.791952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:17.721985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643849+0000","last_change":"2024-03-31T23:15:32.836178+0000","last_active":"2024-03-31T23:17:42.643849+0000","last_peered":"2024-03-31T23:17:42.643849+0000","last_clean":"2024-03-31T23:17:42.643849+0000","last_became_active":"2024-03-31T23:15:32.835597+0000","last_became_peered":"2024-03-31T23:15:32.835597+0000","last_unstale":"2024-03-31T23:17:42.643849+0000","last_undegraded":"2024-03-31T23:17:42.643849+0000","last_fullsized":"2024-03-31T23:17:42.643849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:44.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645096+0000","last_change":"2024-03-31T23:15:33.852694+0000","last_active":"2024-03-31T23:17:42.645096+0000","last_peered":"2024-03-31T23:17:42.645096+0000","last_clean":"2024-03-31T23:17:42.645096+0000","last_became_active":"2024-03-31T23:15:33.850530+0000","last_became_peered":"2024-03-31T23:15:33.850530+0000","last_unstale":"2024-03-31T23:17:42.645096+0000","last_undegraded":"2024-03-31T23:17:42.645096+0000","last_fullsized":"2024-03-31T23:17:42.645096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:36:33.424518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791444+0000","last_change":"2024-03-31T23:15:38.174430+0000","last_active":"2024-03-31T23:17:42.791444+0000","last_peered":"2024-03-31T23:17:42.791444+0000","last_clean":"2024-03-31T23:17:42.791444+0000","last_became_active":"2024-03-31T23:15:38.174030+0000","last_became_peered":"2024-03-31T23:15:38.174030+0000","last_unstale":"2024-03-31T23:17:42.791444+0000","last_undegraded":"2024-03-31T23:17:42.791444+0000","last_fullsized":"2024-03-31T23:17:42.791444+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:30:17.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646012+0000","last_change":"2024-03-31T23:15:32.835065+0000","last_active":"2024-03-31T23:17:42.646012+0000","last_peered":"2024-03-31T23:17:42.646012+0000","last_clean":"2024-03-31T23:17:42.646012+0000","last_became_active":"2024-03-31T23:15:32.834726+0000","last_became_peered":"2024-03-31T23:15:32.834726+0000","last_unstale":"2024-03-31T23:17:42.646012+0000","last_undegraded":"2024-03-31T23:17:42.646012+0000","last_fullsized":"2024-03-31T23:17:42.646012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:49:53.605983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791632+0000","last_change":"2024-03-31T23:15:33.842822+0000","last_active":"2024-03-31T23:17:42.791632+0000","last_peered":"2024-03-31T23:17:42.791632+0000","last_clean":"2024-03-31T23:17:42.791632+0000","last_became_active":"2024-03-31T23:15:33.842366+0000","last_became_peered":"2024-03-31T23:15:33.842366+0000","last_unstale":"2024-03-31T23:17:42.791632+0000","last_undegraded":"2024-03-31T23:17:42.791632+0000","last_fullsized":"2024-03-31T23:17:42.791632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:54.442750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645308+0000","last_change":"2024-03-31T23:15:38.170642+0000","last_active":"2024-03-31T23:17:42.645308+0000","last_peered":"2024-03-31T23:17:42.645308+0000","last_clean":"2024-03-31T23:17:42.645308+0000","last_became_active":"2024-03-31T23:15:38.170231+0000","last_became_peered":"2024-03-31T23:15:38.170231+0000","last_unstale":"2024-03-31T23:17:42.645308+0000","last_undegraded":"2024-03-31T23:17:42.645308+0000","last_fullsized":"2024-03-31T23:17:42.645308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:15:35.219256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":261,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.375159+0000","last_change":"2024-03-31T23:15:32.841830+0000","last_active":"2024-03-31T23:17:53.375159+0000","last_peered":"2024-03-31T23:17:53.375159+0000","last_clean":"2024-03-31T23:17:53.375159+0000","last_became_active":"2024-03-31T23:15:32.841458+0000","last_became_peered":"2024-03-31T23:15:32.841458+0000","last_unstale":"2024-03-31T23:17:53.375159+0000","last_undegraded":"2024-03-31T23:17:53.375159+0000","last_fullsized":"2024-03-31T23:17:53.375159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:20:35.311030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649221+0000","last_change":"2024-03-31T23:15:33.839663+0000","last_active":"2024-03-31T23:17:42.649221+0000","last_peered":"2024-03-31T23:17:42.649221+0000","last_clean":"2024-03-31T23:17:42.649221+0000","last_became_active":"2024-03-31T23:15:33.839302+0000","last_became_peered":"2024-03-31T23:15:33.839302+0000","last_unstale":"2024-03-31T23:17:42.649221+0000","last_undegraded":"2024-03-31T23:17:42.649221+0000","last_fullsized":"2024-03-31T23:17:42.649221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:43:29.775725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791336+0000","last_change":"2024-03-31T23:15:38.179358+0000","last_active":"2024-03-31T23:17:42.791336+0000","last_peered":"2024-03-31T23:17:42.791336+0000","last_clean":"2024-03-31T23:17:42.791336+0000","last_became_active":"2024-03-31T23:15:38.178861+0000","last_became_peered":"2024-03-31T23:15:38.178861+0000","last_unstale":"2024-03-31T23:17:42.791336+0000","last_undegraded":"2024-03-31T23:17:42.791336+0000","last_fullsized":"2024-03-31T23:17:42.791336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:37:34.027960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647777+0000","last_change":"2024-03-31T23:15:32.834331+0000","last_active":"2024-03-31T23:17:42.647777+0000","last_peered":"2024-03-31T23:17:42.647777+0000","last_clean":"2024-03-31T23:17:42.647777+0000","last_became_active":"2024-03-31T23:15:32.833854+0000","last_became_peered":"2024-03-31T23:15:32.833854+0000","last_unstale":"2024-03-31T23:17:42.647777+0000","last_undegraded":"2024-03-31T23:17:42.647777+0000","last_fullsized":"2024-03-31T23:17:42.647777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:21:31.540010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.792041+0000","last_change":"2024-03-31T23:15:33.844127+0000","last_active":"2024-03-31T23:17:42.792041+0000","last_peered":"2024-03-31T23:17:42.792041+0000","last_clean":"2024-03-31T23:17:42.792041+0000","last_became_active":"2024-03-31T23:15:33.843429+0000","last_became_peered":"2024-03-31T23:15:33.843429+0000","last_unstale":"2024-03-31T23:17:42.792041+0000","last_undegraded":"2024-03-31T23:17:42.792041+0000","last_fullsized":"2024-03-31T23:17:42.792041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:47.714714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644494+0000","last_change":"2024-03-31T23:15:38.175420+0000","last_active":"2024-03-31T23:17:42.644494+0000","last_peered":"2024-03-31T23:17:42.644494+0000","last_clean":"2024-03-31T23:17:42.644494+0000","last_became_active":"2024-03-31T23:15:38.174846+0000","last_became_peered":"2024-03-31T23:15:38.174846+0000","last_unstale":"2024-03-31T23:17:42.644494+0000","last_undegraded":"2024-03-31T23:17:42.644494+0000","last_fullsized":"2024-03-31T23:17:42.644494+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:09.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646433+0000","last_change":"2024-03-31T23:15:32.838028+0000","last_active":"2024-03-31T23:17:42.646433+0000","last_peered":"2024-03-31T23:17:42.646433+0000","last_clean":"2024-03-31T23:17:42.646433+0000","last_became_active":"2024-03-31T23:15:32.837440+0000","last_became_peered":"2024-03-31T23:15:32.837440+0000","last_unstale":"2024-03-31T23:17:42.646433+0000","last_undegraded":"2024-03-31T23:17:42.646433+0000","last_fullsized":"2024-03-31T23:17:42.646433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:14.959335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.649125+0000","last_change":"2024-03-31T23:15:33.847056+0000","last_active":"2024-03-31T23:17:42.649125+0000","last_peered":"2024-03-31T23:17:42.649125+0000","last_clean":"2024-03-31T23:17:42.649125+0000","last_became_active":"2024-03-31T23:15:33.846621+0000","last_became_peered":"2024-03-31T23:15:33.846621+0000","last_unstale":"2024-03-31T23:17:42.649125+0000","last_undegraded":"2024-03-31T23:17:42.649125+0000","last_fullsized":"2024-03-31T23:17:42.649125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:36:33.519244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791336+0000","last_change":"2024-03-31T23:15:38.163215+0000","last_active":"2024-03-31T23:17:42.791336+0000","last_peered":"2024-03-31T23:17:42.791336+0000","last_clean":"2024-03-31T23:17:42.791336+0000","last_became_active":"2024-03-31T23:15:38.162746+0000","last_became_peered":"2024-03-31T23:15:38.162746+0000","last_unstale":"2024-03-31T23:17:42.791336+0000","last_undegraded":"2024-03-31T23:17:42.791336+0000","last_fullsized":"2024-03-31T23:17:42.791336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:30.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'41","reported_seq":306,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.693448+0000","last_change":"2024-03-31T23:15:32.839124+0000","last_active":"2024-03-31T23:17:53.693448+0000","last_peered":"2024-03-31T23:17:53.693448+0000","last_clean":"2024-03-31T23:17:53.693448+0000","last_became_active":"2024-03-31T23:15:32.838663+0000","last_became_peered":"2024-03-31T23:15:32.838663+0000","last_unstale":"2024-03-31T23:17:53.693448+0000","last_undegraded":"2024-03-31T23:17:53.693448+0000","last_fullsized":"2024-03-31T23:17:53.693448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:59:25.499074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69286,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":179,"num_write":43,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374011+0000","last_change":"2024-03-31T23:15:33.836191+0000","last_active":"2024-03-31T23:17:43.374011+0000","last_peered":"2024-03-31T23:17:43.374011+0000","last_clean":"2024-03-31T23:17:43.374011+0000","last_became_active":"2024-03-31T23:15:33.835806+0000","last_became_peered":"2024-03-31T23:15:33.835806+0000","last_unstale":"2024-03-31T23:17:43.374011+0000","last_undegraded":"2024-03-31T23:17:43.374011+0000","last_fullsized":"2024-03-31T23:17:43.374011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:28:06.070511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646796+0000","last_change":"2024-03-31T23:15:38.173786+0000","last_active":"2024-03-31T23:17:42.646796+0000","last_peered":"2024-03-31T23:17:42.646796+0000","last_clean":"2024-03-31T23:17:42.646796+0000","last_became_active":"2024-03-31T23:15:38.173374+0000","last_became_peered":"2024-03-31T23:15:38.173374+0000","last_unstale":"2024-03-31T23:17:42.646796+0000","last_undegraded":"2024-03-31T23:17:42.646796+0000","last_fullsized":"2024-03-31T23:17:42.646796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:42:10.226398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791094+0000","last_change":"2024-03-31T23:15:32.838204+0000","last_active":"2024-03-31T23:17:42.791094+0000","last_peered":"2024-03-31T23:17:42.791094+0000","last_clean":"2024-03-31T23:17:42.791094+0000","last_became_active":"2024-03-31T23:15:32.836874+0000","last_became_peered":"2024-03-31T23:15:32.836874+0000","last_unstale":"2024-03-31T23:17:42.791094+0000","last_undegraded":"2024-03-31T23:17:42.791094+0000","last_fullsized":"2024-03-31T23:17:42.791094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:11:52.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643889+0000","last_change":"2024-03-31T23:15:33.838786+0000","last_active":"2024-03-31T23:17:42.643889+0000","last_peered":"2024-03-31T23:17:42.643889+0000","last_clean":"2024-03-31T23:17:42.643889+0000","last_became_active":"2024-03-31T23:15:33.838401+0000","last_became_peered":"2024-03-31T23:15:33.838401+0000","last_unstale":"2024-03-31T23:17:42.643889+0000","last_undegraded":"2024-03-31T23:17:42.643889+0000","last_fullsized":"2024-03-31T23:17:42.643889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:16:24.690455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791346+0000","last_change":"2024-03-31T23:15:38.169053+0000","last_active":"2024-03-31T23:17:42.791346+0000","last_peered":"2024-03-31T23:17:42.791346+0000","last_clean":"2024-03-31T23:17:42.791346+0000","last_became_active":"2024-03-31T23:15:38.168408+0000","last_became_peered":"2024-03-31T23:15:38.168408+0000","last_unstale":"2024-03-31T23:17:42.791346+0000","last_undegraded":"2024-03-31T23:17:42.791346+0000","last_fullsized":"2024-03-31T23:17:42.791346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:15.304450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646725+0000","last_change":"2024-03-31T23:15:32.842706+0000","last_active":"2024-03-31T23:17:42.646725+0000","last_peered":"2024-03-31T23:17:42.646725+0000","last_clean":"2024-03-31T23:17:42.646725+0000","last_became_active":"2024-03-31T23:15:32.842072+0000","last_became_peered":"2024-03-31T23:15:32.842072+0000","last_unstale":"2024-03-31T23:17:42.646725+0000","last_undegraded":"2024-03-31T23:17:42.646725+0000","last_fullsized":"2024-03-31T23:17:42.646725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:19:00.994058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647620+0000","last_change":"2024-03-31T23:15:33.841013+0000","last_active":"2024-03-31T23:17:42.647620+0000","last_peered":"2024-03-31T23:17:42.647620+0000","last_clean":"2024-03-31T23:17:42.647620+0000","last_became_active":"2024-03-31T23:15:33.840637+0000","last_became_peered":"2024-03-31T23:15:33.840637+0000","last_unstale":"2024-03-31T23:17:42.647620+0000","last_undegraded":"2024-03-31T23:17:42.647620+0000","last_fullsized":"2024-03-31T23:17:42.647620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:00.266840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791670+0000","last_change":"2024-03-31T23:15:38.179138+0000","last_active":"2024-03-31T23:17:42.791670+0000","last_peered":"2024-03-31T23:17:42.791670+0000","last_clean":"2024-03-31T23:17:42.791670+0000","last_became_active":"2024-03-31T23:15:38.178675+0000","last_became_peered":"2024-03-31T23:15:38.178675+0000","last_unstale":"2024-03-31T23:17:42.791670+0000","last_undegraded":"2024-03-31T23:17:42.791670+0000","last_fullsized":"2024-03-31T23:17:42.791670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:23:39.354208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.387169+0000","last_change":"2024-03-31T23:15:32.830546+0000","last_active":"2024-03-31T23:17:56.387169+0000","last_peered":"2024-03-31T23:17:56.387169+0000","last_clean":"2024-03-31T23:17:56.387169+0000","last_became_active":"2024-03-31T23:15:32.830183+0000","last_became_peered":"2024-03-31T23:15:32.830183+0000","last_unstale":"2024-03-31T23:17:56.387169+0000","last_undegraded":"2024-03-31T23:17:56.387169+0000","last_fullsized":"2024-03-31T23:17:56.387169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:41:17.502348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647487+0000","last_change":"2024-03-31T23:15:33.840123+0000","last_active":"2024-03-31T23:17:42.647487+0000","last_peered":"2024-03-31T23:17:42.647487+0000","last_clean":"2024-03-31T23:17:42.647487+0000","last_became_active":"2024-03-31T23:15:33.839791+0000","last_became_peered":"2024-03-31T23:15:33.839791+0000","last_unstale":"2024-03-31T23:17:42.647487+0000","last_undegraded":"2024-03-31T23:17:42.647487+0000","last_fullsized":"2024-03-31T23:17:42.647487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:24:53.366448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644361+0000","last_change":"2024-03-31T23:15:38.182253+0000","last_active":"2024-03-31T23:17:42.644361+0000","last_peered":"2024-03-31T23:17:42.644361+0000","last_clean":"2024-03-31T23:17:42.644361+0000","last_became_active":"2024-03-31T23:15:38.181797+0000","last_became_peered":"2024-03-31T23:15:38.181797+0000","last_unstale":"2024-03-31T23:17:42.644361+0000","last_undegraded":"2024-03-31T23:17:42.644361+0000","last_fullsized":"2024-03-31T23:17:42.644361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:15:16.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373550+0000","last_change":"2024-03-31T23:15:32.843149+0000","last_active":"2024-03-31T23:17:43.373550+0000","last_peered":"2024-03-31T23:17:43.373550+0000","last_clean":"2024-03-31T23:17:43.373550+0000","last_became_active":"2024-03-31T23:15:32.842841+0000","last_became_peered":"2024-03-31T23:15:32.842841+0000","last_unstale":"2024-03-31T23:17:43.373550+0000","last_undegraded":"2024-03-31T23:17:43.373550+0000","last_fullsized":"2024-03-31T23:17:43.373550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:53.264922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791377+0000","last_change":"2024-03-31T23:16:42.520338+0000","last_active":"2024-03-31T23:17:42.791377+0000","last_peered":"2024-03-31T23:17:42.791377+0000","last_clean":"2024-03-31T23:17:42.791377+0000","last_became_active":"2024-03-31T23:16:42.519941+0000","last_became_peered":"2024-03-31T23:16:42.519941+0000","last_unstale":"2024-03-31T23:17:42.791377+0000","last_undegraded":"2024-03-31T23:17:42.791377+0000","last_fullsized":"2024-03-31T23:17:42.791377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:49:47.173204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790729+0000","last_change":"2024-03-31T23:16:42.520660+0000","last_active":"2024-03-31T23:17:42.790729+0000","last_peered":"2024-03-31T23:17:42.790729+0000","last_clean":"2024-03-31T23:17:42.790729+0000","last_became_active":"2024-03-31T23:16:42.520061+0000","last_became_peered":"2024-03-31T23:16:42.520061+0000","last_unstale":"2024-03-31T23:17:42.790729+0000","last_undegraded":"2024-03-31T23:17:42.790729+0000","last_fullsized":"2024-03-31T23:17:42.790729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:18:20.495238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791828+0000","last_change":"2024-03-31T23:16:42.486185+0000","last_active":"2024-03-31T23:17:42.791828+0000","last_peered":"2024-03-31T23:17:42.791828+0000","last_clean":"2024-03-31T23:17:42.791828+0000","last_became_active":"2024-03-31T23:16:42.480591+0000","last_became_peered":"2024-03-31T23:16:42.480591+0000","last_unstale":"2024-03-31T23:17:42.791828+0000","last_undegraded":"2024-03-31T23:17:42.791828+0000","last_fullsized":"2024-03-31T23:17:42.791828+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:01:32.270666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791853+0000","last_change":"2024-03-31T23:15:33.844992+0000","last_active":"2024-03-31T23:17:42.791853+0000","last_peered":"2024-03-31T23:17:42.791853+0000","last_clean":"2024-03-31T23:17:42.791853+0000","last_became_active":"2024-03-31T23:15:33.843919+0000","last_became_peered":"2024-03-31T23:15:33.843919+0000","last_unstale":"2024-03-31T23:17:42.791853+0000","last_undegraded":"2024-03-31T23:17:42.791853+0000","last_fullsized":"2024-03-31T23:17:42.791853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:02:03.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373695+0000","last_change":"2024-03-31T23:16:42.520508+0000","last_active":"2024-03-31T23:17:43.373695+0000","last_peered":"2024-03-31T23:17:43.373695+0000","last_clean":"2024-03-31T23:17:43.373695+0000","last_became_active":"2024-03-31T23:16:42.520076+0000","last_became_peered":"2024-03-31T23:16:42.520076+0000","last_unstale":"2024-03-31T23:17:43.373695+0000","last_undegraded":"2024-03-31T23:17:43.373695+0000","last_fullsized":"2024-03-31T23:17:43.373695+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:32:07.192476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791702+0000","last_change":"2024-03-31T23:15:32.828830+0000","last_active":"2024-03-31T23:17:42.791702+0000","last_peered":"2024-03-31T23:17:42.791702+0000","last_clean":"2024-03-31T23:17:42.791702+0000","last_became_active":"2024-03-31T23:15:32.828490+0000","last_became_peered":"2024-03-31T23:15:32.828490+0000","last_unstale":"2024-03-31T23:17:42.791702+0000","last_undegraded":"2024-03-31T23:17:42.791702+0000","last_fullsized":"2024-03-31T23:17:42.791702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:58:29.942509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791054+0000","last_change":"2024-03-31T23:15:33.840537+0000","last_active":"2024-03-31T23:17:42.791054+0000","last_peered":"2024-03-31T23:17:42.791054+0000","last_clean":"2024-03-31T23:17:42.791054+0000","last_became_active":"2024-03-31T23:15:33.840205+0000","last_became_peered":"2024-03-31T23:15:33.840205+0000","last_unstale":"2024-03-31T23:17:42.791054+0000","last_undegraded":"2024-03-31T23:17:42.791054+0000","last_fullsized":"2024-03-31T23:17:42.791054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:08:34.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644490+0000","last_change":"2024-03-31T23:15:38.174143+0000","last_active":"2024-03-31T23:17:42.644490+0000","last_peered":"2024-03-31T23:17:42.644490+0000","last_clean":"2024-03-31T23:17:42.644490+0000","last_became_active":"2024-03-31T23:15:38.173429+0000","last_became_peered":"2024-03-31T23:15:38.173429+0000","last_unstale":"2024-03-31T23:17:42.644490+0000","last_undegraded":"2024-03-31T23:17:42.644490+0000","last_fullsized":"2024-03-31T23:17:42.644490+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:53:34.484078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.386900+0000","last_change":"2024-03-31T23:15:32.843076+0000","last_active":"2024-03-31T23:17:56.386900+0000","last_peered":"2024-03-31T23:17:56.386900+0000","last_clean":"2024-03-31T23:17:56.386900+0000","last_became_active":"2024-03-31T23:15:32.842698+0000","last_became_peered":"2024-03-31T23:15:32.842698+0000","last_unstale":"2024-03-31T23:17:56.386900+0000","last_undegraded":"2024-03-31T23:17:56.386900+0000","last_fullsized":"2024-03-31T23:17:56.386900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:34:37.265657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790917+0000","last_change":"2024-03-31T23:15:33.837981+0000","last_active":"2024-03-31T23:17:42.790917+0000","last_peered":"2024-03-31T23:17:42.790917+0000","last_clean":"2024-03-31T23:17:42.790917+0000","last_became_active":"2024-03-31T23:15:33.837603+0000","last_became_peered":"2024-03-31T23:15:33.837603+0000","last_unstale":"2024-03-31T23:17:42.790917+0000","last_undegraded":"2024-03-31T23:17:42.790917+0000","last_fullsized":"2024-03-31T23:17:42.790917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:15.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644372+0000","last_change":"2024-03-31T23:15:38.177156+0000","last_active":"2024-03-31T23:17:42.644372+0000","last_peered":"2024-03-31T23:17:42.644372+0000","last_clean":"2024-03-31T23:17:42.644372+0000","last_became_active":"2024-03-31T23:15:38.176707+0000","last_became_peered":"2024-03-31T23:15:38.176707+0000","last_unstale":"2024-03-31T23:17:42.644372+0000","last_undegraded":"2024-03-31T23:17:42.644372+0000","last_fullsized":"2024-03-31T23:17:42.644372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:17:52.420473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646100+0000","last_change":"2024-03-31T23:15:33.845524+0000","last_active":"2024-03-31T23:17:42.646100+0000","last_peered":"2024-03-31T23:17:42.646100+0000","last_clean":"2024-03-31T23:17:42.646100+0000","last_became_active":"2024-03-31T23:15:33.845002+0000","last_became_peered":"2024-03-31T23:15:33.845002+0000","last_unstale":"2024-03-31T23:17:42.646100+0000","last_undegraded":"2024-03-31T23:17:42.646100+0000","last_fullsized":"2024-03-31T23:17:42.646100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:57:18.568003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:56.386607+0000","last_change":"2024-03-31T23:15:32.842116+0000","last_active":"2024-03-31T23:17:56.386607+0000","last_peered":"2024-03-31T23:17:56.386607+0000","last_clean":"2024-03-31T23:17:56.386607+0000","last_became_active":"2024-03-31T23:15:32.841776+0000","last_became_peered":"2024-03-31T23:15:32.841776+0000","last_unstale":"2024-03-31T23:17:56.386607+0000","last_undegraded":"2024-03-31T23:17:56.386607+0000","last_fullsized":"2024-03-31T23:17:56.386607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:32:34.276818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648003+0000","last_change":"2024-03-31T23:15:38.166019+0000","last_active":"2024-03-31T23:17:42.648003+0000","last_peered":"2024-03-31T23:17:42.648003+0000","last_clean":"2024-03-31T23:17:42.648003+0000","last_became_active":"2024-03-31T23:15:38.165556+0000","last_became_peered":"2024-03-31T23:15:38.165556+0000","last_unstale":"2024-03-31T23:17:42.648003+0000","last_undegraded":"2024-03-31T23:17:42.648003+0000","last_fullsized":"2024-03-31T23:17:42.648003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:22:54.331286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645220+0000","last_change":"2024-03-31T23:15:33.847290+0000","last_active":"2024-03-31T23:17:42.645220+0000","last_peered":"2024-03-31T23:17:42.645220+0000","last_clean":"2024-03-31T23:17:42.645220+0000","last_became_active":"2024-03-31T23:15:33.846565+0000","last_became_peered":"2024-03-31T23:15:33.846565+0000","last_unstale":"2024-03-31T23:17:42.645220+0000","last_undegraded":"2024-03-31T23:17:42.645220+0000","last_fullsized":"2024-03-31T23:17:42.645220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:28:10.315787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644385+0000","last_change":"2024-03-31T23:15:32.831977+0000","last_active":"2024-03-31T23:17:42.644385+0000","last_peered":"2024-03-31T23:17:42.644385+0000","last_clean":"2024-03-31T23:17:42.644385+0000","last_became_active":"2024-03-31T23:15:32.831247+0000","last_became_peered":"2024-03-31T23:15:32.831247+0000","last_unstale":"2024-03-31T23:17:42.644385+0000","last_undegraded":"2024-03-31T23:17:42.644385+0000","last_fullsized":"2024-03-31T23:17:42.644385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:59:32.407122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":367,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647230+0000","last_change":"2024-03-31T23:14:22.454926+0000","last_active":"2024-03-31T23:17:42.647230+0000","last_peered":"2024-03-31T23:17:42.647230+0000","last_clean":"2024-03-31T23:17:42.647230+0000","last_became_active":"2024-03-31T23:14:22.454392+0000","last_became_peered":"2024-03-31T23:14:22.454392+0000","last_unstale":"2024-03-31T23:17:42.647230+0000","last_undegraded":"2024-03-31T23:17:42.647230+0000","last_fullsized":"2024-03-31T23:17:42.647230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:10:59.406960+0000","last_clean_scrub_stamp":"2024-03-31T23:10:59.406960+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:27.411869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646242+0000","last_change":"2024-03-31T23:15:38.174632+0000","last_active":"2024-03-31T23:17:42.646242+0000","last_peered":"2024-03-31T23:17:42.646242+0000","last_clean":"2024-03-31T23:17:42.646242+0000","last_became_active":"2024-03-31T23:15:38.174115+0000","last_became_peered":"2024-03-31T23:15:38.174115+0000","last_unstale":"2024-03-31T23:17:42.646242+0000","last_undegraded":"2024-03-31T23:17:42.646242+0000","last_fullsized":"2024-03-31T23:17:42.646242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:22:23.151019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.643534+0000","last_change":"2024-03-31T23:16:42.478674+0000","last_active":"2024-03-31T23:17:42.643534+0000","last_peered":"2024-03-31T23:17:42.643534+0000","last_clean":"2024-03-31T23:17:42.643534+0000","last_became_active":"2024-03-31T23:16:42.478317+0000","last_became_peered":"2024-03-31T23:16:42.478317+0000","last_unstale":"2024-03-31T23:17:42.643534+0000","last_undegraded":"2024-03-31T23:17:42.643534+0000","last_fullsized":"2024-03-31T23:17:42.643534+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:43.917393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647240+0000","last_change":"2024-03-31T23:15:32.835069+0000","last_active":"2024-03-31T23:17:42.647240+0000","last_peered":"2024-03-31T23:17:42.647240+0000","last_clean":"2024-03-31T23:17:42.647240+0000","last_became_active":"2024-03-31T23:15:32.834577+0000","last_became_peered":"2024-03-31T23:15:32.834577+0000","last_unstale":"2024-03-31T23:17:42.647240+0000","last_undegraded":"2024-03-31T23:17:42.647240+0000","last_fullsized":"2024-03-31T23:17:42.647240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:02:06.702914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791381+0000","last_change":"2024-03-31T23:15:38.171769+0000","last_active":"2024-03-31T23:17:42.791381+0000","last_peered":"2024-03-31T23:17:42.791381+0000","last_clean":"2024-03-31T23:17:42.791381+0000","last_became_active":"2024-03-31T23:15:38.171373+0000","last_became_peered":"2024-03-31T23:15:38.171373+0000","last_unstale":"2024-03-31T23:17:42.791381+0000","last_undegraded":"2024-03-31T23:17:42.791381+0000","last_fullsized":"2024-03-31T23:17:42.791381+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:05:43.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374029+0000","last_change":"2024-03-31T23:15:32.833046+0000","last_active":"2024-03-31T23:17:43.374029+0000","last_peered":"2024-03-31T23:17:43.374029+0000","last_clean":"2024-03-31T23:17:43.374029+0000","last_became_active":"2024-03-31T23:15:32.832610+0000","last_became_peered":"2024-03-31T23:15:32.832610+0000","last_unstale":"2024-03-31T23:17:43.374029+0000","last_undegraded":"2024-03-31T23:17:43.374029+0000","last_fullsized":"2024-03-31T23:17:43.374029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:26:40.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644171+0000","last_change":"2024-03-31T23:15:33.846659+0000","last_active":"2024-03-31T23:17:42.644171+0000","last_peered":"2024-03-31T23:17:42.644171+0000","last_clean":"2024-03-31T23:17:42.644171+0000","last_became_active":"2024-03-31T23:15:33.846217+0000","last_became_peered":"2024-03-31T23:15:33.846217+0000","last_unstale":"2024-03-31T23:17:42.644171+0000","last_undegraded":"2024-03-31T23:17:42.644171+0000","last_fullsized":"2024-03-31T23:17:42.644171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:42:08.696109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645029+0000","last_change":"2024-03-31T23:15:38.173356+0000","last_active":"2024-03-31T23:17:42.645029+0000","last_peered":"2024-03-31T23:17:42.645029+0000","last_clean":"2024-03-31T23:17:42.645029+0000","last_became_active":"2024-03-31T23:15:38.172898+0000","last_became_peered":"2024-03-31T23:15:38.172898+0000","last_unstale":"2024-03-31T23:17:42.645029+0000","last_undegraded":"2024-03-31T23:17:42.645029+0000","last_fullsized":"2024-03-31T23:17:42.645029+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:40:12.084123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.600500+0000","last_change":"2024-03-31T23:15:32.832512+0000","last_active":"2024-03-31T23:17:43.600500+0000","last_peered":"2024-03-31T23:17:43.600500+0000","last_clean":"2024-03-31T23:17:43.600500+0000","last_became_active":"2024-03-31T23:15:32.832138+0000","last_became_peered":"2024-03-31T23:15:32.832138+0000","last_unstale":"2024-03-31T23:17:43.600500+0000","last_undegraded":"2024-03-31T23:17:43.600500+0000","last_fullsized":"2024-03-31T23:17:43.600500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:02.124400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645913+0000","last_change":"2024-03-31T23:15:33.840947+0000","last_active":"2024-03-31T23:17:42.645913+0000","last_peered":"2024-03-31T23:17:42.645913+0000","last_clean":"2024-03-31T23:17:42.645913+0000","last_became_active":"2024-03-31T23:15:33.839419+0000","last_became_peered":"2024-03-31T23:15:33.839419+0000","last_unstale":"2024-03-31T23:17:42.645913+0000","last_undegraded":"2024-03-31T23:17:42.645913+0000","last_fullsized":"2024-03-31T23:17:42.645913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:02.025534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790772+0000","last_change":"2024-03-31T23:15:38.166464+0000","last_active":"2024-03-31T23:17:42.790772+0000","last_peered":"2024-03-31T23:17:42.790772+0000","last_clean":"2024-03-31T23:17:42.790772+0000","last_became_active":"2024-03-31T23:15:38.166052+0000","last_became_peered":"2024-03-31T23:15:38.166052+0000","last_unstale":"2024-03-31T23:17:42.790772+0000","last_undegraded":"2024-03-31T23:17:42.790772+0000","last_fullsized":"2024-03-31T23:17:42.790772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:33:33.380444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644625+0000","last_change":"2024-03-31T23:15:32.843909+0000","last_active":"2024-03-31T23:17:42.644625+0000","last_peered":"2024-03-31T23:17:42.644625+0000","last_clean":"2024-03-31T23:17:42.644625+0000","last_became_active":"2024-03-31T23:15:32.843562+0000","last_became_peered":"2024-03-31T23:15:32.843562+0000","last_unstale":"2024-03-31T23:17:42.644625+0000","last_undegraded":"2024-03-31T23:17:42.644625+0000","last_fullsized":"2024-03-31T23:17:42.644625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:27:05.678390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791595+0000","last_change":"2024-03-31T23:16:42.479778+0000","last_active":"2024-03-31T23:17:42.791595+0000","last_peered":"2024-03-31T23:17:42.791595+0000","last_clean":"2024-03-31T23:17:42.791595+0000","last_became_active":"2024-03-31T23:16:42.479401+0000","last_became_peered":"2024-03-31T23:16:42.479401+0000","last_unstale":"2024-03-31T23:17:42.791595+0000","last_undegraded":"2024-03-31T23:17:42.791595+0000","last_fullsized":"2024-03-31T23:17:42.791595+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:01:58.138818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644321+0000","last_change":"2024-03-31T23:15:38.174447+0000","last_active":"2024-03-31T23:17:42.644321+0000","last_peered":"2024-03-31T23:17:42.644321+0000","last_clean":"2024-03-31T23:17:42.644321+0000","last_became_active":"2024-03-31T23:15:38.174052+0000","last_became_peered":"2024-03-31T23:15:38.174052+0000","last_unstale":"2024-03-31T23:17:42.644321+0000","last_undegraded":"2024-03-31T23:17:42.644321+0000","last_fullsized":"2024-03-31T23:17:42.644321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:33.984027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648541+0000","last_change":"2024-03-31T23:15:32.828494+0000","last_active":"2024-03-31T23:17:42.648541+0000","last_peered":"2024-03-31T23:17:42.648541+0000","last_clean":"2024-03-31T23:17:42.648541+0000","last_became_active":"2024-03-31T23:15:32.828183+0000","last_became_peered":"2024-03-31T23:15:32.828183+0000","last_unstale":"2024-03-31T23:17:42.648541+0000","last_undegraded":"2024-03-31T23:17:42.648541+0000","last_fullsized":"2024-03-31T23:17:42.648541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:05.298832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373522+0000","last_change":"2024-03-31T23:15:33.836514+0000","last_active":"2024-03-31T23:17:43.373522+0000","last_peered":"2024-03-31T23:17:43.373522+0000","last_clean":"2024-03-31T23:17:43.373522+0000","last_became_active":"2024-03-31T23:15:33.835980+0000","last_became_peered":"2024-03-31T23:15:33.835980+0000","last_unstale":"2024-03-31T23:17:43.373522+0000","last_undegraded":"2024-03-31T23:17:43.373522+0000","last_fullsized":"2024-03-31T23:17:43.373522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:34:20.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.374228+0000","last_change":"2024-03-31T23:16:42.483336+0000","last_active":"2024-03-31T23:17:43.374228+0000","last_peered":"2024-03-31T23:17:43.374228+0000","last_clean":"2024-03-31T23:17:43.374228+0000","last_became_active":"2024-03-31T23:16:42.482909+0000","last_became_peered":"2024-03-31T23:16:42.482909+0000","last_unstale":"2024-03-31T23:17:43.374228+0000","last_undegraded":"2024-03-31T23:17:43.374228+0000","last_fullsized":"2024-03-31T23:17:43.374228+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:38:02.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645179+0000","last_change":"2024-03-31T23:15:32.838121+0000","last_active":"2024-03-31T23:17:42.645179+0000","last_peered":"2024-03-31T23:17:42.645179+0000","last_clean":"2024-03-31T23:17:42.645179+0000","last_became_active":"2024-03-31T23:15:32.837575+0000","last_became_peered":"2024-03-31T23:15:32.837575+0000","last_unstale":"2024-03-31T23:17:42.645179+0000","last_undegraded":"2024-03-31T23:17:42.645179+0000","last_fullsized":"2024-03-31T23:17:42.645179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:07:54.195108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790666+0000","last_change":"2024-03-31T23:15:33.845912+0000","last_active":"2024-03-31T23:17:42.790666+0000","last_peered":"2024-03-31T23:17:42.790666+0000","last_clean":"2024-03-31T23:17:42.790666+0000","last_became_active":"2024-03-31T23:15:33.845568+0000","last_became_peered":"2024-03-31T23:15:33.845568+0000","last_unstale":"2024-03-31T23:17:42.790666+0000","last_undegraded":"2024-03-31T23:17:42.790666+0000","last_fullsized":"2024-03-31T23:17:42.790666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.373204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644223+0000","last_change":"2024-03-31T23:15:38.182178+0000","last_active":"2024-03-31T23:17:42.644223+0000","last_peered":"2024-03-31T23:17:42.644223+0000","last_clean":"2024-03-31T23:17:42.644223+0000","last_became_active":"2024-03-31T23:15:38.181755+0000","last_became_peered":"2024-03-31T23:15:38.181755+0000","last_unstale":"2024-03-31T23:17:42.644223+0000","last_undegraded":"2024-03-31T23:17:42.644223+0000","last_fullsized":"2024-03-31T23:17:42.644223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:11.243818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790630+0000","last_change":"2024-03-31T23:16:42.489599+0000","last_active":"2024-03-31T23:17:42.790630+0000","last_peered":"2024-03-31T23:17:42.790630+0000","last_clean":"2024-03-31T23:17:42.790630+0000","last_became_active":"2024-03-31T23:16:42.483090+0000","last_became_peered":"2024-03-31T23:16:42.483090+0000","last_unstale":"2024-03-31T23:17:42.790630+0000","last_undegraded":"2024-03-31T23:17:42.790630+0000","last_fullsized":"2024-03-31T23:17:42.790630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:31:32.544161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645995+0000","last_change":"2024-03-31T23:15:33.851682+0000","last_active":"2024-03-31T23:17:42.645995+0000","last_peered":"2024-03-31T23:17:42.645995+0000","last_clean":"2024-03-31T23:17:42.645995+0000","last_became_active":"2024-03-31T23:15:33.850349+0000","last_became_peered":"2024-03-31T23:15:33.850349+0000","last_unstale":"2024-03-31T23:17:42.645995+0000","last_undegraded":"2024-03-31T23:17:42.645995+0000","last_fullsized":"2024-03-31T23:17:42.645995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:46:02.572330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644229+0000","last_change":"2024-03-31T23:15:38.173238+0000","last_active":"2024-03-31T23:17:42.644229+0000","last_peered":"2024-03-31T23:17:42.644229+0000","last_clean":"2024-03-31T23:17:42.644229+0000","last_became_active":"2024-03-31T23:15:38.172766+0000","last_became_peered":"2024-03-31T23:15:38.172766+0000","last_unstale":"2024-03-31T23:17:42.644229+0000","last_undegraded":"2024-03-31T23:17:42.644229+0000","last_fullsized":"2024-03-31T23:17:42.644229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:54.089570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:43.373779+0000","last_change":"2024-03-31T23:15:32.844693+0000","last_active":"2024-03-31T23:17:43.373779+0000","last_peered":"2024-03-31T23:17:43.373779+0000","last_clean":"2024-03-31T23:17:43.373779+0000","last_became_active":"2024-03-31T23:15:32.843958+0000","last_became_peered":"2024-03-31T23:15:32.843958+0000","last_unstale":"2024-03-31T23:17:43.373779+0000","last_undegraded":"2024-03-31T23:17:43.373779+0000","last_fullsized":"2024-03-31T23:17:43.373779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:34:55.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647593+0000","last_change":"2024-03-31T23:15:33.841458+0000","last_active":"2024-03-31T23:17:42.647593+0000","last_peered":"2024-03-31T23:17:42.647593+0000","last_clean":"2024-03-31T23:17:42.647593+0000","last_became_active":"2024-03-31T23:15:33.841147+0000","last_became_peered":"2024-03-31T23:15:33.841147+0000","last_unstale":"2024-03-31T23:17:42.647593+0000","last_undegraded":"2024-03-31T23:17:42.647593+0000","last_fullsized":"2024-03-31T23:17:42.647593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:39:35.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648943+0000","last_change":"2024-03-31T23:15:38.175393+0000","last_active":"2024-03-31T23:17:42.648943+0000","last_peered":"2024-03-31T23:17:42.648943+0000","last_clean":"2024-03-31T23:17:42.648943+0000","last_became_active":"2024-03-31T23:15:38.174980+0000","last_became_peered":"2024-03-31T23:15:38.174980+0000","last_unstale":"2024-03-31T23:17:42.648943+0000","last_undegraded":"2024-03-31T23:17:42.648943+0000","last_fullsized":"2024-03-31T23:17:42.648943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:05:59.555634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'7","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:53.383753+0000","last_change":"2024-03-31T23:15:32.835915+0000","last_active":"2024-03-31T23:17:53.383753+0000","last_peered":"2024-03-31T23:17:53.383753+0000","last_clean":"2024-03-31T23:17:53.383753+0000","last_became_active":"2024-03-31T23:15:32.835571+0000","last_became_peered":"2024-03-31T23:15:32.835571+0000","last_unstale":"2024-03-31T23:17:53.383753+0000","last_undegraded":"2024-03-31T23:17:53.383753+0000","last_fullsized":"2024-03-31T23:17:53.383753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:38:30.925554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647801+0000","last_change":"2024-03-31T23:15:33.848836+0000","last_active":"2024-03-31T23:17:42.647801+0000","last_peered":"2024-03-31T23:17:42.647801+0000","last_clean":"2024-03-31T23:17:42.647801+0000","last_became_active":"2024-03-31T23:15:33.848495+0000","last_became_peered":"2024-03-31T23:15:33.848495+0000","last_unstale":"2024-03-31T23:17:42.647801+0000","last_undegraded":"2024-03-31T23:17:42.647801+0000","last_fullsized":"2024-03-31T23:17:42.647801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:19:36.922177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790881+0000","last_change":"2024-03-31T23:15:38.169480+0000","last_active":"2024-03-31T23:17:42.790881+0000","last_peered":"2024-03-31T23:17:42.790881+0000","last_clean":"2024-03-31T23:17:42.790881+0000","last_became_active":"2024-03-31T23:15:38.168978+0000","last_became_peered":"2024-03-31T23:15:38.168978+0000","last_unstale":"2024-03-31T23:17:42.790881+0000","last_undegraded":"2024-03-31T23:17:42.790881+0000","last_fullsized":"2024-03-31T23:17:42.790881+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:05:07.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646717+0000","last_change":"2024-03-31T23:15:32.842078+0000","last_active":"2024-03-31T23:17:42.646717+0000","last_peered":"2024-03-31T23:17:42.646717+0000","last_clean":"2024-03-31T23:17:42.646717+0000","last_became_active":"2024-03-31T23:15:32.841707+0000","last_became_peered":"2024-03-31T23:15:32.841707+0000","last_unstale":"2024-03-31T23:17:42.646717+0000","last_undegraded":"2024-03-31T23:17:42.646717+0000","last_fullsized":"2024-03-31T23:17:42.646717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:42:46.973756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.793479+0000","last_change":"2024-03-31T23:17:42.793114+0000","last_active":"2024-03-31T23:17:42.793479+0000","last_peered":"2024-03-31T23:17:42.793479+0000","last_clean":"2024-03-31T23:17:42.793479+0000","last_became_active":"2024-03-31T23:17:42.792584+0000","last_became_peered":"2024-03-31T23:17:42.792584+0000","last_unstale":"2024-03-31T23:17:42.793479+0000","last_undegraded":"2024-03-31T23:17:42.793479+0000","last_fullsized":"2024-03-31T23:17:42.793479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:55:22.779316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645834+0000","last_change":"2024-03-31T23:15:38.166367+0000","last_active":"2024-03-31T23:17:42.645834+0000","last_peered":"2024-03-31T23:17:42.645834+0000","last_clean":"2024-03-31T23:17:42.645834+0000","last_became_active":"2024-03-31T23:15:38.165927+0000","last_became_peered":"2024-03-31T23:15:38.165927+0000","last_unstale":"2024-03-31T23:17:42.645834+0000","last_undegraded":"2024-03-31T23:17:42.645834+0000","last_fullsized":"2024-03-31T23:17:42.645834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:37.143218+0000","last_clean_scrub_stamp":"2024-03-31T23:15:37.143218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:08:54.651224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644349+0000","last_change":"2024-03-31T23:15:32.843227+0000","last_active":"2024-03-31T23:17:42.644349+0000","last_peered":"2024-03-31T23:17:42.644349+0000","last_clean":"2024-03-31T23:17:42.644349+0000","last_became_active":"2024-03-31T23:15:32.842851+0000","last_became_peered":"2024-03-31T23:15:32.842851+0000","last_unstale":"2024-03-31T23:17:42.644349+0000","last_undegraded":"2024-03-31T23:17:42.644349+0000","last_fullsized":"2024-03-31T23:17:42.644349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:31.809212+0000","last_clean_scrub_stamp":"2024-03-31T23:15:31.809212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:27:48.335694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.647903+0000","last_change":"2024-03-31T23:15:33.834671+0000","last_active":"2024-03-31T23:17:42.647903+0000","last_peered":"2024-03-31T23:17:42.647903+0000","last_clean":"2024-03-31T23:17:42.647903+0000","last_became_active":"2024-03-31T23:15:33.834350+0000","last_became_peered":"2024-03-31T23:15:33.834350+0000","last_unstale":"2024-03-31T23:17:42.647903+0000","last_undegraded":"2024-03-31T23:17:42.647903+0000","last_fullsized":"2024-03-31T23:17:42.647903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:20:24.329429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790673+0000","last_change":"2024-03-31T23:15:33.845308+0000","last_active":"2024-03-31T23:17:42.790673+0000","last_peered":"2024-03-31T23:17:42.790673+0000","last_clean":"2024-03-31T23:17:42.790673+0000","last_became_active":"2024-03-31T23:15:33.844995+0000","last_became_peered":"2024-03-31T23:15:33.844995+0000","last_unstale":"2024-03-31T23:17:42.790673+0000","last_undegraded":"2024-03-31T23:17:42.790673+0000","last_fullsized":"2024-03-31T23:17:42.790673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:52:51.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791180+0000","last_change":"2024-03-31T23:15:33.848648+0000","last_active":"2024-03-31T23:17:42.791180+0000","last_peered":"2024-03-31T23:17:42.791180+0000","last_clean":"2024-03-31T23:17:42.791180+0000","last_became_active":"2024-03-31T23:15:33.848293+0000","last_became_peered":"2024-03-31T23:15:33.848293+0000","last_unstale":"2024-03-31T23:17:42.791180+0000","last_undegraded":"2024-03-31T23:17:42.791180+0000","last_fullsized":"2024-03-31T23:17:42.791180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:41:15.272919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.790746+0000","last_change":"2024-03-31T23:15:33.849871+0000","last_active":"2024-03-31T23:17:42.790746+0000","last_peered":"2024-03-31T23:17:42.790746+0000","last_clean":"2024-03-31T23:17:42.790746+0000","last_became_active":"2024-03-31T23:15:33.849515+0000","last_became_peered":"2024-03-31T23:15:33.849515+0000","last_unstale":"2024-03-31T23:17:42.790746+0000","last_undegraded":"2024-03-31T23:17:42.790746+0000","last_fullsized":"2024-03-31T23:17:42.790746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:52:59.601157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791088+0000","last_change":"2024-03-31T23:16:42.480375+0000","last_active":"2024-03-31T23:17:42.791088+0000","last_peered":"2024-03-31T23:17:42.791088+0000","last_clean":"2024-03-31T23:17:42.791088+0000","last_became_active":"2024-03-31T23:16:42.480005+0000","last_became_peered":"2024-03-31T23:16:42.480005+0000","last_unstale":"2024-03-31T23:17:42.791088+0000","last_undegraded":"2024-03-31T23:17:42.791088+0000","last_fullsized":"2024-03-31T23:17:42.791088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:31:15.217708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644114+0000","last_change":"2024-03-31T23:15:33.842181+0000","last_active":"2024-03-31T23:17:42.644114+0000","last_peered":"2024-03-31T23:17:42.644114+0000","last_clean":"2024-03-31T23:17:42.644114+0000","last_became_active":"2024-03-31T23:15:33.841555+0000","last_became_peered":"2024-03-31T23:15:33.841555+0000","last_unstale":"2024-03-31T23:17:42.644114+0000","last_undegraded":"2024-03-31T23:17:42.644114+0000","last_fullsized":"2024-03-31T23:17:42.644114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:36:45.804423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791722+0000","last_change":"2024-03-31T23:15:33.839153+0000","last_active":"2024-03-31T23:17:42.791722+0000","last_peered":"2024-03-31T23:17:42.791722+0000","last_clean":"2024-03-31T23:17:42.791722+0000","last_became_active":"2024-03-31T23:15:33.838793+0000","last_became_peered":"2024-03-31T23:15:33.838793+0000","last_unstale":"2024-03-31T23:17:42.791722+0000","last_undegraded":"2024-03-31T23:17:42.791722+0000","last_fullsized":"2024-03-31T23:17:42.791722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:11:38.903681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791259+0000","last_change":"2024-03-31T23:15:33.852065+0000","last_active":"2024-03-31T23:17:42.791259+0000","last_peered":"2024-03-31T23:17:42.791259+0000","last_clean":"2024-03-31T23:17:42.791259+0000","last_became_active":"2024-03-31T23:15:33.851359+0000","last_became_peered":"2024-03-31T23:15:33.851359+0000","last_unstale":"2024-03-31T23:17:42.791259+0000","last_undegraded":"2024-03-31T23:17:42.791259+0000","last_fullsized":"2024-03-31T23:17:42.791259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:31:43.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646100+0000","last_change":"2024-03-31T23:15:33.852720+0000","last_active":"2024-03-31T23:17:42.646100+0000","last_peered":"2024-03-31T23:17:42.646100+0000","last_clean":"2024-03-31T23:17:42.646100+0000","last_became_active":"2024-03-31T23:15:33.847178+0000","last_became_peered":"2024-03-31T23:15:33.847178+0000","last_unstale":"2024-03-31T23:17:42.646100+0000","last_undegraded":"2024-03-31T23:17:42.646100+0000","last_fullsized":"2024-03-31T23:17:42.646100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:03:43.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.646019+0000","last_change":"2024-03-31T23:15:33.844276+0000","last_active":"2024-03-31T23:17:42.646019+0000","last_peered":"2024-03-31T23:17:42.646019+0000","last_clean":"2024-03-31T23:17:42.646019+0000","last_became_active":"2024-03-31T23:15:33.843940+0000","last_became_peered":"2024-03-31T23:15:33.843940+0000","last_unstale":"2024-03-31T23:17:42.646019+0000","last_undegraded":"2024-03-31T23:17:42.646019+0000","last_fullsized":"2024-03-31T23:17:42.646019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:10.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.645158+0000","last_change":"2024-03-31T23:15:33.852752+0000","last_active":"2024-03-31T23:17:42.645158+0000","last_peered":"2024-03-31T23:17:42.645158+0000","last_clean":"2024-03-31T23:17:42.645158+0000","last_became_active":"2024-03-31T23:15:33.850800+0000","last_became_peered":"2024-03-31T23:15:33.850800+0000","last_unstale":"2024-03-31T23:17:42.645158+0000","last_undegraded":"2024-03-31T23:17:42.645158+0000","last_fullsized":"2024-03-31T23:17:42.645158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:21:41.965385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.648905+0000","last_change":"2024-03-31T23:15:33.844266+0000","last_active":"2024-03-31T23:17:42.648905+0000","last_peered":"2024-03-31T23:17:42.648905+0000","last_clean":"2024-03-31T23:17:42.648905+0000","last_became_active":"2024-03-31T23:15:33.843927+0000","last_became_peered":"2024-03-31T23:15:33.843927+0000","last_unstale":"2024-03-31T23:17:42.648905+0000","last_undegraded":"2024-03-31T23:17:42.648905+0000","last_fullsized":"2024-03-31T23:17:42.648905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:03:18.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.644318+0000","last_change":"2024-03-31T23:15:33.836079+0000","last_active":"2024-03-31T23:17:42.644318+0000","last_peered":"2024-03-31T23:17:42.644318+0000","last_clean":"2024-03-31T23:17:42.644318+0000","last_became_active":"2024-03-31T23:15:33.834387+0000","last_became_peered":"2024-03-31T23:15:33.834387+0000","last_unstale":"2024-03-31T23:17:42.644318+0000","last_undegraded":"2024-03-31T23:17:42.644318+0000","last_fullsized":"2024-03-31T23:17:42.644318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:59:28.887840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-03-31T23:17:42.791498+0000","last_change":"2024-03-31T23:15:33.839983+0000","last_active":"2024-03-31T23:17:42.791498+0000","last_peered":"2024-03-31T23:17:42.791498+0000","last_clean":"2024-03-31T23:17:42.791498+0000","last_became_active":"2024-03-31T23:15:33.839431+0000","last_became_peered":"2024-03-31T23:15:33.839431+0000","last_unstale":"2024-03-31T23:17:42.791498+0000","last_undegraded":"2024-03-31T23:17:42.791498+0000","last_fullsized":"2024-03-31T23:17:42.791498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T23:15:32.814073+0000","last_clean_scrub_stamp":"2024-03-31T23:15:32.814073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:37:21.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246124,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77612,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1184,"num_read_kb":669,"num_write":261,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":232836,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":520753,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1171460,"data_compressed":64039,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":524225,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":520485,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1101824,"data_stored":1117985,"data_compressed":62432,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":515941,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":586257,"data_compressed":28176,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":517621,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":581860,"data_compressed":28176,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":515341,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":520239,"data_compressed":26569,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":1112727,"data_compressed":62432,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34224,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35863,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71346,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72322,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":71554,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T23:17:59.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3032556501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48102220 msgr2=0x7efe48108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3032556501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48102220 0x7efe48108ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe40009ca0 tx=0x7efe4002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3032556501 shutdown_connections 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3032556501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48102220 0x7efe48108ab0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3032556501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe48101860 0x7efe48101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3032556501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe48100670 0x7efe48100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3032556501 >> 172.21.15.42:0/3032556501 conn(0x7efe480fbbe0 msgr2=0x7efe480fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3032556501 shutdown_connections 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3032556501 wait complete. 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 Processor -- start 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- start start 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 0x7efe48104600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe48101860 0x7efe48102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe48102220 0x7efe48103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe4810c410 con 0x7efe48100670 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efe4810c290 con 0x7efe48102220 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.489+0000 7efe4fb2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efe4810c590 con 0x7efe48101860 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 0x7efe48104600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 0x7efe48104600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59592/0 (socket says 172.21.15.42:59592) 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 -- 172.21.15.42:0/3749359653 learned_addr learned my addr 172.21.15.42:0/3749359653 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d0c7640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe48101860 0x7efe48102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4e0c9640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe48102220 0x7efe48103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 -- 172.21.15.42:0/3749359653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe48101860 msgr2=0x7efe48102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe48101860 0x7efe48102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 -- 172.21.15.42:0/3749359653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe48102220 msgr2=0x7efe48103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe48102220 0x7efe48103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 -- 172.21.15.42:0/3749359653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe48103a10 con 0x7efe48100670 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4d8c8640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 0x7efe48104600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e9c0 tx=0x7efe4400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4400cde0 con 0x7efe48100670 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efe44010930 con 0x7efe48100670 2024-03-31T23:17:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe481a1c00 con 0x7efe48100670 2024-03-31T23:17:59.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44018a70 con 0x7efe48100670 2024-03-31T23:17:59.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.490+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe481a2150 con 0x7efe48100670 2024-03-31T23:17:59.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.491+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe481a2320 con 0x7efe48100670 2024-03-31T23:17:59.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.492+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7efe44018c50 con 0x7efe48100670 2024-03-31T23:17:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.493+0000 7efe3effd640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efe340a24a0 0x7efe340a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.493+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7efe440cf030 con 0x7efe48100670 2024-03-31T23:17:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.493+0000 7efe4d0c7640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efe340a24a0 0x7efe340a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.493+0000 7efe4d0c7640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efe340a24a0 0x7efe340a4960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe48104370 tx=0x7efe38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:59.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.497+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efe44053280 con 0x7efe48100670 2024-03-31T23:17:59.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.680+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe481a2a70 con 0x7efe48100670 2024-03-31T23:17:59.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.682+0000 7efe3effd640 1 -- 172.21.15.42:0/3749359653 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7efe4409be60 con 0x7efe48100670 2024-03-31T23:17:59.683 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:17:59.683 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efe340a24a0 msgr2=0x7efe340a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efe340a24a0 0x7efe340a4960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe48104370 tx=0x7efe38005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 msgr2=0x7efe48104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 0x7efe48104600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e9c0 tx=0x7efe4400ee80 comp rx=0 tx=0).stop 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 shutdown_connections 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe48102220 0x7efe48103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe48101860 0x7efe48102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7efe340a24a0 0x7efe340a4960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 --2- 172.21.15.42:0/3749359653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe48100670 0x7efe48104600 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 >> 172.21.15.42:0/3749359653 conn(0x7efe480fbbe0 msgr2=0x7efe480fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:59.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 shutdown_connections 2024-03-31T23:17:59.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.684+0000 7efe4fb2c640 1 -- 172.21.15.42:0/3749359653 wait complete. 2024-03-31T23:17:59.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:17:59.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:17:59.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 -- 172.21.15.42:0/281485309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760102940 msgr2=0x7fe760102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 --2- 172.21.15.42:0/281485309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760102940 0x7fe760102dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe754009900 tx=0x7fe75402bc30 comp rx=0 tx=0).stop 2024-03-31T23:17:59.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 -- 172.21.15.42:0/281485309 shutdown_connections 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 --2- 172.21.15.42:0/281485309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe760103300 0x7fe760109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 --2- 172.21.15.42:0/281485309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760102940 0x7fe760102dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 --2- 172.21.15.42:0/281485309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe760101750 0x7fe760101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 -- 172.21.15.42:0/281485309 >> 172.21.15.42:0/281485309 conn(0x7fe7600fcce0 msgr2=0x7fe7600ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 -- 172.21.15.42:0/281485309 shutdown_connections 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.802+0000 7fe767325640 1 -- 172.21.15.42:0/281485309 wait complete. 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 Processor -- start 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 -- start start 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe760101750 0x7fe760197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe760102940 0x7fe760197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 0x7fe76019f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe76010d4b0 con 0x7fe760103300 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe76010d330 con 0x7fe760102940 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe767325640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe76010d630 con 0x7fe760101750 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 0x7fe76019f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 0x7fe76019f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59616/0 (socket says 172.21.15.42:59616) 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 -- 172.21.15.42:0/94618699 learned_addr learned my addr 172.21.15.42:0/94618699 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7648c0640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe760102940 0x7fe760197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7650c1640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe760101750 0x7fe760197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 -- 172.21.15.42:0/94618699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe760101750 msgr2=0x7fe760197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe760101750 0x7fe760197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 -- 172.21.15.42:0/94618699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe760102940 msgr2=0x7fe760197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe760102940 0x7fe760197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.803+0000 7fe7658c2640 1 -- 172.21.15.42:0/94618699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76019f6c0 con 0x7fe760103300 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.804+0000 7fe7658c2640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 0x7fe76019f050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe75000eb10 tx=0x7fe75000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.804+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750004b20 con 0x7fe760103300 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.804+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76019f9b0 con 0x7fe760103300 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.804+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe750004cc0 con 0x7fe760103300 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.804+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500107f0 con 0x7fe760103300 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.804+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76019ff20 con 0x7fe760103300 2024-03-31T23:17:59.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.805+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe760108a70 con 0x7fe760103300 2024-03-31T23:17:59.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.806+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fe750005000 con 0x7fe760103300 2024-03-31T23:17:59.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.806+0000 7fe75e7fc640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe7480a24a0 0x7fe7480a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:17:59.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.807+0000 7fe7650c1640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe7480a24a0 0x7fe7480a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:17:59.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.807+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fe7500cf220 con 0x7fe760103300 2024-03-31T23:17:59.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.807+0000 7fe7650c1640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe7480a24a0 0x7fe7480a4960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe7601027a0 tx=0x7fe758005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:17:59.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.810+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe750053280 con 0x7fe760103300 2024-03-31T23:17:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:59 smithi188 ceph-mon[36068]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:17:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:17:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3749359653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:17:59.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.991+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe76002d170 con 0x7fe760103300 2024-03-31T23:17:59.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.992+0000 7fe75e7fc640 1 -- 172.21.15.42:0/94618699 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7fe75009bff0 con 0x7fe760103300 2024-03-31T23:17:59.992 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe7480a24a0 msgr2=0x7fe7480a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe7480a24a0 0x7fe7480a4960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe7601027a0 tx=0x7fe758005f90 comp rx=0 tx=0).stop 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 msgr2=0x7fe76019f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 0x7fe76019f050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe75000eb10 tx=0x7fe75000c2d0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 shutdown_connections 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fe7480a24a0 0x7fe7480a4960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe760103300 0x7fe76019f050 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe760102940 0x7fe760197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 --2- 172.21.15.42:0/94618699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe760101750 0x7fe760197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 >> 172.21.15.42:0/94618699 conn(0x7fe7600fcce0 msgr2=0x7fe760105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:17:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 shutdown_connections 2024-03-31T23:17:59.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:17:59.994+0000 7fe767325640 1 -- 172.21.15.42:0/94618699 wait complete. 2024-03-31T23:18:00.005 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:59 smithi042 ceph-mon[32380]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:00.005 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:17:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3749359653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:18:00.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 -- 172.21.15.42:0/906797268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 msgr2=0x7f497c108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 --2- 172.21.15.42:0/906797268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c108b30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ca0 tx=0x7f497402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 -- 172.21.15.42:0/906797268 shutdown_connections 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 --2- 172.21.15.42:0/906797268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c108b30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 --2- 172.21.15.42:0/906797268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f497c1018e0 0x7f497c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 --2- 172.21.15.42:0/906797268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f497c1006f0 0x7f497c100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 -- 172.21.15.42:0/906797268 >> 172.21.15.42:0/906797268 conn(0x7f497c0fbc60 msgr2=0x7f497c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 -- 172.21.15.42:0/906797268 shutdown_connections 2024-03-31T23:18:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.111+0000 7f4980bd6640 1 -- 172.21.15.42:0/906797268 wait complete. 2024-03-31T23:18:00.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 Processor -- start 2024-03-31T23:18:00.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 -- start start 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f497c1006f0 0x7f497c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f497c1018e0 0x7f497c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f497c10c430 con 0x7f497c1022a0 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f497c10c2b0 con 0x7f497c1018e0 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4980bd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f497c10c5b0 con 0x7f497c1006f0 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c1a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59644/0 (socket says 172.21.15.42:59644) 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 -- 172.21.15.42:0/3405694165 learned_addr learned my addr 172.21.15.42:0/3405694165 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497a59c640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f497c1006f0 0x7f497c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f4979d9b640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f497c1018e0 0x7f497c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 -- 172.21.15.42:0/3405694165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f497c1006f0 msgr2=0x7f497c199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f497c1006f0 0x7f497c199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 -- 172.21.15.42:0/3405694165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f497c1018e0 msgr2=0x7f497c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f497c1018e0 0x7f497c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 -- 172.21.15.42:0/3405694165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c1a19b0 con 0x7f497c1022a0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f497ad9d640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c1a1310 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f497402c700 tx=0x7f49740346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.112+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974039040 con 0x7f497c1022a0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.113+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4974044070 con 0x7f497c1022a0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.113+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c1a1c40 con 0x7f497c1022a0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.113+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740043c0 con 0x7f497c1022a0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.113+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1a2130 con 0x7f497c1022a0 2024-03-31T23:18:00.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.114+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c1a2300 con 0x7f497c1022a0 2024-03-31T23:18:00.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.115+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f4974004580 con 0x7f497c1022a0 2024-03-31T23:18:00.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.115+0000 7f496b7fe640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f49640a24a0 0x7f49640a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.115+0000 7f497a59c640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f49640a24a0 0x7f49640a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.115+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f49740f1210 con 0x7f497c1022a0 2024-03-31T23:18:00.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.115+0000 7f497a59c640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f49640a24a0 0x7f49640a4960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f497c19b270 tx=0x7f496c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:00.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.120+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f49740be040 con 0x7f497c1022a0 2024-03-31T23:18:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:59 smithi094 ceph-mon[36167]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:17:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3749359653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:18:00.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.301+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f497c1a24d0 con 0x7f497c1022a0 2024-03-31T23:18:00.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.302+0000 7f496b7fe640 1 -- 172.21.15.42:0/3405694165 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f49740bd940 con 0x7f497c1022a0 2024-03-31T23:18:00.303 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f49640a24a0 msgr2=0x7f49640a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f49640a24a0 0x7f49640a4960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f497c19b270 tx=0x7f496c005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 msgr2=0x7f497c1a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c1a1310 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f497402c700 tx=0x7f49740346d0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 shutdown_connections 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f49640a24a0 0x7f49640a4960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f497c1022a0 0x7f497c1a1310 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f497c1018e0 0x7f497c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 --2- 172.21.15.42:0/3405694165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f497c1006f0 0x7f497c199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 >> 172.21.15.42:0/3405694165 conn(0x7f497c0fbc60 msgr2=0x7f497c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:00.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 shutdown_connections 2024-03-31T23:18:00.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.304+0000 7f4980bd6640 1 -- 172.21.15.42:0/3405694165 wait complete. 2024-03-31T23:18:00.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 -- 172.21.15.42:0/1978354511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 msgr2=0x7fb258102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/1978354511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258102dc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb240009900 tx=0x7fb24002bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 -- 172.21.15.42:0/1978354511 shutdown_connections 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/1978354511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb258103300 0x7fb258109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/1978354511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258102dc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/1978354511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb258101750 0x7fb258101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 -- 172.21.15.42:0/1978354511 >> 172.21.15.42:0/1978354511 conn(0x7fb2580fccc0 msgr2=0x7fb2580ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:00.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 -- 172.21.15.42:0/1978354511 shutdown_connections 2024-03-31T23:18:00.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.421+0000 7fb25cbf6640 1 -- 172.21.15.42:0/1978354511 wait complete. 2024-03-31T23:18:00.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 Processor -- start 2024-03-31T23:18:00.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 -- start start 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb258101750 0x7fb258197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb258103300 0x7fb25819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb25810d4b0 con 0x7fb258102940 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb25810d330 con 0x7fb258101750 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25cbf6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb25810d630 con 0x7fb258103300 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59668/0 (socket says 172.21.15.42:59668) 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 -- 172.21.15.42:0/3029917231 learned_addr learned my addr 172.21.15.42:0/3029917231 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb256d9d640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb258103300 0x7fb25819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb25659c640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb258101750 0x7fb258197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 -- 172.21.15.42:0/3029917231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb258103300 msgr2=0x7fb25819f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb258103300 0x7fb25819f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 -- 172.21.15.42:0/3029917231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb258101750 msgr2=0x7fb258197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb258101750 0x7fb258197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.422+0000 7fb24dd9b640 1 -- 172.21.15.42:0/3029917231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25819f720 con 0x7fb258102940 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.423+0000 7fb24dd9b640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258198040 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb240009230 tx=0x7fb240004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.423+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240043020 con 0x7fb258102940 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.423+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb240004250 con 0x7fb258102940 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.423+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25819f9b0 con 0x7fb258102940 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.423+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240003b50 con 0x7fb258102940 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.423+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25819ff00 con 0x7fb258102940 2024-03-31T23:18:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.424+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb258068990 con 0x7fb258102940 2024-03-31T23:18:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.425+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fb240046020 con 0x7fb258102940 2024-03-31T23:18:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.425+0000 7fb24ffff640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb2440a24a0 0x7fb2440a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.426+0000 7fb25659c640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb2440a24a0 0x7fb2440a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.426+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fb2400f0ba0 con 0x7fb258102940 2024-03-31T23:18:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.426+0000 7fb25659c640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb2440a24a0 0x7fb2440a4960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2480095f0 tx=0x7fb248005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:00.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.430+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb24004d020 con 0x7fb258102940 2024-03-31T23:18:00.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.612+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb258062350 con 0x7fb258102940 2024-03-31T23:18:00.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.612+0000 7fb24ffff640 1 -- 172.21.15.42:0/3029917231 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fb2400bd9d0 con 0x7fb258102940 2024-03-31T23:18:00.613 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:18:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb2440a24a0 msgr2=0x7fb2440a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb2440a24a0 0x7fb2440a4960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2480095f0 tx=0x7fb248005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 msgr2=0x7fb258198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258198040 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb240009230 tx=0x7fb240004ab0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 shutdown_connections 2024-03-31T23:18:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb258103300 0x7fb25819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fb2440a24a0 0x7fb2440a4960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb258102940 0x7fb258198040 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 --2- 172.21.15.42:0/3029917231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb258101750 0x7fb258197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 >> 172.21.15.42:0/3029917231 conn(0x7fb2580fccc0 msgr2=0x7fb258105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 shutdown_connections 2024-03-31T23:18:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.614+0000 7fb25cbf6640 1 -- 172.21.15.42:0/3029917231 wait complete. 2024-03-31T23:18:00.626 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:18:00.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 -- 172.21.15.42:0/1312154316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 msgr2=0x7f8fbc101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 --2- 172.21.15.42:0/1312154316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc101cd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009900 tx=0x7f8fb002bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 -- 172.21.15.42:0/1312154316 shutdown_connections 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 --2- 172.21.15.42:0/1312154316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fbc102210 0x7f8fbc108aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 --2- 172.21.15.42:0/1312154316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc101cd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 --2- 172.21.15.42:0/1312154316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 -- 172.21.15.42:0/1312154316 >> 172.21.15.42:0/1312154316 conn(0x7f8fbc0fbbf0 msgr2=0x7f8fbc0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 -- 172.21.15.42:0/1312154316 shutdown_connections 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 -- 172.21.15.42:0/1312154316 wait complete. 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 Processor -- start 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.732+0000 7f8fc147c640 1 -- start start 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fbc102210 0x7f8fbc19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc10c3c0 con 0x7f8fbc101850 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc10c240 con 0x7f8fbc100660 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc10c540 con 0x7f8fbc102210 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fbaffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59694/0 (socket says 172.21.15.42:59694) 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 -- 172.21.15.42:0/3577927115 learned_addr learned my addr 172.21.15.42:0/3577927115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fbaffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:39146/0 (socket says 172.21.15.42:39146) 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fbb7fe640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fbc102210 0x7f8fbc19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 -- 172.21.15.42:0/3577927115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fbc102210 msgr2=0x7f8fbc19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fbc102210 0x7f8fbc19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 -- 172.21.15.42:0/3577927115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 msgr2=0x7f8fbc196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 -- 172.21.15.42:0/3577927115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc19e660 con 0x7f8fbc101850 2024-03-31T23:18:00.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fbaffd640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:00.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fba7fc640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc196f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0005ab0 tx=0x7f8fb0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:00.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0043020 con 0x7f8fbc101850 2024-03-31T23:18:00.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc19e8f0 con 0x7f8fbc101850 2024-03-31T23:18:00.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fb0004250 con 0x7f8fbc101850 2024-03-31T23:18:00.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.733+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0003c00 con 0x7f8fbc101850 2024-03-31T23:18:00.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.734+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc19ee90 con 0x7f8fbc101850 2024-03-31T23:18:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.734+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc068990 con 0x7f8fbc101850 2024-03-31T23:18:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.735+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f8fb0046020 con 0x7f8fbc101850 2024-03-31T23:18:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.736+0000 7f8fa3fff640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8fa40a24a0 0x7f8fa40a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.736+0000 7f8fbaffd640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8fa40a24a0 0x7f8fa40a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.736+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f8fb00f0af0 con 0x7f8fbc101850 2024-03-31T23:18:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.736+0000 7f8fbaffd640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8fa40a24a0 0x7f8fa40a4960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc1016b0 tx=0x7f8fac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:00.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.741+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8fb004d020 con 0x7f8fbc101850 2024-03-31T23:18:00.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.924+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8fbc062350 con 0x7f8fbc101850 2024-03-31T23:18:00.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.924+0000 7f8fa3fff640 1 -- 172.21.15.42:0/3577927115 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f8fb00bd920 con 0x7f8fbc101850 2024-03-31T23:18:00.925 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:18:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8fa40a24a0 msgr2=0x7f8fa40a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8fa40a24a0 0x7f8fa40a4960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc1016b0 tx=0x7f8fac005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 msgr2=0x7f8fbc196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc196f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0005ab0 tx=0x7f8fb0004a50 comp rx=0 tx=0).stop 2024-03-31T23:18:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 shutdown_connections 2024-03-31T23:18:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fbc102210 0x7f8fbc19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f8fa40a24a0 0x7f8fa40a4960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fbc101850 0x7f8fbc196f80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 --2- 172.21.15.42:0/3577927115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fbc100660 0x7f8fbc196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:00.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 >> 172.21.15.42:0/3577927115 conn(0x7f8fbc0fbbf0 msgr2=0x7f8fbc104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:00.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 shutdown_connections 2024-03-31T23:18:00.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:00.926+0000 7f8fc147c640 1 -- 172.21.15.42:0/3577927115 wait complete. 2024-03-31T23:18:00.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:00 smithi042 ceph-mon[32380]: pgmap v362: 129 pgs: 129 active+clean; 653 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-03-31T23:18:00.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:00 smithi042 ceph-mon[32380]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:00.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:00 smithi042 ceph-mon[32380]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:00.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/94618699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:18:00.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3405694165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:18:00.938 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:00 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3029917231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:18:00.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:18:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:00 smithi188 ceph-mon[36068]: pgmap v362: 129 pgs: 129 active+clean; 653 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-03-31T23:18:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:00 smithi188 ceph-mon[36068]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:00 smithi188 ceph-mon[36068]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/94618699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:18:00.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3405694165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:18:00.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:00 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3029917231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:18:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 -- 172.21.15.42:0/403952326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484101860 msgr2=0x7f6484101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 --2- 172.21.15.42:0/403952326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484101860 0x7f6484101ce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6478009900 tx=0x7f647802bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 -- 172.21.15.42:0/403952326 shutdown_connections 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 --2- 172.21.15.42:0/403952326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484102220 0x7f6484108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 --2- 172.21.15.42:0/403952326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484101860 0x7f6484101ce0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 --2- 172.21.15.42:0/403952326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6484100670 0x7f6484100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 -- 172.21.15.42:0/403952326 >> 172.21.15.42:0/403952326 conn(0x7f64840fbbe0 msgr2=0x7f64840fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 -- 172.21.15.42:0/403952326 shutdown_connections 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.040+0000 7f648984e640 1 -- 172.21.15.42:0/403952326 wait complete. 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 Processor -- start 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 -- start start 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 0x7f6484199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484101860 0x7f648419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6484102220 0x7f64841a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f648410c3d0 con 0x7f6484100670 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f648410c250 con 0x7f6484102220 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f648984e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f648410c550 con 0x7f6484101860 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f6482ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 0x7f6484199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f6482ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 0x7f6484199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59712/0 (socket says 172.21.15.42:59712) 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f6482ffd640 1 -- 172.21.15.42:0/2420223863 learned_addr learned my addr 172.21.15.42:0/2420223863 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f64827fc640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484101860 0x7f648419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.041+0000 7f64837fe640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6484102220 0x7f64841a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f6482ffd640 1 -- 172.21.15.42:0/2420223863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484101860 msgr2=0x7f648419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f6482ffd640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484101860 0x7f648419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f6482ffd640 1 -- 172.21.15.42:0/2420223863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6484102220 msgr2=0x7f64841a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f6482ffd640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6484102220 0x7f64841a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f6482ffd640 1 -- 172.21.15.42:0/2420223863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64841a1970 con 0x7f6484100670 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f6482ffd640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 0x7f6484199d50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e9c0 tx=0x7f647c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c00cde0 con 0x7f6484100670 2024-03-31T23:18:01.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f647c010930 con 0x7f6484100670 2024-03-31T23:18:01.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64841a1c60 con 0x7f6484100670 2024-03-31T23:18:01.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c018ab0 con 0x7f6484100670 2024-03-31T23:18:01.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.042+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64841a21d0 con 0x7f6484100670 2024-03-31T23:18:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.043+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64841a2400 con 0x7f6484100670 2024-03-31T23:18:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.044+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f647c01f020 con 0x7f6484100670 2024-03-31T23:18:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.045+0000 7f648884c640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f646c0a2520 0x7f646c0a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.045+0000 7f64827fc640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f646c0a2520 0x7f646c0a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.045+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f647c0cf220 con 0x7f6484100670 2024-03-31T23:18:01.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.045+0000 7f64827fc640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f646c0a2520 0x7f646c0a49e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f647802c900 tx=0x7f6478005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.048+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f647c09bff0 con 0x7f6484100670 2024-03-31T23:18:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:00 smithi094 ceph-mon[36167]: pgmap v362: 129 pgs: 129 active+clean; 653 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-03-31T23:18:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:00 smithi094 ceph-mon[36167]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:00 smithi094 ceph-mon[36167]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-31T23:18:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/94618699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:18:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3405694165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:18:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:00 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3029917231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:18:01.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.269+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64841a25d0 con 0x7f6484100670 2024-03-31T23:18:01.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.269+0000 7f648884c640 1 -- 172.21.15.42:0/2420223863 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11923 (secure 0 0 0) 0x7f647c09b8f0 con 0x7f6484100670 2024-03-31T23:18:01.271 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:18:01.271 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:17:54.070406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:18:01.271 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-03-31T23:18:01.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f646c0a2520 msgr2=0x7f646c0a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f646c0a2520 0x7f646c0a49e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f647802c900 tx=0x7f6478005fd0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 msgr2=0x7f6484199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 0x7f6484199d50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e9c0 tx=0x7f647c00ee80 comp rx=0 tx=0).stop 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 shutdown_connections 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6484102220 0x7f64841a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484101860 0x7f648419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f646c0a2520 0x7f646c0a49e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 --2- 172.21.15.42:0/2420223863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6484100670 0x7f6484199d50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.271+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 >> 172.21.15.42:0/2420223863 conn(0x7f64840fbbe0 msgr2=0x7f64840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.272+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 shutdown_connections 2024-03-31T23:18:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.272+0000 7f648984e640 1 -- 172.21.15.42:0/2420223863 wait complete. 2024-03-31T23:18:01.284 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:18:01.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 -- 172.21.15.42:0/2873487078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92941074b0 msgr2=0x7f92941098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 --2- 172.21.15.42:0/2873487078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92941074b0 0x7f92941098a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f928c009ca0 tx=0x7f928c02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 -- 172.21.15.42:0/2873487078 shutdown_connections 2024-03-31T23:18:01.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 --2- 172.21.15.42:0/2873487078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92941074b0 0x7f92941098a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 --2- 172.21.15.42:0/2873487078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9294104b80 0x7f9294106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 --2- 172.21.15.42:0/2873487078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9294102250 0x7f9294104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 -- 172.21.15.42:0/2873487078 >> 172.21.15.42:0/2873487078 conn(0x7f92940fbbe0 msgr2=0x7f92940fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 -- 172.21.15.42:0/2873487078 shutdown_connections 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 -- 172.21.15.42:0/2873487078 wait complete. 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 Processor -- start 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 -- start start 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9294102250 0x7f9294101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.387+0000 7f9299c54640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9294104b80 0x7f9294100200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9299c54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 0x7f9294100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9299c54640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f929410d540 con 0x7f92941074b0 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9299c54640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f929410d3c0 con 0x7f9294102250 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9299c54640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f929410d6c0 con 0x7f9294104b80 2024-03-31T23:18:01.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 0x7f9294100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 0x7f9294100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59736/0 (socket says 172.21.15.42:59736) 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 -- 172.21.15.42:0/2327434253 learned_addr learned my addr 172.21.15.42:0/2327434253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f92937fe640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9294102250 0x7f9294101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9292ffd640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9294104b80 0x7f9294100200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 -- 172.21.15.42:0/2327434253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9294104b80 msgr2=0x7f9294100200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9294104b80 0x7f9294100200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 -- 172.21.15.42:0/2327434253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9294102250 msgr2=0x7f9294101bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9294102250 0x7f9294101bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 -- 172.21.15.42:0/2327434253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9294100fd0 con 0x7f92941074b0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9293fff640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 0x7f9294100740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f928c02c700 tx=0x7f928c0346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c039040 con 0x7f92941074b0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92941a1be0 con 0x7f92941074b0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f928c044070 con 0x7f92941074b0 2024-03-31T23:18:01.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c0043c0 con 0x7f92941074b0 2024-03-31T23:18:01.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.388+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92941a2180 con 0x7f92941074b0 2024-03-31T23:18:01.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.389+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92940fd6d0 con 0x7f92941074b0 2024-03-31T23:18:01.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.390+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f928c0045a0 con 0x7f92941074b0 2024-03-31T23:18:01.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.391+0000 7f9290ff9640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f927c0a24a0 0x7f927c0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.391+0000 7f92937fe640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f927c0a24a0 0x7f927c0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.391+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f928c0f10a0 con 0x7f92941074b0 2024-03-31T23:18:01.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.392+0000 7f92937fe640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f927c0a24a0 0x7f927c0a4960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9284009bd0 tx=0x7f9284005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.395+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f928c0bded0 con 0x7f92941074b0 2024-03-31T23:18:01.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.578+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9294062350 con 0x7f92941074b0 2024-03-31T23:18:01.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.579+0000 7f9290ff9640 1 -- 172.21.15.42:0/2327434253 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24683 (secure 0 0 0) 0x7f928c0dd020 con 0x7f92941074b0 2024-03-31T23:18:01.581 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:18:01.582 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:17:42.640704+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f927c0a24a0 msgr2=0x7f927c0a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f927c0a24a0 0x7f927c0a4960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9284009bd0 tx=0x7f9284005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 msgr2=0x7f9294100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 0x7f9294100740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f928c02c700 tx=0x7f928c0346d0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 shutdown_connections 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f927c0a24a0 0x7f927c0a4960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.581+0000 7f9299c54640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92941074b0 0x7f9294100740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.582+0000 7f9299c54640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9294104b80 0x7f9294100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.582+0000 7f9299c54640 1 --2- 172.21.15.42:0/2327434253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9294102250 0x7f9294101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.582+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 >> 172.21.15.42:0/2327434253 conn(0x7f92940fbbe0 msgr2=0x7f9294102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.582+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 shutdown_connections 2024-03-31T23:18:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.582+0000 7f9299c54640 1 -- 172.21.15.42:0/2327434253 wait complete. 2024-03-31T23:18:01.594 DEBUG:tasks.fwd_scrub:Yielding 2024-03-31T23:18:01.594 INFO:teuthology.run_tasks:Running task exec... 2024-03-31T23:18:01.603 INFO:teuthology.task.exec:Executing custom commands... 2024-03-31T23:18:01.604 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:18:01.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-03-31T23:18:01.604 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-03-31T23:18:01.604 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-31T23:18:01.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:18:01.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 -- 172.21.15.42:0/1942157514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8101860 msgr2=0x7f5dc8101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 --2- 172.21.15.42:0/1942157514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8101860 0x7f5dc8101ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009900 tx=0x7f5dbc02bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 -- 172.21.15.42:0/1942157514 shutdown_connections 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 --2- 172.21.15.42:0/1942157514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8102220 0x7f5dc8108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 --2- 172.21.15.42:0/1942157514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8101860 0x7f5dc8101ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 --2- 172.21.15.42:0/1942157514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dc8100670 0x7f5dc8100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 -- 172.21.15.42:0/1942157514 >> 172.21.15.42:0/1942157514 conn(0x7f5dc80fbbe0 msgr2=0x7f5dc80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 -- 172.21.15.42:0/1942157514 shutdown_connections 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 -- 172.21.15.42:0/1942157514 wait complete. 2024-03-31T23:18:01.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.708+0000 7f5dce03b640 1 Processor -- start 2024-03-31T23:18:01.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 -- start start 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dc8100670 0x7f5dc8197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 0x7f5dc8198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8102220 0x7f5dc819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc810c3d0 con 0x7f5dc8102220 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc810c250 con 0x7f5dc8101860 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dce03b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc810c550 con 0x7f5dc8100670 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8102220 0x7f5dc819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 0x7f5dc8198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 0x7f5dc8198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:39180/0 (socket says 172.21.15.42:39180) 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8102220 0x7f5dc819f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59750/0 (socket says 172.21.15.42:59750) 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 -- 172.21.15.42:0/3978554468 learned_addr learned my addr 172.21.15.42:0/3978554468 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc77fe640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dc8100670 0x7f5dc8197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 -- 172.21.15.42:0/3978554468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dc8100670 msgr2=0x7f5dc8197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dc8100670 0x7f5dc8197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 -- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8102220 msgr2=0x7f5dc819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8102220 0x7f5dc819f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 -- 172.21.15.42:0/3978554468 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc819f6f0 con 0x7f5dc8101860 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.709+0000 7f5dc6ffd640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 0x7f5dc8198010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009230 tx=0x7f5dbc004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.710+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc043020 con 0x7f5dc8101860 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.710+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc819f980 con 0x7f5dc8101860 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.710+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dbc004250 con 0x7f5dc8101860 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.710+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003b50 con 0x7f5dc8101860 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.710+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc819fed0 con 0x7f5dc8101860 2024-03-31T23:18:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.711+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc81a00a0 con 0x7f5dc8101860 2024-03-31T23:18:01.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.712+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f5dbc046020 con 0x7f5dc8101860 2024-03-31T23:18:01.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.712+0000 7f5dc4ff9640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5db00a2540 0x7f5db00a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.712+0000 7f5dc77fe640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5db00a2540 0x7f5db00a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.712+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f5dbc0f0bb0 con 0x7f5dc8101860 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 -- 172.21.15.42:0/3640093923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8100650 msgr2=0x7f9fa8100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 --2- 172.21.15.42:0/3640093923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8100650 0x7f9fa8100a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009900 tx=0x7f9fa402bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 -- 172.21.15.42:0/3640093923 shutdown_connections 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 --2- 172.21.15.42:0/3640093923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fa8102200 0x7f9fa8108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 --2- 172.21.15.42:0/3640093923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8101840 0x7f9fa8101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 --2- 172.21.15.42:0/3640093923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8100650 0x7f9fa8100a70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 -- 172.21.15.42:0/3640093923 >> 172.21.15.42:0/3640093923 conn(0x7f9fa80fbbe0 msgr2=0x7f9fa80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f5dc77fe640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5db00a2540 0x7f5db00a4a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5dc81016c0 tx=0x7f5db8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 -- 172.21.15.42:0/3640093923 shutdown_connections 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 -- 172.21.15.42:0/3640093923 wait complete. 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 Processor -- start 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.713+0000 7f9faf38a640 1 -- start start 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9faf38a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 0x7f9fa8197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9faf38a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8101840 0x7f9fa8198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9faf38a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fa8102200 0x7f9fa819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9faf38a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810c3a0 con 0x7f9fa8102200 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9faf38a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810c220 con 0x7f9fa8100650 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9faf38a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810c520 con 0x7f9fa8101840 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 0x7f9fa8197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 0x7f9fa8197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:39192/0 (socket says 172.21.15.42:39192) 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad927640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fa8102200 0x7f9fa819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 -- 172.21.15.42:0/2618556138 learned_addr learned my addr 172.21.15.42:0/2618556138 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fac925640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8101840 0x7f9fa8198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 -- 172.21.15.42:0/2618556138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8101840 msgr2=0x7f9fa8198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8101840 0x7f9fa8198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 -- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fa8102200 msgr2=0x7f9fa819f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fa8102200 0x7f9fa819f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 -- 172.21.15.42:0/2618556138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa819f7f0 con 0x7f9fa8100650 2024-03-31T23:18:01.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.714+0000 7f9fad126640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 0x7f9fa8197bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c00 tx=0x7f9fa4004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.721+0000 7f9f9e7fc640 1 -- 172.21.15.42:0/2618556138 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4043020 con 0x7f9fa8100650 2024-03-31T23:18:01.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.721+0000 7f9f9e7fc640 1 -- 172.21.15.42:0/2618556138 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fa4004250 con 0x7f9fa8100650 2024-03-31T23:18:01.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.721+0000 7f9f9e7fc640 1 -- 172.21.15.42:0/2618556138 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4003b20 con 0x7f9fa8100650 2024-03-31T23:18:01.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.721+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa819fa80 con 0x7f9fa8100650 2024-03-31T23:18:01.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.721+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa81a0020 con 0x7f9fa8100650 2024-03-31T23:18:01.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.721+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5dbc04d020 con 0x7f5dc8101860 2024-03-31T23:18:01.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.724+0000 7f9f9e7fc640 1 -- 172.21.15.42:0/2618556138 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7f9fa4046020 con 0x7f9fa8100650 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 Processor -- start 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 -- start start 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04136e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a0413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a0413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556a040380b0 con 0x556a0413c570 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556a0409aea0 con 0x556a04137400 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556a04043c00 con 0x556a04136a10 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a0413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fad126640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a0413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a0413ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59770/0 (socket says 172.21.15.42:59770) 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 -- 172.21.15.42:0/560381713 learned_addr learned my addr 172.21.15.42:0/560381713 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fad927640 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9f9e7fc640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9f940a2520 0x7f9f940a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fad927640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9f940a2520 0x7f9f940a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 -- 172.21.15.42:0/560381713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 msgr2=0x556a04136e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04136e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 -- 172.21.15.42:0/560381713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 msgr2=0x556a0413bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a0413bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fac925640 1 -- 172.21.15.42:0/560381713 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a03e777e0 con 0x556a0413c570 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9fad126640 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a0413bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.725+0000 7f9f9e7fc640 1 -- 172.21.15.42:0/2618556138 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9fa40f0b10 con 0x7f9fa8100650 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.726+0000 7f9fac925640 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a0413ea00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009c90 tx=0x7f9f98011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f05a369fa412e2c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.726+0000 7f9fad927640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9f940a2520 0x7f9f940a49e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x556a04137c60 tx=0x7f9fa0004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.726+0000 7f9f937fe640 1 -- 172.21.15.42:0/560381713 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9801e070 con 0x556a0413c570 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.726+0000 7f9f937fe640 1 -- 172.21.15.42:0/560381713 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f98019b30 con 0x556a0413c570 2024-03-31T23:18:01.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.726+0000 7f9f937fe640 1 -- 172.21.15.42:0/560381713 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800eac0 con 0x556a0413c570 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- 172.21.15.42:0/560381713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 msgr2=0x556a0413ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a0413ea00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009c90 tx=0x7f9f98011810 comp rx=0 tx=0).stop 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- 172.21.15.42:0/560381713 shutdown_connections 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a0413ea00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a0413bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/560381713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- 172.21.15.42:0/560381713 >> 172.21.15.42:0/560381713 conn(0x556a04131f80 msgr2=0x556a04132380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- 172.21.15.42:0/560381713 shutdown_connections 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- 172.21.15.42:0/560381713 wait complete. 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- start start 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 Processor -- start 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 0x556a04140da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0413c570 0x556a04148320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.727+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556a040393d0 con 0x556a04137400 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556a04096f40 con 0x556a04136a10 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556a0413f520 con 0x556a0413c570 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fb1f69740 10 client.0 _ll_register_callbacks cb 0x556a04056b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fac925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 0x556a04140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fac925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59782/0 (socket says 172.21.15.42:59782) 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fac925640 1 -- 172.21.15.42:0/2106038192 learned_addr learned my addr 172.21.15.42:0/2106038192 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 0x556a04140da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:39216/0 (socket says 172.21.15.42:39216) 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad927640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0413c570 0x556a04148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 -- 172.21.15.42:0/2106038192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0413c570 msgr2=0x556a04148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0413c570 0x556a04148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 -- 172.21.15.42:0/2106038192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 msgr2=0x556a041412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 -- 172.21.15.42:0/2106038192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a03ed7f70 con 0x556a04136a10 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fac925640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad927640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0413c570 0x556a04148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fad126640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 0x556a04140da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40ee2d0 tx=0x7f9fa4005890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc531c8597aaeae server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9f90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9f90ff9640 1 -- 172.21.15.42:0/2106038192 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40bd940 con 0x556a04136a10 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9f90ff9640 1 -- 172.21.15.42:0/2106038192 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9fa40ee390 con 0x556a04136a10 2024-03-31T23:18:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.728+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f98019b30 con 0x556a04136a10 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9f90ff9640 1 -- 172.21.15.42:0/2106038192 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9fa40bd240 con 0x556a04136a10 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 10 client.25502 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556a03d6f170 con 0x556a04136a10 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9f90ff9640 1 -- 172.21.15.42:0/2106038192 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f98019b30 con 0x556a04136a10 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9f90ff9640 1 -- 172.21.15.42:0/2106038192 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9fa40053e0 con 0x556a04136a10 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 10 client.25502 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 10 client.25502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 20 client.25502 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a0414c860 0x556a0414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 4 client.25502 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a040a83e0 con 0x556a0414c860 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.729+0000 7f9fac925640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a0414c860 0x556a0414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9f90ff9640 10 client.25502 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fac925640 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a0414c860 0x556a0414ed20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af9d4b72411c0de server_cookie=93b33decea82908e in_seq=0 out_seq=0 2024-03-31T23:18:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9f90ff9640 1 -- 172.21.15.42:0/2106038192 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556a040a83e0 con 0x556a0414c860 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9f90ff9640 10 client.25502 handle_command_reply: tid=0 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 client.25502 shutdown 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 msgr2=0x556a04140da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 0x556a04140da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40ee2d0 tx=0x7f9fa4005890 comp rx=0 tx=0).stop 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 shutdown_connections 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a0414c860 0x556a0414ed20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0413c570 0x556a04148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/2106038192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04136a10 0x556a04140da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 >> 172.21.15.42:0/2106038192 conn(0x556a04131f80 msgr2=0x556a04131180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9f90ff9640 0 client.25502 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 shutdown_connections 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.730+0000 7f9fb1f69740 1 -- 172.21.15.42:0/2106038192 wait complete. 2024-03-31T23:18:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.731+0000 7f9fb1f69740 20 client.25502 trim_cache size 0 max 16384 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 Processor -- start 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 -- start start 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04149020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041482e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a0413c570 0x556a04141240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81aa480 con 0x556a04137400 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81abfc0 con 0x556a0413c570 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81aab50 con 0x556a04136a10 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fac925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fac925640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59790/0 (socket says 172.21.15.42:59790) 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fac925640 1 -- 172.21.15.42:0/139912922 learned_addr learned my addr 172.21.15.42:0/139912922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fad927640 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a0413c570 0x556a04141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.748+0000 7f9fad126640 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fac925640 1 -- 172.21.15.42:0/139912922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 msgr2=0x556a04149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fac925640 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fac925640 1 -- 172.21.15.42:0/139912922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a0413c570 msgr2=0x556a04141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fac925640 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a0413c570 0x556a04141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fac925640 1 -- 172.21.15.42:0/139912922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a0412c320 con 0x556a04137400 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fad927640 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a0413c570 0x556a04141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9fac925640 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041482e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9f9801c040 tx=0x7f9f98005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48af8124d20f9d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9f92ffd640 1 -- 172.21.15.42:0/139912922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9801e040 con 0x556a04137400 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9f92ffd640 1 -- 172.21.15.42:0/139912922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f9802a070 con 0x556a04137400 2024-03-31T23:18:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.749+0000 7f9f92ffd640 1 -- 172.21.15.42:0/139912922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98003850 con 0x556a04137400 2024-03-31T23:18:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 -- 172.21.15.42:0/139912922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 msgr2=0x556a041482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041482e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9f9801c040 tx=0x7f9f98005850 comp rx=0 tx=0).stop 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 -- 172.21.15.42:0/139912922 shutdown_connections 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a0413c570 0x556a04141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a04137400 0x556a041482e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/139912922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 -- 172.21.15.42:0/139912922 >> 172.21.15.42:0/139912922 conn(0x556a04131f80 msgr2=0x556a041351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 -- 172.21.15.42:0/139912922 shutdown_connections 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 -- 172.21.15.42:0/139912922 wait complete. 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 -- start start 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.750+0000 7f9fb1f69740 1 Processor -- start 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a041463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a04147390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ab8f0 con 0x556a0413c570 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ab220 con 0x556a04137400 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a8460 con 0x556a04136a10 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 10 client.0 _ll_register_callbacks cb 0x7f9fa40057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad927640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a04147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fac925640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a041463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad927640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a04147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59796/0 (socket says 172.21.15.42:59796) 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fac925640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a041463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:39236/0 (socket says 172.21.15.42:39236) 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad927640 1 -- 172.21.15.42:0/1517434837 learned_addr learned my addr 172.21.15.42:0/1517434837 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:54072/0 (socket says 172.21.15.42:54072) 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 -- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 msgr2=0x556a041463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a041463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 -- 172.21.15.42:0/1517434837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 msgr2=0x556a04147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a04147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 -- 172.21.15.42:0/1517434837 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a04147980 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad927640 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a04147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fad126640 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04145eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4036040 tx=0x7f9fa4003da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6e128c955359da server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9f90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9f90ff9640 1 -- 172.21.15.42:0/1517434837 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40bd940 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f9802a070 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.751+0000 7f9f90ff9640 1 -- 172.21.15.42:0/1517434837 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f9fa40bc690 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9f90ff9640 1 -- 172.21.15.42:0/1517434837 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9fa40c57c0 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 10 client.25471 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556a041b3100 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9f90ff9640 1 -- 172.21.15.42:0/1517434837 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f9802a070 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9f90ff9640 1 -- 172.21.15.42:0/1517434837 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9fa40bc100 con 0x556a04136a10 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 10 client.25471 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 10 client.25471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 20 client.25471 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a041b38e0 0x556a041b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 4 client.25471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556a040a2730 con 0x556a041b38e0 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.752+0000 7f9fac925640 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a041b38e0 0x556a041b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.753+0000 7f9f90ff9640 10 client.25471 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.753+0000 7f9fac925640 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a041b38e0 0x556a041b5d00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a815f233514ad558 server_cookie=712f7073fe445ee in_seq=0 out_seq=0 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9f90ff9640 1 -- 172.21.15.42:0/1517434837 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556a040a2730 con 0x556a041b38e0 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9f90ff9640 10 client.25471 handle_command_reply: tid=0 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 client.25471 shutdown 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 msgr2=0x556a04145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04145eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4036040 tx=0x7f9fa4003da0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 shutdown_connections 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x556a041b38e0 0x556a041b5d00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556a0413c570 0x556a04147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556a04137400 0x556a041463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9f90ff9640 0 client.25471 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 --2- 172.21.15.42:0/1517434837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a04136a10 0x556a04145eb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 >> 172.21.15.42:0/1517434837 conn(0x556a04131f80 msgr2=0x556a04135a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 shutdown_connections 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 1 -- 172.21.15.42:0/1517434837 wait complete. 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.754+0000 7f9fb1f69740 20 client.25471 trim_cache size 0 max 16384 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "527089ab-da0a-4be9-bc1f-1ea04e62d380", 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-03-31T23:18:01.760 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:18:01.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9f940a2520 msgr2=0x7f9f940a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9f940a2520 0x7f9f940a49e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x556a04137c60 tx=0x7f9fa0004ab0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 msgr2=0x7f9fa8197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 0x7f9fa8197bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c00 tx=0x7f9fa4004a30 comp rx=0 tx=0).stop 2024-03-31T23:18:01.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 shutdown_connections 2024-03-31T23:18:01.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f9f940a2520 0x7f9f940a49e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fa8102200 0x7f9fa819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fa8101840 0x7f9fa8198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 --2- 172.21.15.42:0/2618556138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa8100650 0x7f9fa8197bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 >> 172.21.15.42:0/2618556138 conn(0x7f9fa80fbbe0 msgr2=0x7f9fa80688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 shutdown_connections 2024-03-31T23:18:01.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.755+0000 7f9faf38a640 1 -- 172.21.15.42:0/2618556138 wait complete. 2024-03-31T23:18:01.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:18:01.767 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 -- 172.21.15.42:0/1930613740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 msgr2=0x7fa8c81045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1930613740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c81045c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009860 tx=0x7fa8b802bb70 comp rx=0 tx=0).stop 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 -- 172.21.15.42:0/1930613740 shutdown_connections 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1930613740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8107430 0x7fa8c8109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1930613740 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8c8104b00 0x7fa8c8106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1930613740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c81045c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 -- 172.21.15.42:0/1930613740 >> 172.21.15.42:0/1930613740 conn(0x7fa8c80fbbe0 msgr2=0x7fa8c80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 -- 172.21.15.42:0/1930613740 shutdown_connections 2024-03-31T23:18:01.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.872+0000 7fa8cda96640 1 -- 172.21.15.42:0/1930613740 wait complete. 2024-03-31T23:18:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 Processor -- start 2024-03-31T23:18:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 -- start start 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c8197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 0x7fa8c81980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8c8107430 0x7fa8c819f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c810d500 con 0x7fa8c8104b00 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c810d380 con 0x7fa8c81021d0 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8cda96640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c810d680 con 0x7fa8c8107430 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 0x7fa8c81980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c8197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 0x7fa8c81980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59812/0 (socket says 172.21.15.42:59812) 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1053995470 learned_addr learned my addr 172.21.15.42:0/1053995470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8c8107430 0x7fa8c819f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1053995470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8c8107430 msgr2=0x7fa8c819f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8c8107430 0x7fa8c819f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1053995470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 msgr2=0x7fa8c8197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.873+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c8197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1053995470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c819f7c0 con 0x7fa8c8104b00 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c8197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 0x7fa8c81980e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00e9a0 tx=0x7fa8bc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8c4ff9640 1 -- 172.21.15.42:0/1053995470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00cd80 con 0x7fa8c8104b00 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8c4ff9640 1 -- 172.21.15.42:0/1053995470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8bc0035f0 con 0x7fa8c8104b00 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c819fab0 con 0x7fa8c8104b00 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8c4ff9640 1 -- 172.21.15.42:0/1053995470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc010700 con 0x7fa8c8104b00 2024-03-31T23:18:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.874+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81a0000 con 0x7fa8c8104b00 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.876+0000 7fa8c4ff9640 1 -- 172.21.15.42:0/1053995470 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137320+0+0 (secure 0 0 0) 0x7fa8bc0037a0 con 0x7fa8c8104b00 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.876+0000 7fa8d0672740 1 Processor -- start 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.876+0000 7fa8d0672740 1 -- start start 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.876+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a802b0 0x557388a806d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.876+0000 7fa8c4ff9640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8b00a24a0 0x7fa8b00a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a882a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8d0672740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5573889e5180 con 0x557388a802b0 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8d0672740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55738898db70 con 0x557388a80ca0 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8d0672740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5573889e1220 con 0x557388a85e10 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a802b0 0x557388a806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8b00a24a0 0x7fa8b00a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a802b0 0x557388a806d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59816/0 (socket says 172.21.15.42:59816) 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c7fff640 1 -- 172.21.15.42:0/4078493127 learned_addr learned my addr 172.21.15.42:0/4078493127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c4ff9640 1 -- 172.21.15.42:0/1053995470 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fa8bc0ced70 con 0x7fa8c8104b00 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/4078493127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 msgr2=0x557388a882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a882a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/4078493127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a802b0 msgr2=0x557388a806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a802b0 0x557388a806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/4078493127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573889a17c0 con 0x557388a80ca0 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8b00a24a0 0x7fa8b00a4960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009830 tx=0x7fa8b8034b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a857a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0cc850 tx=0x7fa8bc014fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a7c130785b0b0e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8adffb640 1 -- 172.21.15.42:0/4078493127 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc09bba0 con 0x557388a80ca0 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8adffb640 1 -- 172.21.15.42:0/4078493127 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8bc0525b0 con 0x557388a80ca0 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.877+0000 7fa8adffb640 1 -- 172.21.15.42:0/4078493127 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a88c0 con 0x557388a80ca0 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 -- 172.21.15.42:0/4078493127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 msgr2=0x557388a857a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a857a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0cc850 tx=0x7fa8bc014fe0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 -- 172.21.15.42:0/4078493127 shutdown_connections 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a882a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a857a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 --2- 172.21.15.42:0/4078493127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a802b0 0x557388a806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 -- 172.21.15.42:0/4078493127 >> 172.21.15.42:0/4078493127 conn(0x557388a7b820 msgr2=0x557388a7bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 -- 172.21.15.42:0/4078493127 shutdown_connections 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 -- 172.21.15.42:0/4078493127 wait complete. 2024-03-31T23:18:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.878+0000 7fa8d0672740 1 -- start start 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 Processor -- start 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a8a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 0x557388a8ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a91d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557388a88d60 con 0x557388a80ca0 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5573889834a0 con 0x557388a802b0 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557388a88ee0 con 0x557388a85e10 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8d0672740 10 client.0 _ll_register_callbacks cb 0x557388986d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 0x557388a8ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a8a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 0x557388a8ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59824/0 (socket says 172.21.15.42:59824) 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1591307621 learned_addr learned my addr 172.21.15.42:0/1591307621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a91d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1591307621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 msgr2=0x557388a91d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a91d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 msgr2=0x557388a8a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a8a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c6ffd640 1 -- 172.21.15.42:0/1591307621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573887c37d0 con 0x557388a80ca0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a91d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.879+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a8a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 0x557388a8ad30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc097e70 tx=0x7fa8bc003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2c621aaf08efe1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/1591307621 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc09bba0 con 0x557388a80ca0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/1591307621 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fa8bc0ab0b0 con 0x557388a80ca0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8bc0525b0 con 0x557388a80ca0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/1591307621 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa8bc0b4050 con 0x557388a80ca0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 10 client.15690 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5573886f93f0 con 0x557388a80ca0 2024-03-31T23:18:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/1591307621 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8bc0525b0 con 0x557388a80ca0 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/1591307621 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa8bc0a3a20 con 0x557388a80ca0 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 10 client.15690 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 20 client.15690 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388a96260 0x557388a98650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 4 client.15690 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.880+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573889f26c0 con 0x557388a96260 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.881+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388a96260 0x557388a98650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.881+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388a96260 0x557388a98650 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=985d057c24b4b352 server_cookie=e8c14f44b374b82f in_seq=0 out_seq=0 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.881+0000 7fa8a6ffd640 10 client.15690 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/1591307621 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5573889f26c0 con 0x557388a96260 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8a6ffd640 10 client.15690 handle_command_reply: tid=0 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 client.15690 shutdown 2024-03-31T23:18:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 msgr2=0x557388a8ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 0x557388a8ad30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc097e70 tx=0x7fa8bc003ea0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 shutdown_connections 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388a96260 0x557388a98650 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a85e10 0x557388a91d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a80ca0 0x557388a8ad30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 --2- 172.21.15.42:0/1591307621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a8a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8a6ffd640 0 client.15690 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 >> 172.21.15.42:0/1591307621 conn(0x557388a7b820 msgr2=0x557388a7ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 shutdown_connections 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 1 -- 172.21.15.42:0/1591307621 wait complete. 2024-03-31T23:18:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.882+0000 7fa8d0672740 20 client.15690 trim_cache size 0 max 16384 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.899+0000 7fa8d0672740 1 Processor -- start 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.899+0000 7fa8d0672740 1 -- start start 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a81710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a80ca0 0x557388a91d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a7a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8d0672740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81aa5a0 con 0x557388a85e10 2024-03-31T23:18:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8d0672740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81ac0e0 con 0x557388a802b0 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8d0672740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81aac70 con 0x557388a80ca0 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a7a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a7a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59838/0 (socket says 172.21.15.42:59838) 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 -- 172.21.15.42:0/2884149987 learned_addr learned my addr 172.21.15.42:0/2884149987 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a81710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a80ca0 0x557388a91d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 -- 172.21.15.42:0/2884149987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a80ca0 msgr2=0x557388a91d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a80ca0 0x557388a91d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 -- 172.21.15.42:0/2884149987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 msgr2=0x557388a81710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a81710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 -- 172.21.15.42:0/2884149987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557388a828e0 con 0x557388a85e10 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a7a390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00049d0 tx=0x7fa8c0010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db2a63420b25fcc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8ad7fa640 1 -- 172.21.15.42:0/2884149987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0017040 con 0x557388a85e10 2024-03-31T23:18:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8ad7fa640 1 -- 172.21.15.42:0/2884149987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8c0004b20 con 0x557388a85e10 2024-03-31T23:18:01.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.900+0000 7fa8ad7fa640 1 -- 172.21.15.42:0/2884149987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001d630 con 0x557388a85e10 2024-03-31T23:18:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 -- 172.21.15.42:0/2884149987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 msgr2=0x557388a7a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a7a390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00049d0 tx=0x7fa8c0010040 comp rx=0 tx=0).stop 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 -- 172.21.15.42:0/2884149987 shutdown_connections 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a7a390 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a80ca0 0x557388a91d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 --2- 172.21.15.42:0/2884149987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a802b0 0x557388a81710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 -- 172.21.15.42:0/2884149987 >> 172.21.15.42:0/2884149987 conn(0x557388a7b820 msgr2=0x557388a89280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 -- 172.21.15.42:0/2884149987 shutdown_connections 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 -- 172.21.15.42:0/2884149987 wait complete. 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 -- start start 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.901+0000 7fa8d0672740 1 Processor -- start 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a802b0 0x557388a8f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a90d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81aba10 con 0x557388a85e10 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81ab340 con 0x557388a80ca0 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81a8580 con 0x557388a802b0 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8d0672740 10 client.0 _ll_register_callbacks cb 0x7fa8c0009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a90d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a90d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59840/0 (socket says 172.21.15.42:59840) 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 -- 172.21.15.42:0/3451997036 learned_addr learned my addr 172.21.15.42:0/3451997036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a802b0 0x557388a8f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 -- 172.21.15.42:0/3451997036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a802b0 msgr2=0x557388a8f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a802b0 0x557388a8f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 -- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 msgr2=0x557388a8fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a8fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 -- 172.21.15.42:0/3451997036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573886b90f0 con 0x557388a85e10 2024-03-31T23:18:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a802b0 0x557388a8f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c6ffd640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a8fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8c7fff640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a90d00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00049a0 tx=0x7fa8c0005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86837c942af5928 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/3451997036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0005020 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.902+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/3451997036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fa8c00051c0 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c0004b20 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/3451997036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa8c0038050 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 10 client.15696 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557388afc4c0 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/3451997036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8c0004b20 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/3451997036 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa8c000b040 con 0x557388a85e10 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 10 client.15696 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 20 client.15696 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388afcef0 0x557388aff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:01.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 4 client.15696 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5573889eca10 con 0x557388afcef0 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.903+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388afcef0 0x557388aff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8c77fe640 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388afcef0 0x557388aff310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5edc5b6a2ea41a5 server_cookie=cae6e7da4f66f3a1 in_seq=0 out_seq=0 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8a6ffd640 10 client.15696 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8a6ffd640 1 -- 172.21.15.42:0/3451997036 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5573889eca10 con 0x557388afcef0 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8a6ffd640 10 client.15696 handle_command_reply: tid=0 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 client.15696 shutdown 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 msgr2=0x557388a90d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a90d00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00049a0 tx=0x7fa8c0005df0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 shutdown_connections 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557388afcef0 0x557388aff310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557388a85e10 0x557388a90d00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557388a80ca0 0x557388a8fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 --2- 172.21.15.42:0/3451997036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557388a802b0 0x557388a8f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8a6ffd640 0 client.15696 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 >> 172.21.15.42:0/3451997036 conn(0x557388a7b820 msgr2=0x557388a7ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 shutdown_connections 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 1 -- 172.21.15.42:0/3451997036 wait complete. 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.904+0000 7fa8d0672740 20 client.15696 trim_cache size 0 max 16384 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-31T23:18:01.911 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout: "527089ab-da0a-4be9-bc1f-1ea04e62d380": { 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "527089ab-da0a-4be9-bc1f-1ea04e62d380", 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:18:01.912 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8b00a24a0 msgr2=0x7fa8b00a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8b00a24a0 0x7fa8b00a4960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009830 tx=0x7fa8b8034b50 comp rx=0 tx=0).stop 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 msgr2=0x7fa8c81980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 0x7fa8c81980e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00e9a0 tx=0x7fa8bc00ee60 comp rx=0 tx=0).stop 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 shutdown_connections 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8c8107430 0x7fa8c819f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fa8b00a24a0 0x7fa8b00a4960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8c8104b00 0x7fa8c81980e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 --2- 172.21.15.42:0/1053995470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8c81021d0 0x7fa8c8197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 >> 172.21.15.42:0/1053995470 conn(0x7fa8c80fbbe0 msgr2=0x7fa8c8102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 shutdown_connections 2024-03-31T23:18:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.905+0000 7fa8cda96640 1 -- 172.21.15.42:0/1053995470 wait complete. 2024-03-31T23:18:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:01 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3577927115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:18:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:01 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2420223863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:18:01.915 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:01 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2327434253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:18:01.916 INFO:tasks.cephfs.filesystem:scrub status for tag:527089ab-da0a-4be9-bc1f-1ea04e62d380 - {'path': '/', 'tag': '527089ab-da0a-4be9-bc1f-1ea04e62d380', 'options': 'recursive,force'} 2024-03-31T23:18:01.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:01.963+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f5dc81a0310 con 0x7f5dc8101860 2024-03-31T23:18:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:01 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3577927115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:18:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:01 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2420223863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:18:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:01 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2327434253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:18:02.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:01 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3577927115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:18:02.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:01 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2420223863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:18:02.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:01 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2327434253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:18:02.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.717+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mgrmap(e 19) ==== 137337+0+0 (secure 0 0 0) 0x7f5dbc003cf0 con 0x7f5dc8101860 2024-03-31T23:18:02.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.718+0000 7f5dc4ff9640 1 -- 172.21.15.42:0/3978554468 <== mon.2 v2:172.21.15.94:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f5dbc09a3b0 con 0x7f5dc8101860 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5db00a2540 msgr2=0x7f5db00a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5db00a2540 0x7f5db00a4a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5dc81016c0 tx=0x7f5db8005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 msgr2=0x7f5dc8198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 0x7f5dc8198010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009230 tx=0x7f5dbc004ab0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 shutdown_connections 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f5db00a2540 0x7f5db00a4a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5dc8102220 0x7f5dc819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5dc8101860 0x7f5dc8198010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 --2- 172.21.15.42:0/3978554468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dc8100670 0x7f5dc8197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 >> 172.21.15.42:0/3978554468 conn(0x7f5dc80fbbe0 msgr2=0x7f5dc80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 shutdown_connections 2024-03-31T23:18:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.721+0000 7f5dce03b640 1 -- 172.21.15.42:0/3978554468 wait complete. 2024-03-31T23:18:02.734 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:02 smithi042 ceph-mon[32380]: pgmap v363: 129 pgs: 129 active+clean; 653 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-03-31T23:18:02.734 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:02 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3978554468' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-31T23:18:02.734 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:02 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-31T23:18:02.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-03-31T23:18:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 -- 172.21.15.42:0/645765773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754100060 msgr2=0x7fd754100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 --2- 172.21.15.42:0/645765773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754100060 0x7fd754100480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd750009860 tx=0x7fd75002bc00 comp rx=0 tx=0).stop 2024-03-31T23:18:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 -- 172.21.15.42:0/645765773 shutdown_connections 2024-03-31T23:18:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 --2- 172.21.15.42:0/645765773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd754101360 0x7fd7541017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 --2- 172.21.15.42:0/645765773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7541009c0 0x7fd754100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 --2- 172.21.15.42:0/645765773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754100060 0x7fd754100480 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 -- 172.21.15.42:0/645765773 >> 172.21.15.42:0/645765773 conn(0x7fd7540fbbe0 msgr2=0x7fd7540fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 -- 172.21.15.42:0/645765773 shutdown_connections 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.848+0000 7fd75b93e640 1 -- 172.21.15.42:0/645765773 wait complete. 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 Processor -- start 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 -- start start 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 0x7fd754199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7541009c0 0x7fd75419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754101360 0x7fd7541a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd75410f710 con 0x7fd754100060 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd75410f590 con 0x7fd7541009c0 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd75b93e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd75410f890 con 0x7fd754101360 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd7596da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 0x7fd754199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd7596da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 0x7fd754199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59870/0 (socket says 172.21.15.42:59870) 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd7596da640 1 -- 172.21.15.42:0/2512001378 learned_addr learned my addr 172.21.15.42:0/2512001378 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd759edb640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754101360 0x7fd7541a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.849+0000 7fd758ed9640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7541009c0 0x7fd75419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd7596da640 1 -- 172.21.15.42:0/2512001378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754101360 msgr2=0x7fd7541a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd7596da640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754101360 0x7fd7541a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd7596da640 1 -- 172.21.15.42:0/2512001378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7541009c0 msgr2=0x7fd75419a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd7596da640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7541009c0 0x7fd75419a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd7596da640 1 -- 172.21.15.42:0/2512001378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7541a18f0 con 0x7fd754100060 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd7596da640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 0x7fd754199d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd750005940 tx=0x7fd7500346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750041020 con 0x7fd754100060 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7541a1b80 con 0x7fd754100060 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd75002ce50 con 0x7fd754100060 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7541a20c0 con 0x7fd754100060 2024-03-31T23:18:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.850+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750039040 con 0x7fd754100060 2024-03-31T23:18:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.851+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75410adb0 con 0x7fd754100060 2024-03-31T23:18:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.852+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 137337+0+0 (secure 0 0 0) 0x7fd750044020 con 0x7fd754100060 2024-03-31T23:18:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.853+0000 7fd74a7fc640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7400a2590 0x7fd7400a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.853+0000 7fd758ed9640 1 -- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7400a2590 msgr2=0x7fd7400a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.853+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fd7500f01a0 con 0x7fd754100060 2024-03-31T23:18:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.853+0000 7fd758ed9640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7400a2590 0x7fd7400a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:18:02.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:02.857+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd75004b020 con 0x7fd754100060 2024-03-31T23:18:02.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:02 smithi188 ceph-mon[36068]: pgmap v363: 129 pgs: 129 active+clean; 653 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-03-31T23:18:02.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:02 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3978554468' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-31T23:18:02.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:02 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-31T23:18:02.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: ignoring --setuser ceph since I am not root 2024-03-31T23:18:02.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: ignoring --setgroup ceph since I am not root 2024-03-31T23:18:02.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:02 smithi188 ceph-mgr[37922]: -- 172.21.15.188:0/1161408035 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8755c65a0 con 0x55d87559b000 2024-03-31T23:18:03.022 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: ignoring --setuser ceph since I am not root 2024-03-31T23:18:03.022 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: ignoring --setgroup ceph since I am not root 2024-03-31T23:18:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.043+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fd754062350 con 0x7fd754100060 2024-03-31T23:18:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.048+0000 7fd74a7fc640 1 -- 172.21.15.42:0/2512001378 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v26)=0 v26) ==== 138+0+0 (secure 0 0 0) 0x7fd7500bcfd0 con 0x7fd754100060 2024-03-31T23:18:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.050+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7400a2590 msgr2=0x7fd7400a4a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:18:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.050+0000 7fd75b93e640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7400a2590 0x7fd7400a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.050+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 msgr2=0x7fd754199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.050+0000 7fd75b93e640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 0x7fd754199d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd750005940 tx=0x7fd7500346f0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.050+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 shutdown_connections 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.050+0000 7fd75b93e640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd754101360 0x7fd7541a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.051+0000 7fd75b93e640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7541009c0 0x7fd75419a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.051+0000 7fd75b93e640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fd7400a2590 0x7fd7400a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.051+0000 7fd75b93e640 1 --2- 172.21.15.42:0/2512001378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd754100060 0x7fd754199d00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.051+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 >> 172.21.15.42:0/2512001378 conn(0x7fd7540fbbe0 msgr2=0x7fd7540fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.051+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 shutdown_connections 2024-03-31T23:18:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.051+0000 7fd75b93e640 1 -- 172.21.15.42:0/2512001378 wait complete. 2024-03-31T23:18:03.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-03-31T23:18:03.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.170+0000 7fcc3fb65640 1 -- 172.21.15.42:0/4250450525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc38102260 msgr2=0x7fcc38108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.170+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/4250450525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc38102260 0x7fcc38108af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009ca0 tx=0x7fcc3002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- 172.21.15.42:0/4250450525 shutdown_connections 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/4250450525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc38102260 0x7fcc38108af0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/4250450525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc381018a0 0x7fcc38101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/4250450525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc381006b0 0x7fcc38100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- 172.21.15.42:0/4250450525 >> 172.21.15.42:0/4250450525 conn(0x7fcc380fbc20 msgr2=0x7fcc380fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- 172.21.15.42:0/4250450525 shutdown_connections 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- 172.21.15.42:0/4250450525 wait complete. 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 Processor -- start 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- start start 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc381006b0 0x7fcc38197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 0x7fcc38197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc38102260 0x7fcc3819f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3810c460 con 0x7fcc381018a0 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3810c2e0 con 0x7fcc38102260 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.171+0000 7fcc3fb65640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3810c5e0 con 0x7fcc381006b0 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 0x7fcc38197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 0x7fcc38197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59890/0 (socket says 172.21.15.42:59890) 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 -- 172.21.15.42:0/768742795 learned_addr learned my addr 172.21.15.42:0/768742795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3e102640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc38102260 0x7fcc3819f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d901640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc381006b0 0x7fcc38197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 -- 172.21.15.42:0/768742795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc381006b0 msgr2=0x7fcc38197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc381006b0 0x7fcc38197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 -- 172.21.15.42:0/768742795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc38102260 msgr2=0x7fcc3819f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc38102260 0x7fcc3819f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 -- 172.21.15.42:0/768742795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3819f6d0 con 0x7fcc381018a0 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3e102640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc38102260 0x7fcc3819f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:03.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3d100640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 0x7fcc38197ff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800e9f0 tx=0x7fcc2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:03.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800cd80 con 0x7fcc381018a0 2024-03-31T23:18:03.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc28005520 con 0x7fcc381018a0 2024-03-31T23:18:03.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3819f9c0 con 0x7fcc381018a0 2024-03-31T23:18:03.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28010690 con 0x7fcc381018a0 2024-03-31T23:18:03.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.172+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3819fec0 con 0x7fcc381018a0 2024-03-31T23:18:03.176 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:02 smithi094 ceph-mon[36167]: pgmap v363: 129 pgs: 129 active+clean; 653 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-03-31T23:18:03.177 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:02 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3978554468' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-31T23:18:03.177 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:02 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-31T23:18:03.177 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: ignoring --setuser ceph since I am not root 2024-03-31T23:18:03.177 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: ignoring --setgroup ceph since I am not root 2024-03-31T23:18:03.177 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:02 smithi094 ceph-mgr[37556]: -- 172.21.15.94:0/1526008799 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1f53705a0 con 0x55e1f5344800 2024-03-31T23:18:03.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.174+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc381a0150 con 0x7fcc381018a0 2024-03-31T23:18:03.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.175+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 137337+0+0 (secure 0 0 0) 0x7fcc280046c0 con 0x7fcc381018a0 2024-03-31T23:18:03.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.175+0000 7fcc2effd640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcc240a2590 0x7fcc240a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.175+0000 7fcc3d901640 1 -- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcc240a2590 msgr2=0x7fcc240a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:03.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.175+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7fcc280cf130 con 0x7fcc381018a0 2024-03-31T23:18:03.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.175+0000 7fcc3d901640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcc240a2590 0x7fcc240a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:18:03.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.179+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcc28053280 con 0x7fcc381018a0 2024-03-31T23:18:03.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.365+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fcc381a0320 con 0x7fcc381018a0 2024-03-31T23:18:03.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.370+0000 7fcc2effd640 1 -- 172.21.15.42:0/768742795 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v27)=0 v27) ==== 133+0+0 (secure 0 0 0) 0x7fcc2809bf60 con 0x7fcc381018a0 2024-03-31T23:18:03.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcc240a2590 msgr2=0x7fcc240a4a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:18:03.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcc240a2590 0x7fcc240a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 msgr2=0x7fcc38197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 0x7fcc38197ff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800e9f0 tx=0x7fcc2800edf0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 shutdown_connections 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc38102260 0x7fcc3819f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7fcc240a2590 0x7fcc240a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc381018a0 0x7fcc38197ff0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 --2- 172.21.15.42:0/768742795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc381006b0 0x7fcc38197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 >> 172.21.15.42:0/768742795 conn(0x7fcc380fbc20 msgr2=0x7fcc380fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 shutdown_connections 2024-03-31T23:18:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.372+0000 7fcc3fb65640 1 -- 172.21.15.42:0/768742795 wait complete. 2024-03-31T23:18:03.385 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-03-31T23:18:03.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- 172.21.15.42:0/2578031703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58101074b0 msgr2=0x7f58101098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- 172.21.15.42:0/2578031703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58101074b0 0x7f58101098a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5808009ca0 tx=0x7f580802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- 172.21.15.42:0/2578031703 shutdown_connections 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- 172.21.15.42:0/2578031703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58101074b0 0x7f58101098a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- 172.21.15.42:0/2578031703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5810104b80 0x7f5810106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- 172.21.15.42:0/2578031703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5810102250 0x7f5810104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- 172.21.15.42:0/2578031703 >> 172.21.15.42:0/2578031703 conn(0x7f58100fbbe0 msgr2=0x7f58100fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- 172.21.15.42:0/2578031703 shutdown_connections 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- 172.21.15.42:0/2578031703 wait complete. 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 Processor -- start 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- start start 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5810102250 0x7f5810101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5810104b80 0x7f5810100200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58101074b0 0x7f5810100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f581010d540 con 0x7f5810104b80 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f581010d3c0 con 0x7f5810102250 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.494+0000 7f58170c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f581010d6c0 con 0x7f58101074b0 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5810104b80 0x7f5810100200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5810104b80 0x7f5810100200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59908/0 (socket says 172.21.15.42:59908) 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 -- 172.21.15.42:0/1185204658 learned_addr learned my addr 172.21.15.42:0/1185204658 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f5814e65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5810102250 0x7f5810101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f5815666640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58101074b0 0x7f5810100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58101074b0 msgr2=0x7f5810100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58101074b0 0x7f5810100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5810102250 msgr2=0x7f5810101bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5810102250 0x7f5810101bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:03.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 -- 172.21.15.42:0/1185204658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5810100fd0 con 0x7f5810104b80 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5810102250 0x7f5810101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580ffff640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5810104b80 0x7f5810100200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00e9f0 tx=0x7f57fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00ccc0 con 0x7f5810104b80 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57fc005520 con 0x7f5810104b80 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58101a1bd0 con 0x7f5810104b80 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.495+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc010690 con 0x7f5810104b80 2024-03-31T23:18:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.496+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58101a20d0 con 0x7f5810104b80 2024-03-31T23:18:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.497+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58100fd6d0 con 0x7f5810104b80 2024-03-31T23:18:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.497+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 137337+0+0 (secure 0 0 0) 0x7f57fc004f70 con 0x7f5810104b80 2024-03-31T23:18:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.498+0000 7f580dffb640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.498+0000 7f5814e65640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:03.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.498+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9150+0+0 (secure 0 0 0) 0x7f57fc0cef10 con 0x7f5810104b80 2024-03-31T23:18:03.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.498+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T23:18:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.503+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f57fc09bce0 con 0x7f5810104b80 2024-03-31T23:18:03.672 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:03.315+0000 7f30b2785200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:18:03.672 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:03.420+0000 7f30b2785200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:18:03.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.699+0000 7f5814e65640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:03.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.699+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-31T23:18:03.705 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:03.415+0000 7f3fd45f8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:18:03.705 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:03.528+0000 7f3fd45f8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:18:03.705 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:03.331+0000 7f1f0dc31200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T23:18:03.705 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:03.436+0000 7f1f0dc31200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T23:18:03.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:03.710+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 --> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5810061b90 con 0x7f58000a2590 2024-03-31T23:18:03.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: scrub queued for path: / 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2512001378' entity='client.admin' 2024-03-31T23:18:03.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:03 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/768742795' entity='client.admin' 2024-03-31T23:18:04.009 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: scrub queued for path: / 2024-03-31T23:18:04.009 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:04.009 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:18:04.009 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:04.010 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-31T23:18:04.010 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-31T23:18:04.010 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2512001378' entity='client.admin' 2024-03-31T23:18:04.010 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:03 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/768742795' entity='client.admin' 2024-03-31T23:18:04.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: scrub queued for path: / 2024-03-31T23:18:04.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:04.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:18:04.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:04.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-31T23:18:04.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-31T23:18:04.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2512001378' entity='client.admin' 2024-03-31T23:18:04.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:03 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/768742795' entity='client.admin' 2024-03-31T23:18:04.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:04.100+0000 7f5814e65640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:04.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:04.100+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-31T23:18:04.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.112+0000 7f1f0dc31200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:18:04.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.208+0000 7f1f0dc31200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:18:04.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.094+0000 7f30b2785200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:18:04.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.188+0000 7f30b2785200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:18:04.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.331+0000 7f30b2785200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:18:04.683 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:04.375+0000 7f3fd45f8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T23:18:04.683 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:04.520+0000 7f3fd45f8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T23:18:04.683 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:04.682+0000 7f3fd45f8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:18:04.791 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.441+0000 7f30b2785200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:18:04.792 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.525+0000 7f30b2785200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:18:04.814 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.353+0000 7f1f0dc31200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T23:18:04.814 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.452+0000 7f1f0dc31200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:18:04.814 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.538+0000 7f1f0dc31200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:18:04.814 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.813+0000 7f1f0dc31200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:18:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:04.901+0000 7f5814e65640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:04.901+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-31T23:18:04.968 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:04.807+0000 7f3fd45f8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T23:18:04.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:04.919+0000 7f3fd45f8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T23:18:05.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:04.928+0000 7f1f0dc31200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:18:05.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:05.017+0000 7f1f0dc31200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:18:05.135 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.790+0000 7f30b2785200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:18:05.135 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:04.935+0000 7f30b2785200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:18:05.135 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:05.036+0000 7f30b2785200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:18:05.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:05.134+0000 7f30b2785200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:18:05.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:05.310+0000 7f30b2785200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:18:05.565 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:05.249+0000 7f3fd45f8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T23:18:05.565 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:05.367+0000 7f3fd45f8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T23:18:05.565 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:05.467+0000 7f3fd45f8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T23:18:05.565 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:05.563+0000 7f3fd45f8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:18:05.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:05.115+0000 7f1f0dc31200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T23:18:05.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:05.295+0000 7f1f0dc31200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:18:05.968 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:05.761+0000 7f3fd45f8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T23:18:06.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:06.502+0000 7f5814e65640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:06.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:06.502+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-31T23:18:06.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:06.292+0000 7f1f0dc31200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:18:06.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:06.429+0000 7f1f0dc31200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:18:06.672 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:06.283+0000 7f30b2785200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:18:06.672 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:06.415+0000 7f30b2785200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:18:07.072 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:06.772+0000 7f1f0dc31200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:18:07.072 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:06.866+0000 7f1f0dc31200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:18:07.072 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:07.071+0000 7f1f0dc31200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:18:07.079 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:06.751+0000 7f30b2785200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:18:07.080 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:06.847+0000 7f30b2785200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:18:07.218 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:06.920+0000 7f3fd45f8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T23:18:07.219 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:07.090+0000 7f3fd45f8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T23:18:07.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:07.265+0000 7f1f0dc31200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:18:07.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:07.078+0000 7f30b2785200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:18:07.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:07.287+0000 7f30b2785200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:18:07.718 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:07.466+0000 7f3fd45f8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T23:18:07.719 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:07.581+0000 7f3fd45f8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T23:18:07.825 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:07.562+0000 7f1f0dc31200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:18:07.922 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:07.606+0000 7f30b2785200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:18:08.218 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:07.809+0000 7f3fd45f8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:18:08.218 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:08.024+0000 7f3fd45f8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T23:18:08.268 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:07.946+0000 7f30b2785200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:18:08.268 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:08.267+0000 7f30b2785200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:18:08.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:07.825+0000 7f1f0dc31200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:18:08.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:08.072+0000 7f1f0dc31200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:18:08.685 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:08.358+0000 7f3fd45f8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T23:18:08.686 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:08.684+0000 7f3fd45f8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T23:18:09.325 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:08.917+0000 7f1f0dc31200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:18:09.468 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:09.013+0000 7f3fd45f8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T23:18:09.672 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:09.182+0000 7f30b2785200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:18:09.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:09.706+0000 7f5814e65640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2637331812 2024-03-31T23:18:09.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:09.706+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-03-31T23:18:09.825 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:09.504+0000 7f1f0dc31200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:18:09.825 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:09.608+0000 7f1f0dc31200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:18:09.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:09.847+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 20) ==== 137005+0+0 (secure 0 0 0) 0x7f57fc097c50 con 0x7f5810104b80 2024-03-31T23:18:09.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:09.847+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 msgr2=0x7f58000a4a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:18:09.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:09.847+0000 7f580dffb640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/2637331812,v1:172.21.15.42:6801/2637331812] conn(0x7f58000a2590 0x7f58000a4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:10.086 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:09.835+0000 7f1f0dc31200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: Active manager daemon x restarted 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: Activating manager daemon x 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: osdmap e94: 12 total, 12 up, 12 in 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: mgrmap e20: x(active, starting, since 0.0122159s), standbys: z, y 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:18:10.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:18:10.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-31T23:18:10.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:09 smithi042 ceph-mon[32380]: Manager daemon x is now available 2024-03-31T23:18:10.172 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:09.846+0000 7f30b2785200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:18:10.172 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:09.961+0000 7f30b2785200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: Active manager daemon x restarted 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: Activating manager daemon x 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: osdmap e94: 12 total, 12 up, 12 in 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: mgrmap e20: x(active, starting, since 0.0122159s), standbys: z, y 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:18:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:18:10.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-31T23:18:10.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:09 smithi094 ceph-mon[36167]: Manager daemon x is now available 2024-03-31T23:18:10.218 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:10.084+0000 7f3fd45f8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: Active manager daemon x restarted 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: Activating manager daemon x 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: osdmap e94: 12 total, 12 up, 12 in 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: mgrmap e20: x(active, starting, since 0.0122159s), standbys: z, y 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-31T23:18:10.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-31T23:18:10.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-31T23:18:10.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:09 smithi188 ceph-mon[36068]: Manager daemon x is now available 2024-03-31T23:18:10.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e6d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e6d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e6d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e6d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e6d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e7060e700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e7060e700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e7060e700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e7060e700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.576 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:18:10.085+0000 7f1e7060e700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:18:10.672 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y[37551]: 2024-03-31T23:18:10.220+0000 7f30b2785200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:18:10.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.853+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 21) ==== 137132+0+0 (secure 0 0 0) 0x7f57fc0cc6a0 con 0x7f5810104b80 2024-03-31T23:18:10.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.853+0000 7f580dffb640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f580006a260 0x7f580006a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:10.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.853+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 --> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f57fc0d10a0 con 0x7f580006a260 2024-03-31T23:18:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.857+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f580006a260 0x7f580006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.859+0000 7f5814e65640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f580006a260 0x7f580006a640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5804009fd0 tx=0x7f5804005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:10.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.929+0000 7f580dffb640 1 -- 172.21.15.42:0/1185204658 <== mgr.15714 v2:172.21.15.42:6800/4058163900 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f57fc0d10a0 con 0x7f580006a260 2024-03-31T23:18:10.930 INFO:teuthology.orchestra.run.smithi042.stdout:Schedule set for path / 2024-03-31T23:18:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f580006a260 msgr2=0x7f580006a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f580006a260 0x7f580006a640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5804009fd0 tx=0x7f5804005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5810104b80 msgr2=0x7f5810100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 --2- 172.21.15.42:0/1185204658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5810104b80 0x7f5810100200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00e9f0 tx=0x7f57fc00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:18:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f5815666640 1 -- 172.21.15.42:0/1185204658 reap_dead start 2024-03-31T23:18:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 shutdown_connections 2024-03-31T23:18:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 >> 172.21.15.42:0/1185204658 conn(0x7f58100fbbe0 msgr2=0x7f5810102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 shutdown_connections 2024-03-31T23:18:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:10.931+0000 7f58170c9640 1 -- 172.21.15.42:0/1185204658 wait complete. 2024-03-31T23:18:10.943 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-03-31T23:18:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/3063784740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4102230 msgr2=0x7fbcf4108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/3063784740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4102230 0x7fbcf4108ac0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009ca0 tx=0x7fbcec02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/3063784740 shutdown_connections 2024-03-31T23:18:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/3063784740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4102230 0x7fbcf4108ac0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/3063784740 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbcf4101870 0x7fbcf4101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/3063784740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf4100680 0x7fbcf4100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/3063784740 >> 172.21.15.42:0/3063784740 conn(0x7fbcf40fbc10 msgr2=0x7fbcf40fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/3063784740 shutdown_connections 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.049+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/3063784740 wait complete. 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 Processor -- start 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 -- start start 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 0x7fbcf406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbcf4101870 0x7fbcf419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf4102230 0x7fbcf419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf410c430 con 0x7fbcf4100680 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf410c2b0 con 0x7fbcf4102230 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfbcd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf410c5b0 con 0x7fbcf4101870 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 0x7fbcf406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 0x7fbcf406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44854/0 (socket says 172.21.15.42:44854) 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 -- 172.21.15.42:0/2823272818 learned_addr learned my addr 172.21.15.42:0/2823272818 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcfa273640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf4102230 0x7fbcf419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9271640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbcf4101870 0x7fbcf419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 -- 172.21.15.42:0/2823272818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbcf4101870 msgr2=0x7fbcf419c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbcf4101870 0x7fbcf419c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 -- 172.21.15.42:0/2823272818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf4102230 msgr2=0x7fbcf419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf4102230 0x7fbcf419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.050+0000 7fbcf9a72640 1 -- 172.21.15.42:0/2823272818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf419f660 con 0x7fbcf4100680 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.051+0000 7fbcf9a72640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 0x7fbcf406ab60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e9c0 tx=0x7fbcf000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.051+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000cd80 con 0x7fbcf4100680 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.051+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcf00035f0 con 0x7fbcf4100680 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.051+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf419f950 con 0x7fbcf4100680 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.051+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0010690 con 0x7fbcf4100680 2024-03-31T23:18:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.051+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf419fef0 con 0x7fbcf4100680 2024-03-31T23:18:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.052+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf41078d0 con 0x7fbcf4100680 2024-03-31T23:18:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.053+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 21) ==== 137132+0+0 (secure 0 0 0) 0x7fbcf00037a0 con 0x7fbcf4100680 2024-03-31T23:18:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.053+0000 7fbceaffd640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbce00a23d0 0x7fbce00a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.053+0000 7fbcf9271640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbce00a23d0 0x7fbce00a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.053+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fbcf00ceb60 con 0x7fbcf4100680 2024-03-31T23:18:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.054+0000 7fbcf9271640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbce00a23d0 0x7fbce00a4890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcf406a8d0 tx=0x7fbce400b390 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.058+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbcf009bb80 con 0x7fbcf4100680 2024-03-31T23:18:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:18:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-31T23:18:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-31T23:18:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: Standby manager daemon y restarted 2024-03-31T23:18:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: Standby manager daemon y started 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: [31/Mar/2024:23:18:10] ENGINE Bus STARTING 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: [31/Mar/2024:23:18:10] ENGINE Serving on https://172.21.15.42:7150 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: [31/Mar/2024:23:18:10] ENGINE Serving on http://172.21.15.42:8765 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: [31/Mar/2024:23:18:10] ENGINE Bus STARTED 2024-03-31T23:18:11.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:10 smithi094 ceph-mon[36167]: mgrmap e21: x(active, since 1.02024s), standbys: z, y 2024-03-31T23:18:11.218 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:10.827+0000 7f3fd45f8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:10.975+0000 7f3fd45f8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: Standby manager daemon y restarted 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: Standby manager daemon y started 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: [31/Mar/2024:23:18:10] ENGINE Bus STARTING 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: [31/Mar/2024:23:18:10] ENGINE Serving on https://172.21.15.42:7150 2024-03-31T23:18:11.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: [31/Mar/2024:23:18:10] ENGINE Serving on http://172.21.15.42:8765 2024-03-31T23:18:11.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: [31/Mar/2024:23:18:10] ENGINE Bus STARTED 2024-03-31T23:18:11.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:10 smithi188 ceph-mon[36068]: mgrmap e21: x(active, since 1.02024s), standbys: z, y 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: Standby manager daemon y restarted 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: Standby manager daemon y started 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-31T23:18:11.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.94:0/3618075042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: [31/Mar/2024:23:18:10] ENGINE Bus STARTING 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: [31/Mar/2024:23:18:10] ENGINE Serving on https://172.21.15.42:7150 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: [31/Mar/2024:23:18:10] ENGINE Serving on http://172.21.15.42:8765 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: [31/Mar/2024:23:18:10] ENGINE Bus STARTED 2024-03-31T23:18:11.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:10 smithi042 ceph-mon[32380]: mgrmap e21: x(active, since 1.02024s), standbys: z, y 2024-03-31T23:18:11.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.267+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 --> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fbcf4061b90 con 0x7fbce00a23d0 2024-03-31T23:18:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.321+0000 7fbceaffd640 1 -- 172.21.15.42:0/2823272818 <== mgr.15714 v2:172.21.15.42:6800/4058163900 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fbcf4061b90 con 0x7fbce00a23d0 2024-03-31T23:18:11.322 INFO:teuthology.orchestra.run.smithi042.stdout:Retention added to path / 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbce00a23d0 msgr2=0x7fbce00a4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbce00a23d0 0x7fbce00a4890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcf406a8d0 tx=0x7fbce400b390 comp rx=0 tx=0).stop 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 msgr2=0x7fbcf406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 0x7fbcf406ab60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e9c0 tx=0x7fbcf000ee80 comp rx=0 tx=0).stop 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 shutdown_connections 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf4102230 0x7fbcf419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbcf4101870 0x7fbcf419c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbce00a23d0 0x7fbce00a4890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 --2- 172.21.15.42:0/2823272818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcf4100680 0x7fbcf406ab60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 >> 172.21.15.42:0/2823272818 conn(0x7fbcf40fbc10 msgr2=0x7fbcf4104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 shutdown_connections 2024-03-31T23:18:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.324+0000 7fbcfbcd6640 1 -- 172.21.15.42:0/2823272818 wait complete. 2024-03-31T23:18:11.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-31T23:18:11.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 -- 172.21.15.42:0/1702047533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66581033f0 msgr2=0x7f6658109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 --2- 172.21.15.42:0/1702047533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66581033f0 0x7f6658109c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6650009cd0 tx=0x7f665002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 -- 172.21.15.42:0/1702047533 shutdown_connections 2024-03-31T23:18:11.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 --2- 172.21.15.42:0/1702047533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66581033f0 0x7f6658109c80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 --2- 172.21.15.42:0/1702047533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6658102a30 0x7f6658102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 --2- 172.21.15.42:0/1702047533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66580ffa60 0x7f66580ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 -- 172.21.15.42:0/1702047533 >> 172.21.15.42:0/1702047533 conn(0x7f66580fb3b0 msgr2=0x7f66580fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 -- 172.21.15.42:0/1702047533 shutdown_connections 2024-03-31T23:18:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.440+0000 7f665e17a640 1 -- 172.21.15.42:0/1702047533 wait complete. 2024-03-31T23:18:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 Processor -- start 2024-03-31T23:18:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 -- start start 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 0x7f66581023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6658102a30 0x7f66581009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66581033f0 0x7f6658100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f665810d570 con 0x7f66580ffa60 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f665810d3f0 con 0x7f6658102a30 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f665e17a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f665810d6f0 con 0x7f66581033f0 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 0x7f66581023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 0x7f66581023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44884/0 (socket says 172.21.15.42:44884) 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 -- 172.21.15.42:0/2381772760 learned_addr learned my addr 172.21.15.42:0/2381772760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:11.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f6656ffd640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6658102a30 0x7f66581009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f6657fff640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66581033f0 0x7f6658100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 -- 172.21.15.42:0/2381772760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66581033f0 msgr2=0x7f6658100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66581033f0 0x7f6658100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 -- 172.21.15.42:0/2381772760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6658102a30 msgr2=0x7f66581009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6658102a30 0x7f66581009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.441+0000 7f66577fe640 1 -- 172.21.15.42:0/2381772760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66581017b0 con 0x7f66580ffa60 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.442+0000 7f66577fe640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 0x7f66581023a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f664c00e9c0 tx=0x7f664c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.442+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c00cd80 con 0x7f66580ffa60 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.442+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f664c0035f0 con 0x7f66580ffa60 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.442+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c010670 con 0x7f66580ffa60 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.442+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66581a1b80 con 0x7f66580ffa60 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.442+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66581a2080 con 0x7f66580ffa60 2024-03-31T23:18:11.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.443+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6658108a90 con 0x7f66580ffa60 2024-03-31T23:18:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.444+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 21) ==== 137132+0+0 (secure 0 0 0) 0x7f664c0037a0 con 0x7f66580ffa60 2024-03-31T23:18:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.444+0000 7f6654ff9640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f66400a2350 0x7f66400a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.444+0000 7f6656ffd640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f66400a2350 0x7f66400a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.444+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f664c0ceb70 con 0x7f66580ffa60 2024-03-31T23:18:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.445+0000 7f6656ffd640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f66400a2350 0x7f66400a4810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6658102110 tx=0x7f6648005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:11.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.449+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f664c09bb90 con 0x7f66580ffa60 2024-03-31T23:18:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.655+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 --> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6658061b90 con 0x7f66400a2350 2024-03-31T23:18:11.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.662+0000 7f6654ff9640 1 -- 172.21.15.42:0/2381772760 <== mgr.15714 v2:172.21.15.42:6800/4058163900 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f6658061b90 con 0x7f66400a2350 2024-03-31T23:18:11.663 INFO:teuthology.orchestra.run.smithi042.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-31T00:00:00", "created": "2024-03-31T23:18:10", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f66400a2350 msgr2=0x7f66400a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f66400a2350 0x7f66400a4810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6658102110 tx=0x7f6648005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 msgr2=0x7f66581023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 0x7f66581023a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f664c00e9c0 tx=0x7f664c00ee80 comp rx=0 tx=0).stop 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 shutdown_connections 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66581033f0 0x7f6658100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6658102a30 0x7f66581009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f66400a2350 0x7f66400a4810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 --2- 172.21.15.42:0/2381772760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66580ffa60 0x7f66581023a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 >> 172.21.15.42:0/2381772760 conn(0x7f66580fb3b0 msgr2=0x7f6658105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 shutdown_connections 2024-03-31T23:18:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.664+0000 7f665e17a640 1 -- 172.21.15.42:0/2381772760 wait complete. 2024-03-31T23:18:11.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-31T23:18:11.718 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z[37918]: 2024-03-31T23:18:11.226+0000 7f3fd45f8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 -- 172.21.15.42:0/4255846735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 msgr2=0x7fdc28100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 --2- 172.21.15.42:0/4255846735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28100ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009900 tx=0x7fdc2402bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 -- 172.21.15.42:0/4255846735 shutdown_connections 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 --2- 172.21.15.42:0/4255846735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc28108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 --2- 172.21.15.42:0/4255846735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc281018a0 0x7fdc28101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 --2- 172.21.15.42:0/4255846735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28100ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 -- 172.21.15.42:0/4255846735 >> 172.21.15.42:0/4255846735 conn(0x7fdc280fbc20 msgr2=0x7fdc280fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 -- 172.21.15.42:0/4255846735 shutdown_connections 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.788+0000 7fdc30264640 1 -- 172.21.15.42:0/4255846735 wait complete. 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 Processor -- start 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 -- start start 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc281018a0 0x7fdc28198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc2819f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810c410 con 0x7fdc28102260 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810c290 con 0x7fdc281006b0 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc30264640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810c590 con 0x7fdc281018a0 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc2819f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc2819f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44914/0 (socket says 172.21.15.42:44914) 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 -- 172.21.15.42:0/2460026762 learned_addr learned my addr 172.21.15.42:0/2460026762 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2d7ff640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc281018a0 0x7fdc28198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 -- 172.21.15.42:0/2460026762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc281018a0 msgr2=0x7fdc28198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc281018a0 0x7fdc28198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 -- 172.21.15.42:0/2460026762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 msgr2=0x7fdc28197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e801640 1 -- 172.21.15.42:0/2460026762 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2819f6d0 con 0x7fdc28102260 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.789+0000 7fdc2e000640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.790+0000 7fdc2e801640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc2819f060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000eb10 tx=0x7fdc2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.790+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20004b20 con 0x7fdc28102260 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.790+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc20004cc0 con 0x7fdc28102260 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.790+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2819f9c0 con 0x7fdc28102260 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.790+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc200107f0 con 0x7fdc28102260 2024-03-31T23:18:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.790+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2819fec0 con 0x7fdc28102260 2024-03-31T23:18:11.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.791+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc281a00f0 con 0x7fdc28102260 2024-03-31T23:18:11.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.792+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 21) ==== 137132+0+0 (secure 0 0 0) 0x7fdc20005020 con 0x7fdc28102260 2024-03-31T23:18:11.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.793+0000 7fdc1effd640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fdc140a2350 0x7fdc140a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:11.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.793+0000 7fdc2e000640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fdc140a2350 0x7fdc140a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:11.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.793+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fdc200cedb0 con 0x7fdc28102260 2024-03-31T23:18:11.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.793+0000 7fdc2e000640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fdc140a2350 0x7fdc140a4810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc24000c00 tx=0x7fdc24005fd0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.798+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fdc200d3070 con 0x7fdc28102260 2024-03-31T23:18:11.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:11.908+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 22) ==== 137440+0+0 (secure 0 0 0) 0x7fdc20097d20 con 0x7fdc28102260 2024-03-31T23:18:12.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.038+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 --> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fdc281a02c0 con 0x7fdc140a2350 2024-03-31T23:18:12.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.045+0000 7fdc1effd640 1 -- 172.21.15.42:0/2460026762 <== mgr.15714 v2:172.21.15.42:6800/4058163900 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fdc281a02c0 con 0x7fdc140a2350 2024-03-31T23:18:12.045 INFO:teuthology.orchestra.run.smithi042.stdout:/ 1m 6m3h 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fdc140a2350 msgr2=0x7fdc140a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fdc140a2350 0x7fdc140a4810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc24000c00 tx=0x7fdc24005fd0 comp rx=0 tx=0).stop 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 msgr2=0x7fdc2819f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc2819f060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000eb10 tx=0x7fdc2000c2d0 comp rx=0 tx=0).stop 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 shutdown_connections 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fdc140a2350 0x7fdc140a4810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28102260 0x7fdc2819f060 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc281018a0 0x7fdc28198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 --2- 172.21.15.42:0/2460026762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc281006b0 0x7fdc28197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 >> 172.21.15.42:0/2460026762 conn(0x7fdc280fbc20 msgr2=0x7fdc28069960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 shutdown_connections 2024-03-31T23:18:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:12.047+0000 7fdc30264640 1 -- 172.21.15.42:0/2460026762 wait complete. 2024-03-31T23:18:12.059 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: Standby manager daemon z restarted 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: Standby manager daemon z started 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.060 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:11 smithi042 ceph-mon[32380]: from='client.15777 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-03-31T23:18:12.091 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-03-31T23:18:12.103 INFO:teuthology.run_tasks:Running task background_exec... 2024-03-31T23:18:12.125 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:18:12.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-03-31T23:18:12.134 INFO:teuthology.run_tasks:Running task workunit... 2024-03-31T23:18:12.146 INFO:tasks.workunit:Pulling workunits from ref 384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:18:12.146 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-31T23:18:12.146 INFO:tasks.workunit:timeout=3h 2024-03-31T23:18:12.146 INFO:tasks.workunit:cleanup=True 2024-03-31T23:18:12.147 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-31 23:16:02.354698837 +0000 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-31 23:16:02.354698837 +0000 2024-03-31T23:18:12.163 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-31 23:17:53.387165007 +0000 2024-03-31T23:18:12.164 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-31 23:16:02.354698837 +0000 2024-03-31T23:18:12.164 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-31T23:18:12.164 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: Standby manager daemon z restarted 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: Standby manager daemon z started 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:18:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:11 smithi094 ceph-mon[36167]: from='client.15777 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: Standby manager daemon z restarted 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: Standby manager daemon z started 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='mgr.? 172.21.15.188:0/3716156267' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:11 smithi188 ceph-mon[36068]: from='client.15777 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:12.239 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 384f31f3d3aee7f8ba3f60846b8844c049165583 2024-03-31T23:18:12.294 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:12 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:12 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:13.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-03-31T23:18:13.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:18:13.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:13.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:12 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi042 to 177.2M 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Unable to set osd_memory_target on smithi042 to 185897779: error parsing value: Value '185897779' is below minimum 939524096 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi094 to 174.1M 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Unable to set osd_memory_target on smithi094 to 182619136: error parsing value: Value '182619136' is below minimum 939524096 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi188 to 174.1M 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Unable to set osd_memory_target on smithi188 to 182618419: error parsing value: Value '182618419' is below minimum 939524096 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:18:14.328 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:14 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:18:14.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi042 to 177.2M 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Unable to set osd_memory_target on smithi042 to 185897779: error parsing value: Value '185897779' is below minimum 939524096 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi094 to 174.1M 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Unable to set osd_memory_target on smithi094 to 182619136: error parsing value: Value '182619136' is below minimum 939524096 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi188 to 174.1M 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Unable to set osd_memory_target on smithi188 to 182618419: error parsing value: Value '182618419' is below minimum 939524096 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:18:14.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:18:14.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:18:14.675 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:14 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi042 to 177.2M 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Unable to set osd_memory_target on smithi042 to 185897779: error parsing value: Value '185897779' is below minimum 939524096 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi094 to 174.1M 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Unable to set osd_memory_target on smithi094 to 182619136: error parsing value: Value '182619136' is below minimum 939524096 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.720 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi188 to 174.1M 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Unable to set osd_memory_target on smithi188 to 182618419: error parsing value: Value '182618419' is below minimum 939524096 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Updating smithi042:/etc/ceph/ceph.conf 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Updating smithi094:/etc/ceph/ceph.conf 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: Updating smithi188:/etc/ceph/ceph.conf 2024-03-31T23:18:14.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:14 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:18:15.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi094:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-03-31T23:18:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:18:15.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi094:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:18:15.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi094:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: Updating smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:18:15.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:18:17.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:17 smithi042 ceph-mon[32380]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:17.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:17 smithi094 ceph-mon[36167]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:17.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:17 smithi188 ceph-mon[36068]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:18:19.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:19 smithi042 ceph-mon[32380]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-03-31T23:18:19.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:19 smithi094 ceph-mon[36167]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-03-31T23:18:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:19 smithi188 ceph-mon[36068]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-03-31T23:18:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:21 smithi042 ceph-mon[32380]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-03-31T23:18:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:21 smithi094 ceph-mon[36167]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-03-31T23:18:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:21 smithi188 ceph-mon[36068]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-03-31T23:18:23.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:23 smithi042 ceph-mon[32380]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-03-31T23:18:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:23 smithi094 ceph-mon[36167]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-03-31T23:18:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:23 smithi188 ceph-mon[36068]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-03-31T23:18:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 -- 172.21.15.42:0/3696027869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a60102ad0 msgr2=0x7f3a6010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 --2- 172.21.15.42:0/3696027869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a60102ad0 0x7f3a6010d600 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009ca0 tx=0x7f3a5802c1d0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 -- 172.21.15.42:0/3696027869 shutdown_connections 2024-03-31T23:18:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 --2- 172.21.15.42:0/3696027869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a60102ad0 0x7f3a6010d600 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 --2- 172.21.15.42:0/3696027869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 0x7f3a60102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 --2- 172.21.15.42:0/3696027869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a601009f0 0x7f3a60100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 -- 172.21.15.42:0/3696027869 >> 172.21.15.42:0/3696027869 conn(0x7f3a60077770 msgr2=0x7f3a60077b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 -- 172.21.15.42:0/3696027869 shutdown_connections 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.276+0000 7f3a68556640 1 -- 172.21.15.42:0/3696027869 wait complete. 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 Processor -- start 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 -- start start 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 0x7f3a60198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 0x7f3a601993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a60102ad0 0x7f3a601a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60110c60 con 0x7f3a601009f0 2024-03-31T23:18:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60110ae0 con 0x7f3a60102130 2024-03-31T23:18:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a68556640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60110de0 con 0x7f3a60102ad0 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 0x7f3a60198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a65af1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 0x7f3a601993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 0x7f3a60198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55828/0 (socket says 172.21.15.42:55828) 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a662f2640 1 -- 172.21.15.42:0/3287262958 learned_addr learned my addr 172.21.15.42:0/3287262958 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a66af3640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a60102ad0 0x7f3a601a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.277+0000 7f3a662f2640 1 -- 172.21.15.42:0/3287262958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a60102ad0 msgr2=0x7f3a601a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a662f2640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a60102ad0 0x7f3a601a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a662f2640 1 -- 172.21.15.42:0/3287262958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 msgr2=0x7f3a601993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a662f2640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 0x7f3a601993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a662f2640 1 -- 172.21.15.42:0/3287262958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a601a4460 con 0x7f3a601009f0 2024-03-31T23:18:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a65af1640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 0x7f3a601993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a662f2640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 0x7f3a60198ea0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00ea60 tx=0x7f3a5c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a577fe640 1 -- 172.21.15.42:0/3287262958 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00cde0 con 0x7f3a601009f0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a577fe640 1 -- 172.21.15.42:0/3287262958 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a5c0035f0 con 0x7f3a601009f0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a601a4690 con 0x7f3a601009f0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a577fe640 1 -- 172.21.15.42:0/3287262958 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c010720 con 0x7f3a601009f0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.278+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a601a4bb0 con 0x7f3a601009f0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a577fe640 1 -- 172.21.15.42:0/3287262958 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f3a5c0037a0 con 0x7f3a601009f0 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 Processor -- start 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 -- start start 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad128aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad131870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad1341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8ad08b8f0 con 0x55e8ad128fe0 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e8ad0348d0 con 0x55e8ad1286c0 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a6b219740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e8ad087990 con 0x55e8ad131db0 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a577fe640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f3a4c0a2750 0x7f3a4c0a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a66af3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad128aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad131870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.281+0000 7f3a66af3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad128aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41492/0 (socket says 172.21.15.42:41492) 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a66af3640 1 -- 172.21.15.42:0/1052732063 learned_addr learned my addr 172.21.15.42:0/1052732063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a65af1640 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad1341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a66af3640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f3a4c0a2750 0x7f3a4c0a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a577fe640 1 -- 172.21.15.42:0/3287262958 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f3a5c0cf440 con 0x7f3a601009f0 2024-03-31T23:18:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a662f2640 1 -- 172.21.15.42:0/1052732063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 msgr2=0x55e8ad1341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a662f2640 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad1341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a662f2640 1 -- 172.21.15.42:0/1052732063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 msgr2=0x55e8ad128aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a662f2640 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad128aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a662f2640 1 -- 172.21.15.42:0/1052732063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8acda0210 con 0x55e8ad128fe0 2024-03-31T23:18:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a66af3640 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad128aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a662f2640 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad131870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0cc720 tx=0x7f3a5c06e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc4fc8b282e2c14 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a66af3640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f3a4c0a2750 0x7f3a4c0a4c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a58032650 tx=0x7f3a58005c50 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a54bfe640 1 -- 172.21.15.42:0/1052732063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c09b000 con 0x55e8ad128fe0 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a54bfe640 1 -- 172.21.15.42:0/1052732063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a5c003bc0 con 0x55e8ad128fe0 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.282+0000 7f3a54bfe640 1 -- 172.21.15.42:0/1052732063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c013190 con 0x55e8ad128fe0 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 -- 172.21.15.42:0/1052732063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 msgr2=0x55e8ad131870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad131870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0cc720 tx=0x7f3a5c06e710 comp rx=0 tx=0).stop 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 -- 172.21.15.42:0/1052732063 shutdown_connections 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad1341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad131870 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1052732063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad128aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 -- 172.21.15.42:0/1052732063 >> 172.21.15.42:0/1052732063 conn(0x55e8ad122fe0 msgr2=0x55e8ad1233c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 -- 172.21.15.42:0/1052732063 shutdown_connections 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 -- 172.21.15.42:0/1052732063 wait complete. 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.283+0000 7f3a6b219740 1 -- start start 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 Processor -- start 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8ad134920 con 0x55e8ad128fe0 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e8ad029f80 con 0x55e8ad1286c0 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e8ad134aa0 con 0x55e8ad131db0 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a6b219740 10 client.0 _ll_register_callbacks cb 0x55e8ad082290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41504/0 (socket says 172.21.15.42:41504) 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a662f2640 1 -- 172.21.15.42:0/294090107 learned_addr learned my addr 172.21.15.42:0/294090107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a66af3640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 -- 172.21.15.42:0/294090107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 msgr2=0x55e8ad12f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 -- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 msgr2=0x55e8ad12ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 -- 172.21.15.42:0/294090107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8ace6c620 con 0x55e8ad128fe0 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a662f2640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a65af1640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12f460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55e8ad124170 tx=0x7f3a5000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1038561584563501 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.284+0000 7f3a49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a49ffb640 1 -- 172.21.15.42:0/294090107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50012110 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a49ffb640 1 -- 172.21.15.42:0/294090107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f3a50004050 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e8ad09f120 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a49ffb640 1 -- 172.21.15.42:0/294090107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a500122b0 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 10 client.15801 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8ad140990 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a49ffb640 1 -- 172.21.15.42:0/294090107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55e8ad09f120 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a49ffb640 1 -- 172.21.15.42:0/294090107 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3a50010550 con 0x55e8ad128fe0 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 10 client.15801 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 20 client.15801 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad141e50 0x55e8ad144240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 4 client.15801 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8ad098e30 con 0x55e8ad141e50 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.285+0000 7f3a662f2640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad141e50 0x55e8ad144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.286+0000 7f3a662f2640 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad141e50 0x55e8ad144240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd40e6296a8e1dc server_cookie=fd3cef5ce21d9dc7 in_seq=0 out_seq=0 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.286+0000 7f3a49ffb640 10 client.15801 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.286+0000 7f3a49ffb640 1 -- 172.21.15.42:0/294090107 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e8ad098e30 con 0x55e8ad141e50 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.286+0000 7f3a49ffb640 10 client.15801 handle_command_reply: tid=0 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.286+0000 7f3a6b219740 1 client.15801 shutdown 2024-03-31T23:18:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 msgr2=0x55e8ad12f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12f460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55e8ad124170 tx=0x7f3a5000f790 comp rx=0 tx=0).stop 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 shutdown_connections 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad141e50 0x55e8ad144240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12f460 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a49ffb640 0 client.15801 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 --2- 172.21.15.42:0/294090107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 >> 172.21.15.42:0/294090107 conn(0x55e8ad122fe0 msgr2=0x55e8ad124d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 shutdown_connections 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 1 -- 172.21.15.42:0/294090107 wait complete. 2024-03-31T23:18:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.287+0000 7f3a6b219740 20 client.15801 trim_cache size 0 max 16384 2024-03-31T23:18:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 Processor -- start 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 -- start start 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 0x55e8ad131650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad128fe0 0x55e8ad13d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad131db0 0x55e8ad121e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601aec10 con 0x55e8ad1286c0 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601b0750 con 0x55e8ad131db0 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a6b219740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601af2e0 con 0x55e8ad128fe0 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 0x55e8ad131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 0x55e8ad131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55866/0 (socket says 172.21.15.42:55866) 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 -- 172.21.15.42:0/1069561913 learned_addr learned my addr 172.21.15.42:0/1069561913 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a65af1640 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad128fe0 0x55e8ad13d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a66af3640 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad131db0 0x55e8ad121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 -- 172.21.15.42:0/1069561913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad128fe0 msgr2=0x55e8ad13d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad128fe0 0x55e8ad13d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 -- 172.21.15.42:0/1069561913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad131db0 msgr2=0x55e8ad121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad131db0 0x55e8ad121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.302+0000 7f3a662f2640 1 -- 172.21.15.42:0/1069561913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8ad12d490 con 0x55e8ad1286c0 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a662f2640 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 0x55e8ad131650 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00d010 tx=0x7f3a5c097940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54358d7fbee4c3fa server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a4bfff640 1 -- 172.21.15.42:0/1069561913 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c09bda0 con 0x55e8ad1286c0 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a4bfff640 1 -- 172.21.15.42:0/1069561913 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a5c09f7f0 con 0x55e8ad1286c0 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a4bfff640 1 -- 172.21.15.42:0/1069561913 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0cf250 con 0x55e8ad1286c0 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 -- 172.21.15.42:0/1069561913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 msgr2=0x55e8ad131650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 0x55e8ad131650 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00d010 tx=0x7f3a5c097940 comp rx=0 tx=0).stop 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 -- 172.21.15.42:0/1069561913 shutdown_connections 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad131db0 0x55e8ad121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad128fe0 0x55e8ad13d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 --2- 172.21.15.42:0/1069561913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad1286c0 0x55e8ad131650 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 -- 172.21.15.42:0/1069561913 >> 172.21.15.42:0/1069561913 conn(0x55e8ad122fe0 msgr2=0x55e8ad1216f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 -- 172.21.15.42:0/1069561913 shutdown_connections 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.303+0000 7f3a6b219740 1 -- 172.21.15.42:0/1069561913 wait complete. 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 -- start start 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 Processor -- start 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601b0080 con 0x55e8ad128fe0 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601af9b0 con 0x55e8ad1286c0 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601acbd0 con 0x55e8ad131db0 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a6b219740 10 client.0 _ll_register_callbacks cb 0x7f3a50009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a65af1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a65af1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55872/0 (socket says 172.21.15.42:55872) 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a65af1640 1 -- 172.21.15.42:0/743607370 learned_addr learned my addr 172.21.15.42:0/743607370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a662f2640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a66af3640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a662f2640 1 -- 172.21.15.42:0/743607370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 msgr2=0x55e8ad12c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a662f2640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a662f2640 1 -- 172.21.15.42:0/743607370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 msgr2=0x55e8ad12c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a662f2640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a662f2640 1 -- 172.21.15.42:0/743607370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8ad1ab590 con 0x55e8ad1286c0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.304+0000 7f3a65af1640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a662f2640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12bb40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0a3b80 tx=0x7f3a5c099a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd37af22b0d6cf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a49ffb640 1 -- 172.21.15.42:0/743607370 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c09bda0 con 0x55e8ad1286c0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a5c09f7f0 con 0x55e8ad1286c0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a49ffb640 1 -- 172.21.15.42:0/743607370 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f3a5c097d10 con 0x55e8ad1286c0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a49ffb640 1 -- 172.21.15.42:0/743607370 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c0a40b0 con 0x55e8ad1286c0 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 10 client.25634 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8ad1ac880 con 0x55e8ad1286c0 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a49ffb640 1 -- 172.21.15.42:0/743607370 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a5c09f7f0 con 0x55e8ad1286c0 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a49ffb640 1 -- 172.21.15.42:0/743607370 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3a5c084be0 con 0x55e8ad1286c0 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 10 client.25634 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 10 client.25634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 20 client.25634 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad1acac0 0x55e8ad1aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 4 client.25634 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.305+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8ad093180 con 0x55e8ad1acac0 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.306+0000 7f3a65af1640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad1acac0 0x55e8ad1aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.306+0000 7f3a65af1640 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad1acac0 0x55e8ad1aeeb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c733c87f149d89e server_cookie=a83faf1a3905a549 in_seq=0 out_seq=0 2024-03-31T23:18:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.306+0000 7f3a49ffb640 10 client.25634 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a49ffb640 1 -- 172.21.15.42:0/743607370 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8ad093180 con 0x55e8ad1acac0 2024-03-31T23:18:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a49ffb640 10 client.25634 handle_command_reply: tid=0 2024-03-31T23:18:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 client.25634 shutdown 2024-03-31T23:18:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 msgr2=0x55e8ad12bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12bb40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0a3b80 tx=0x7f3a5c099a20 comp rx=0 tx=0).stop 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 shutdown_connections 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e8ad1acac0 0x55e8ad1aeeb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e8ad131db0 0x55e8ad12c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a49ffb640 0 client.25634 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8ad128fe0 0x55e8ad12c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 --2- 172.21.15.42:0/743607370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8ad1286c0 0x55e8ad12bb40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 >> 172.21.15.42:0/743607370 conn(0x55e8ad122fe0 msgr2=0x55e8ad121f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 shutdown_connections 2024-03-31T23:18:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.317+0000 7f3a6b219740 1 -- 172.21.15.42:0/743607370 wait complete. 2024-03-31T23:18:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a6b219740 20 client.25634 trim_cache size 0 max 16384 2024-03-31T23:18:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:18:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:18:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:18:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:18:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f3a4c0a2750 msgr2=0x7f3a4c0a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f3a4c0a2750 0x7f3a4c0a4c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a58032650 tx=0x7f3a58005c50 comp rx=0 tx=0).stop 2024-03-31T23:18:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 msgr2=0x7f3a60198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 0x7f3a60198ea0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00ea60 tx=0x7f3a5c00ef20 comp rx=0 tx=0).stop 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 shutdown_connections 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a60102ad0 0x7f3a601a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a60102130 0x7f3a601993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f3a4c0a2750 0x7f3a4c0a4c10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 --2- 172.21.15.42:0/3287262958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a601009f0 0x7f3a60198ea0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 >> 172.21.15.42:0/3287262958 conn(0x7f3a60077770 msgr2=0x7f3a60105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 shutdown_connections 2024-03-31T23:18:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:25.318+0000 7f3a68556640 1 -- 172.21.15.42:0/3287262958 wait complete. 2024-03-31T23:18:25.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:25 smithi042 ceph-mon[32380]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-31T23:18:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:25 smithi094 ceph-mon[36167]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-31T23:18:25.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:25 smithi188 ceph-mon[36068]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-31T23:18:27.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:27 smithi042 ceph-mon[32380]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 53 op/s 2024-03-31T23:18:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:27 smithi094 ceph-mon[36167]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 53 op/s 2024-03-31T23:18:27.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:27 smithi188 ceph-mon[36068]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 53 op/s 2024-03-31T23:18:29.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:29 smithi042 ceph-mon[32380]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 KiB/s wr, 59 op/s 2024-03-31T23:18:29.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:29 smithi094 ceph-mon[36167]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 KiB/s wr, 59 op/s 2024-03-31T23:18:29.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:29 smithi188 ceph-mon[36068]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 KiB/s wr, 59 op/s 2024-03-31T23:18:31.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:18:31.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:18:31.921 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:31 smithi094 ceph-mon[36167]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-03-31T23:18:31.946 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:31 smithi042 ceph-mon[32380]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-03-31T23:18:31.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:31 smithi188 ceph-mon[36068]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 -- 172.21.15.42:0/1753371140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 msgr2=0x7f840810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 --2- 172.21.15.42:0/1753371140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840810e200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8400009ca0 tx=0x7f840002c180 comp rx=0 tx=0).stop 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 -- 172.21.15.42:0/1753371140 shutdown_connections 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 --2- 172.21.15.42:0/1753371140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840810e200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 --2- 172.21.15.42:0/1753371140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84081032e0 0x7f840810b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 --2- 172.21.15.42:0/1753371140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 0x7f8408102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 -- 172.21.15.42:0/1753371140 >> 172.21.15.42:0/1753371140 conn(0x7f84080777b0 msgr2=0x7f8408077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 -- 172.21.15.42:0/1753371140 shutdown_connections 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 -- 172.21.15.42:0/1753371140 wait complete. 2024-03-31T23:18:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 Processor -- start 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.035+0000 7f840daf4640 1 -- start start 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f840daf4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 0x7f84081980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f840daf4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84081032e0 0x7f8408198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f840daf4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f840daf4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8408111c80 con 0x7f84081032e0 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f840daf4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8408111b00 con 0x7f840810bd90 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f840daf4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8408111e00 con 0x7f84081029c0 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84081032e0 0x7f8408198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f84077fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 0x7f84081980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840819c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41554/0 (socket says 172.21.15.42:41554) 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f84077fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 0x7f84081980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33316/0 (socket says 172.21.15.42:33316) 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 -- 172.21.15.42:0/1312369113 learned_addr learned my addr 172.21.15.42:0/1312369113 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 -- 172.21.15.42:0/1312369113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 msgr2=0x7f84081980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 0x7f84081980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 -- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84081032e0 msgr2=0x7f8408198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84081032e0 0x7f8408198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 -- 172.21.15.42:0/1312369113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840819d0b0 con 0x7f840810bd90 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8407fff640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840819c980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f840002c790 tx=0x7f84000346f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.036+0000 7f8404ff9640 1 -- 172.21.15.42:0/1312369113 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400039040 con 0x7f840810bd90 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.037+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840819d340 con 0x7f840810bd90 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.037+0000 7f8404ff9640 1 -- 172.21.15.42:0/1312369113 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8400044070 con 0x7f840810bd90 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.037+0000 7f8404ff9640 1 -- 172.21.15.42:0/1312369113 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400004330 con 0x7f840810bd90 2024-03-31T23:18:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.037+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84081a4c30 con 0x7f840810bd90 2024-03-31T23:18:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f8404ff9640 1 -- 172.21.15.42:0/1312369113 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f84000044d0 con 0x7f840810bd90 2024-03-31T23:18:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 Processor -- start 2024-03-31T23:18:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 -- start start 2024-03-31T23:18:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f8404ff9640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f83f00a26a0 0x7f83f00a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc1d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1dbb0 0x56542fc26250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc26790 0x56542fc28b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56542fb81180 con 0x56542fc26790 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56542fb29b70 con 0x56542fc1d290 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84107b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56542fb7d220 con 0x56542fc1dbb0 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f8406ffd640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f83f00a26a0 0x7f83f00a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f8404ff9640 1 -- 172.21.15.42:0/1312369113 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f84000f1270 con 0x7f840810bd90 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84077fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc1d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84077fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc1d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41556/0 (socket says 172.21.15.42:41556) 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1dbb0 0x56542fc26250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f84077fe640 1 -- 172.21.15.42:0/1545038408 learned_addr learned my addr 172.21.15.42:0/1545038408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.039+0000 7f8407fff640 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc26790 0x56542fc28b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f84077fe640 1 -- 172.21.15.42:0/1545038408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1dbb0 msgr2=0x56542fc26250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f84077fe640 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1dbb0 0x56542fc26250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f84077fe640 1 -- 172.21.15.42:0/1545038408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc26790 msgr2=0x56542fc28b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f84077fe640 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc26790 0x56542fc28b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f84077fe640 1 -- 172.21.15.42:0/1545038408 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542fb3d7c0 con 0x56542fc1d290 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f8406ffd640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f83f00a26a0 0x7f83f00a4b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f840810d8e0 tx=0x7f83fc009a30 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f84077fe640 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc1d670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009d20 tx=0x7f83f8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be21b9163781cdf server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f83edffb640 1 -- 172.21.15.42:0/1545038408 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8019620 con 0x56542fc1d290 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f83edffb640 1 -- 172.21.15.42:0/1545038408 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83f8019cc0 con 0x56542fc1d290 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.040+0000 7f83edffb640 1 -- 172.21.15.42:0/1545038408 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8018d10 con 0x56542fc1d290 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 -- 172.21.15.42:0/1545038408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 msgr2=0x56542fc1d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc1d670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009d20 tx=0x7f83f8011810 comp rx=0 tx=0).stop 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 -- 172.21.15.42:0/1545038408 shutdown_connections 2024-03-31T23:18:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc26790 0x56542fc28b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1dbb0 0x56542fc26250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 --2- 172.21.15.42:0/1545038408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc1d670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 -- 172.21.15.42:0/1545038408 >> 172.21.15.42:0/1545038408 conn(0x56542fc179c0 msgr2=0x56542fc17da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 -- 172.21.15.42:0/1545038408 shutdown_connections 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 -- 172.21.15.42:0/1545038408 wait complete. 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 -- start start 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.041+0000 7f84107b4740 1 Processor -- start 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 0x56542fc23710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc23c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc26790 0x56542fc24190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56542fc29580 con 0x56542fc1dbb0 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56542fb1f4a0 con 0x56542fc26790 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56542fc29700 con 0x56542fc1d290 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 10 client.0 _ll_register_callbacks cb 0x56542fb22d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc23c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84077fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 0x56542fc23710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc23c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55904/0 (socket says 172.21.15.42:55904) 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84077fe640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 0x56542fc23710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33334/0 (socket says 172.21.15.42:33334) 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 -- 172.21.15.42:0/1747461648 learned_addr learned my addr 172.21.15.42:0/1747461648 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8407fff640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc26790 0x56542fc24190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 -- 172.21.15.42:0/1747461648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 msgr2=0x56542fc23710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 0x56542fc23710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 -- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc26790 msgr2=0x56542fc24190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc26790 0x56542fc24190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 -- 172.21.15.42:0/1747461648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56542f95f7d0 con 0x56542fc1dbb0 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84077fe640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 0x56542fc23710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8407fff640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc26790 0x56542fc24190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f8406ffd640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc23c50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f83fc011c60 tx=0x7f83fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87317dc967d7537 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f83e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f83e6ffd640 1 -- 172.21.15.42:0/1747461648 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc01fe50 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f83e6ffd640 1 -- 172.21.15.42:0/1747461648 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f83fc02c480 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.042+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83f8019cc0 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f83e6ffd640 1 -- 172.21.15.42:0/1747461648 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83fc035050 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 10 client.15819 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56542f8953f0 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f83e6ffd640 1 -- 172.21.15.42:0/1747461648 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83f8019cc0 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f83e6ffd640 1 -- 172.21.15.42:0/1747461648 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f83fc020050 con 0x56542fc1dbb0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 10 client.15819 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 20 client.15819 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc36ad0 0x56542fc38ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 4 client.15819 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56542fb8e6c0 con 0x56542fc36ad0 2024-03-31T23:18:32.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.043+0000 7f84077fe640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc36ad0 0x56542fc38ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.044+0000 7f83e6ffd640 10 client.15819 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.044+0000 7f84077fe640 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc36ad0 0x56542fc38ef0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c92b1b10b552a31b server_cookie=d536c9fdab36c89e in_seq=0 out_seq=0 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f83e6ffd640 1 -- 172.21.15.42:0/1747461648 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56542fb8e6c0 con 0x56542fc36ad0 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f83e6ffd640 10 client.15819 handle_command_reply: tid=0 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 client.15819 shutdown 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 msgr2=0x56542fc23c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc23c50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f83fc011c60 tx=0x7f83fc004730 comp rx=0 tx=0).stop 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 shutdown_connections 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc36ad0 0x56542fc38ef0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc26790 0x56542fc24190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc23c50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f83e6ffd640 0 client.15819 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 --2- 172.21.15.42:0/1747461648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc1d290 0x56542fc23710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 >> 172.21.15.42:0/1747461648 conn(0x56542fc179c0 msgr2=0x56542fc19710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 shutdown_connections 2024-03-31T23:18:32.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 1 -- 172.21.15.42:0/1747461648 wait complete. 2024-03-31T23:18:32.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.045+0000 7f84107b4740 20 client.15819 trim_cache size 0 max 16384 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 Processor -- start 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 -- start start 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc25e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc32350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc16aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84081aebd0 con 0x56542fc1dbb0 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84081b0710 con 0x56542fc1d290 2024-03-31T23:18:32.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84107b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84081af2a0 con 0x56542fc26790 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc32350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8407fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc16aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc32350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55916/0 (socket says 172.21.15.42:55916) 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 -- 172.21.15.42:0/2157041077 learned_addr learned my addr 172.21.15.42:0/2157041077 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84077fe640 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc25e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 -- 172.21.15.42:0/2157041077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 msgr2=0x56542fc16aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc16aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 -- 172.21.15.42:0/2157041077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 msgr2=0x56542fc25e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc25e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8406ffd640 1 -- 172.21.15.42:0/2157041077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542fc1d9e0 con 0x56542fc1dbb0 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f8407fff640 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc16aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.063+0000 7f84077fe640 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc25e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f8406ffd640 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc32350 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0058c0 tx=0x7f83fc00e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10c62ba841cbc35 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f83ed7fa640 1 -- 172.21.15.42:0/2157041077 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0097a0 con 0x56542fc1dbb0 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f83ed7fa640 1 -- 172.21.15.42:0/2157041077 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83fc01fe50 con 0x56542fc1dbb0 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f83ed7fa640 1 -- 172.21.15.42:0/2157041077 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00ede0 con 0x56542fc1dbb0 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 -- 172.21.15.42:0/2157041077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 msgr2=0x56542fc32350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc32350 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0058c0 tx=0x7f83fc00e430 comp rx=0 tx=0).stop 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 -- 172.21.15.42:0/2157041077 shutdown_connections 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc16aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc32350 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 --2- 172.21.15.42:0/2157041077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc25e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 -- 172.21.15.42:0/2157041077 >> 172.21.15.42:0/2157041077 conn(0x56542fc179c0 msgr2=0x56542fc16390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.064+0000 7f84107b4740 1 -- 172.21.15.42:0/2157041077 shutdown_connections 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 -- 172.21.15.42:0/2157041077 wait complete. 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 -- start start 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 Processor -- start 2024-03-31T23:18:32.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc2ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc1ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84081b0040 con 0x56542fc1dbb0 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84081af970 con 0x56542fc1d290 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84081acb90 con 0x56542fc26790 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84107b4740 10 client.0 _ll_register_callbacks cb 0x7f83fc009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc1ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc1ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55932/0 (socket says 172.21.15.42:55932) 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f8406ffd640 1 -- 172.21.15.42:0/2403289463 learned_addr learned my addr 172.21.15.42:0/2403289463 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f8407fff640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.065+0000 7f84077fe640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc2ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f8406ffd640 1 -- 172.21.15.42:0/2403289463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 msgr2=0x56542fc204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f8406ffd640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f8406ffd640 1 -- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 msgr2=0x56542fc2ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f8406ffd640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc2ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f8406ffd640 1 -- 172.21.15.42:0/2403289463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56542f8550f0 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f8406ffd640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc1ff80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f83fc011850 tx=0x7f83fc00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafe8e9b30914664 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f83e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f83e6ffd640 1 -- 172.21.15.42:0/2403289463 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc03e070 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f83e6ffd640 1 -- 172.21.15.42:0/2403289463 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f83fc004430 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83fc01fe50 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f83e6ffd640 1 -- 172.21.15.42:0/2403289463 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83fc047050 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f84107b4740 10 client.15825 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56542fc9cbb0 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.066+0000 7f83e6ffd640 1 -- 172.21.15.42:0/2403289463 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83fc01fe50 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f83e6ffd640 1 -- 172.21.15.42:0/2403289463 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f83fc041020 con 0x56542fc1dbb0 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:32.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 20 client.15825 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc9d260 0x56542fc9f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 4 client.15825 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56542fb88a10 con 0x56542fc9d260 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84077fe640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc9d260 0x56542fc9f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f83e6ffd640 10 client.15825 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84077fe640 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc9d260 0x56542fc9f680 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=266177fc78938f28 server_cookie=746b4c4b0f102e57 in_seq=0 out_seq=0 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f83e6ffd640 1 -- 172.21.15.42:0/2403289463 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56542fb88a10 con 0x56542fc9d260 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f83e6ffd640 10 client.15825 handle_command_reply: tid=0 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 1 client.15825 shutdown 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 msgr2=0x56542fc1ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.067+0000 7f84107b4740 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc1ff80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f83fc011850 tx=0x7f83fc00e940 comp rx=0 tx=0).stop 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 shutdown_connections 2024-03-31T23:18:32.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56542fc9d260 0x56542fc9f680 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56542fc26790 0x56542fc204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56542fc1dbb0 0x56542fc1ff80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f83e6ffd640 0 client.15825 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 --2- 172.21.15.42:0/2403289463 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56542fc1d290 0x56542fc2ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 >> 172.21.15.42:0/2403289463 conn(0x56542fc179c0 msgr2=0x56542fc16c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 shutdown_connections 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 1 -- 172.21.15.42:0/2403289463 wait complete. 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f84107b4740 20 client.15825 trim_cache size 0 max 16384 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-03-31T23:18:32.075 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-03-31T23:18:32.076 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:18:32.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f83f00a26a0 msgr2=0x7f83f00a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f83f00a26a0 0x7f83f00a4b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f840810d8e0 tx=0x7f83fc009a30 comp rx=0 tx=0).stop 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 msgr2=0x7f840819c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840819c980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f840002c790 tx=0x7f84000346f0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 shutdown_connections 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f840810bd90 0x7f840819c980 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f83f00a26a0 0x7f83f00a4b60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84081032e0 0x7f8408198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 --2- 172.21.15.42:0/1312369113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84081029c0 0x7f84081980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 >> 172.21.15.42:0/1312369113 conn(0x7f84080777b0 msgr2=0x7f84080fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 shutdown_connections 2024-03-31T23:18:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.068+0000 7f840daf4640 1 -- 172.21.15.42:0/1312369113 wait complete. 2024-03-31T23:18:32.080 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-31T23:18:32.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:18:32.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 -- 172.21.15.42:0/2150199440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 msgr2=0x7fa0bc10d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/2150199440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc10d520 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009930 tx=0x7fa0b402bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 -- 172.21.15.42:0/2150199440 shutdown_connections 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/2150199440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc10d520 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/2150199440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0bc100650 0x7fa0bc100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/2150199440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc106660 0x7fa0bc106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 -- 172.21.15.42:0/2150199440 >> 172.21.15.42:0/2150199440 conn(0x7fa0bc077750 msgr2=0x7fa0bc077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 -- 172.21.15.42:0/2150199440 shutdown_connections 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.223+0000 7fa0c3b25640 1 -- 172.21.15.42:0/2150199440 wait complete. 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 Processor -- start 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 -- start start 2024-03-31T23:18:32.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc100650 0x7fa0bc1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0bc106660 0x7fa0bc19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111c40 con 0x7fa0bc101010 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111ac0 con 0x7fa0bc106660 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c3b25640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111dc0 con 0x7fa0bc100650 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55956/0 (socket says 172.21.15.42:55956) 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 -- 172.21.15.42:0/142389993 learned_addr learned my addr 172.21.15.42:0/142389993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c18c1640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc100650 0x7fa0bc1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c20c2640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0bc106660 0x7fa0bc19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 -- 172.21.15.42:0/142389993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc100650 msgr2=0x7fa0bc1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc100650 0x7fa0bc1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 -- 172.21.15.42:0/142389993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0bc106660 msgr2=0x7fa0bc19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0bc106660 0x7fa0bc19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.224+0000 7fa0c10c0640 1 -- 172.21.15.42:0/142389993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc19d0b0 con 0x7fa0bc101010 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.225+0000 7fa0c10c0640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc198600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.225+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00cd80 con 0x7fa0bc101010 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.225+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa0ac010930 con 0x7fa0bc101010 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.225+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc19d3a0 con 0x7fa0bc101010 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.225+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac018b00 con 0x7fa0bc101010 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.225+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc1a4c30 con 0x7fa0bc101010 2024-03-31T23:18:32.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.226+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0bc068540 con 0x7fa0bc101010 2024-03-31T23:18:32.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.227+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7fa0ac018ca0 con 0x7fa0bc101010 2024-03-31T23:18:32.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.227+0000 7fa0b2ffd640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fa0a80a26a0 0x7fa0a80a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.228+0000 7fa0c18c1640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fa0a80a26a0 0x7fa0a80a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.228+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fa0ac0cf3b0 con 0x7fa0bc101010 2024-03-31T23:18:32.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.228+0000 7fa0c18c1640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fa0a80a26a0 0x7fa0a80a4b60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8005fd0 tx=0x7fa0b8009500 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.232+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa0ac09b6c0 con 0x7fa0bc101010 2024-03-31T23:18:32.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.453+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0bc108c20 con 0x7fa0bc101010 2024-03-31T23:18:32.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.454+0000 7fa0b2ffd640 1 -- 172.21.15.42:0/142389993 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11923 (secure 0 0 0) 0x7fa0ac09f760 con 0x7fa0bc101010 2024-03-31T23:18:32.455 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:18:32.455 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:17:54.070406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:18:32.456 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-03-31T23:18:32.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fa0a80a26a0 msgr2=0x7fa0a80a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fa0a80a26a0 0x7fa0a80a4b60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8005fd0 tx=0x7fa0b8009500 comp rx=0 tx=0).stop 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 msgr2=0x7fa0bc198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc198600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 shutdown_connections 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0bc106660 0x7fa0bc19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fa0a80a26a0 0x7fa0a80a4b60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0bc101010 0x7fa0bc198600 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 --2- 172.21.15.42:0/142389993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc100650 0x7fa0bc1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 >> 172.21.15.42:0/142389993 conn(0x7fa0bc077750 msgr2=0x7fa0bc102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 shutdown_connections 2024-03-31T23:18:32.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.456+0000 7fa0c3b25640 1 -- 172.21.15.42:0/142389993 wait complete. 2024-03-31T23:18:32.469 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/3532283205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 msgr2=0x7f8bc4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/3532283205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc4106a40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009930 tx=0x7f8bb802bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/3532283205 shutdown_connections 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/3532283205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8bc4100f80 0x7f8bc410d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/3532283205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bc41005c0 0x7f8bc4100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/3532283205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc4106a40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/3532283205 >> 172.21.15.42:0/3532283205 conn(0x7f8bc4077750 msgr2=0x7f8bc4077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/3532283205 shutdown_connections 2024-03-31T23:18:32.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/3532283205 wait complete. 2024-03-31T23:18:32.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.576+0000 7f8bc9bc7640 1 Processor -- start 2024-03-31T23:18:32.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 -- start start 2024-03-31T23:18:32.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bc41005c0 0x7f8bc4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8bc4100f80 0x7f8bc41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4110a70 con 0x7f8bc4106660 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41108f0 con 0x7f8bc4100f80 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc9bc7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4110bf0 con 0x7f8bc41005c0 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8bc4100f80 0x7f8bc41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55984/0 (socket says 172.21.15.42:55984) 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 -- 172.21.15.42:0/1855532754 learned_addr learned my addr 172.21.15.42:0/1855532754 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bc41005c0 0x7f8bc4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 -- 172.21.15.42:0/1855532754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bc41005c0 msgr2=0x7f8bc4198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bc41005c0 0x7f8bc4198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 -- 172.21.15.42:0/1855532754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8bc4100f80 msgr2=0x7f8bc41985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8bc4100f80 0x7f8bc41985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 -- 172.21.15.42:0/1855532754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc419d080 con 0x7f8bc4106660 2024-03-31T23:18:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.577+0000 7f8bc3fff640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc419c950 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00eb10 tx=0x7f8bbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.579+0000 7f8bc0ff9640 1 -- 172.21.15.42:0/1855532754 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc004b20 con 0x7f8bc4106660 2024-03-31T23:18:32.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.580+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc419d370 con 0x7f8bc4106660 2024-03-31T23:18:32.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.580+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc41a4c00 con 0x7f8bc4106660 2024-03-31T23:18:32.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.580+0000 7f8bc0ff9640 1 -- 172.21.15.42:0/1855532754 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bbc004cc0 con 0x7f8bc4106660 2024-03-31T23:18:32.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.580+0000 7f8bc0ff9640 1 -- 172.21.15.42:0/1855532754 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0107b0 con 0x7f8bc4106660 2024-03-31T23:18:32.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.582+0000 7f8bc0ff9640 1 -- 172.21.15.42:0/1855532754 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f8bbc010950 con 0x7f8bc4106660 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 Processor -- start 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 -- start start 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ddc4191b0 con 0x557ddc4b5d90 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557ddc3c1c00 con 0x557ddc4be970 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557ddc415250 con 0x557ddc4b5470 2024-03-31T23:18:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4be430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56000/0 (socket says 172.21.15.42:56000) 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc37fe640 1 -- 172.21.15.42:0/2694128070 learned_addr learned my addr 172.21.15.42:0/2694128070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc0ff9640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8bac0a26a0 0x7f8bac0a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/2694128070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 msgr2=0x557ddc4c0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4c0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/2694128070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 msgr2=0x557ddc4be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4be430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/2694128070 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ddc3e13d0 con 0x557ddc4b5470 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.583+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.584+0000 7f8bc3fff640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8bac0a26a0 0x7f8bac0a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.584+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4b5850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009730 tx=0x7f8bb40096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a57627034b6949 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.584+0000 7f8ba9ffb640 1 -- 172.21.15.42:0/2694128070 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4004050 con 0x557ddc4b5470 2024-03-31T23:18:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.584+0000 7f8ba9ffb640 1 -- 172.21.15.42:0/2694128070 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb4005520 con 0x557ddc4b5470 2024-03-31T23:18:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.584+0000 7f8ba9ffb640 1 -- 172.21.15.42:0/2694128070 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400f790 con 0x557ddc4b5470 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/2694128070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 msgr2=0x557ddc4b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bc3fff640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8bac0a26a0 0x7f8bac0a4b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0ccab0 tx=0x7f8bbc067950 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4b5850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009730 tx=0x7f8bb40096c0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bc0ff9640 1 -- 172.21.15.42:0/1855532754 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8bbc008fd0 con 0x7f8bc4106660 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/2694128070 shutdown_connections 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4c0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/2694128070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4b5850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/2694128070 >> 172.21.15.42:0/2694128070 conn(0x557ddc4afba0 msgr2=0x557ddc4aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/2694128070 shutdown_connections 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/2694128070 wait complete. 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 -- start start 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.585+0000 7f8bcc7a2740 1 Processor -- start 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4bba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc4bc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ddc4c1760 con 0x557ddc4b5470 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557ddc3b7470 con 0x557ddc4b5d90 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557ddc4c18e0 con 0x557ddc4be970 2024-03-31T23:18:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bcc7a2740 10 client.0 _ll_register_callbacks cb 0x557ddc3d4cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4bba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56010/0 (socket says 172.21.15.42:56010) 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3937198882 learned_addr learned my addr 172.21.15.42:0/3937198882 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc4bc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 -- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 msgr2=0x557ddc4bc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc4bc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 -- 172.21.15.42:0/3937198882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 msgr2=0x557ddc4bba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4bba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 -- 172.21.15.42:0/3937198882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ddc12d3f0 con 0x557ddc4b5d90 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4bba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4bbf80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009900 tx=0x7f8bb802ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545886b62e876fb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.586+0000 7f8ba2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:18:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3937198882 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8004250 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb4005520 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3937198882 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8bb80043f0 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3937198882 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8bb804d050 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 10 client.25670 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ddc1f77d0 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3937198882 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb4005520 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3937198882 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8bb80035f0 con 0x557ddc4b5d90 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 10 client.25670 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 10 client.25670 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 20 client.25670 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc4cea20 0x557ddc4d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 4 client.25670 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ddc4266f0 con 0x557ddc4cea20 2024-03-31T23:18:32.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.587+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc4cea20 0x557ddc4d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.588+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc4cea20 0x557ddc4d0e10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8425c92b88dfbc2b server_cookie=10d0a0329e4878ff in_seq=0 out_seq=0 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.588+0000 7f8ba2ffd640 10 client.25670 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.588+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3937198882 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557ddc4266f0 con 0x557ddc4cea20 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.588+0000 7f8ba2ffd640 10 client.25670 handle_command_reply: tid=0 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.588+0000 7f8bcc7a2740 1 client.25670 shutdown 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 msgr2=0x557ddc4bbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4bbf80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009900 tx=0x7f8bb802ccd0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 shutdown_connections 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc4bc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4bbf80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc4cea20 0x557ddc4d0e10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3937198882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4bba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8ba2ffd640 0 client.25670 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:18:32.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 >> 172.21.15.42:0/3937198882 conn(0x557ddc4afba0 msgr2=0x557ddc4b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 shutdown_connections 2024-03-31T23:18:32.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3937198882 wait complete. 2024-03-31T23:18:32.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.589+0000 7f8bcc7a2740 20 client.25670 trim_cache size 0 max 16384 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 Processor -- start 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 -- start start 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41aecc0 con 0x557ddc4b5d90 2024-03-31T23:18:32.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41b0800 con 0x557ddc4be970 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.602+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41af390 con 0x557ddc4b5470 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56012/0 (socket says 172.21.15.42:56012) 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc37fe640 1 -- 172.21.15.42:0/3773372131 learned_addr learned my addr 172.21.15.42:0/3773372131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3773372131 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 msgr2=0x557ddc4ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3773372131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 msgr2=0x557ddc4aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3773372131 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ddc4ba9f0 con 0x557ddc4b5470 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4be170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4004b80 tx=0x7f8bb4011550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2134bbff15727a12 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8ba97fa640 1 -- 172.21.15.42:0/3773372131 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb402db40 con 0x557ddc4b5470 2024-03-31T23:18:32.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8ba97fa640 1 -- 172.21.15.42:0/3773372131 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb402dce0 con 0x557ddc4b5470 2024-03-31T23:18:32.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.603+0000 7f8ba97fa640 1 -- 172.21.15.42:0/3773372131 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4005210 con 0x557ddc4b5470 2024-03-31T23:18:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3773372131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 msgr2=0x557ddc4be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4be170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4004b80 tx=0x7f8bb4011550 comp rx=0 tx=0).stop 2024-03-31T23:18:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3773372131 shutdown_connections 2024-03-31T23:18:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4be970 0x557ddc4ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5d90 0x557ddc4aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3773372131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4b5470 0x557ddc4be170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3773372131 >> 172.21.15.42:0/3773372131 conn(0x557ddc4afba0 msgr2=0x557ddc4aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3773372131 shutdown_connections 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3773372131 wait complete. 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.604+0000 7f8bcc7a2740 1 -- start start 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 Processor -- start 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc533cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41b0130 con 0x557ddc4b5470 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41afa60 con 0x557ddc4b5d90 2024-03-31T23:18:32.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41acc80 con 0x557ddc4be970 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bcc7a2740 10 client.0 _ll_register_callbacks cb 0x7f8bb802c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4c2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56020/0 (socket says 172.21.15.42:56020) 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3366681099 learned_addr learned my addr 172.21.15.42:0/3366681099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc533cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 msgr2=0x557ddc533cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc533cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3366681099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 msgr2=0x557ddc4c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 -- 172.21.15.42:0/3366681099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ddc4d1180 con 0x557ddc4b5470 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8bc2ffd640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4c2890 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009b10 tx=0x7f8bb4011280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88903056426c527b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.605+0000 7f8ba2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3366681099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb402d590 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3366681099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8bb402d730 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb402dce0 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3366681099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8bb4011320 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 10 client.15849 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ddc5351d0 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3366681099 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb402dce0 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3366681099 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8bb402d070 con 0x557ddc4b5470 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 10 client.15849 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 10 client.15849 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 20 client.15849 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc535730 0x557ddc537b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 4 client.15849 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:18:32.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ddc420a40 con 0x557ddc535730 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.606+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc535730 0x557ddc537b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8ba2ffd640 10 client.15849 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bc37fe640 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc535730 0x557ddc537b50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c280f1cd35052442 server_cookie=ab2e2bf49bd98ef4 in_seq=0 out_seq=0 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8ba2ffd640 1 -- 172.21.15.42:0/3366681099 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ddc420a40 con 0x557ddc535730 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8ba2ffd640 10 client.15849 handle_command_reply: tid=0 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 client.15849 shutdown 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 msgr2=0x557ddc4c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4c2890 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009b10 tx=0x7f8bb4011280 comp rx=0 tx=0).stop 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 shutdown_connections 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ddc4be970 0x557ddc533cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557ddc4b5d90 0x557ddc4c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x557ddc535730 0x557ddc537b50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 --2- 172.21.15.42:0/3366681099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ddc4b5470 0x557ddc4c2890 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8ba2ffd640 0 client.15849 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:18:32.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 >> 172.21.15.42:0/3366681099 conn(0x557ddc4afba0 msgr2=0x557ddc4ae4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 shutdown_connections 2024-03-31T23:18:32.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 1 -- 172.21.15.42:0/3366681099 wait complete. 2024-03-31T23:18:32.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.607+0000 7f8bcc7a2740 20 client.15849 trim_cache size 0 max 16384 2024-03-31T23:18:32.615 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8bac0a26a0 msgr2=0x7f8bac0a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8bac0a26a0 0x7f8bac0a4b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0ccab0 tx=0x7f8bbc067950 comp rx=0 tx=0).stop 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 msgr2=0x7f8bc419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc419c950 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00eb10 tx=0x7f8bbc00c2d0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 shutdown_connections 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8bac0a26a0 0x7f8bac0a4b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bc4106660 0x7f8bc419c950 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8bc4100f80 0x7f8bc41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 --2- 172.21.15.42:0/1855532754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bc41005c0 0x7f8bc4198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 >> 172.21.15.42:0/1855532754 conn(0x7f8bc4077750 msgr2=0x7f8bc40ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 shutdown_connections 2024-03-31T23:18:32.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.608+0000 7f8bc9bc7640 1 -- 172.21.15.42:0/1855532754 wait complete. 2024-03-31T23:18:32.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-31T23:18:32.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 -- 172.21.15.42:0/2133607529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8106660 msgr2=0x7f0ac8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/2133607529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8106660 0x7f0ac8106a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009900 tx=0x7f0ab802bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:32.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 -- 172.21.15.42:0/2133607529 shutdown_connections 2024-03-31T23:18:32.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/2133607529 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ac8100f80 0x7f0ac810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/2133607529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac8100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/2133607529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8106660 0x7f0ac8106a40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 -- 172.21.15.42:0/2133607529 >> 172.21.15.42:0/2133607529 conn(0x7f0ac8077750 msgr2=0x7f0ac8077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 -- 172.21.15.42:0/2133607529 shutdown_connections 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 -- 172.21.15.42:0/2133607529 wait complete. 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.727+0000 7f0ace6c0640 1 Processor -- start 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 -- start start 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8100f80 0x7f0ac819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ac8106660 0x7f0ac819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8110b00 con 0x7f0ac81005c0 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8110980 con 0x7f0ac8100f80 2024-03-31T23:18:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ace6c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8110c80 con 0x7f0ac8106660 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56032/0 (socket says 172.21.15.42:56032) 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac7fff640 1 -- 172.21.15.42:0/1882447783 learned_addr learned my addr 172.21.15.42:0/1882447783 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8100f80 0x7f0ac819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0accc5d640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ac8106660 0x7f0ac819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac77fe640 1 -- 172.21.15.42:0/1882447783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ac8106660 msgr2=0x7f0ac819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ac8106660 0x7f0ac819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac77fe640 1 -- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 msgr2=0x7f0ac819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac77fe640 1 -- 172.21.15.42:0/1882447783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac819f250 con 0x7f0ac8100f80 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.728+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.729+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8100f80 0x7f0ac819a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00e9f0 tx=0x7f0abc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.729+0000 7f0ac57fa640 1 -- 172.21.15.42:0/1882447783 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00ccc0 con 0x7f0ac8100f80 2024-03-31T23:18:32.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.729+0000 7f0ac57fa640 1 -- 172.21.15.42:0/1882447783 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0abc010930 con 0x7f0ac8100f80 2024-03-31T23:18:32.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.729+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac819f540 con 0x7f0ac8100f80 2024-03-31T23:18:32.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.729+0000 7f0ac57fa640 1 -- 172.21.15.42:0/1882447783 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0189f0 con 0x7f0ac8100f80 2024-03-31T23:18:32.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.729+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac81a6dd0 con 0x7f0ac8100f80 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 Processor -- start 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 -- start start 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 0x55fd2fc4f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc58430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc5ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fbb31b0 con 0x55fd2fc58970 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fb5bc00 con 0x55fd2fc4f470 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.731+0000 7f0ad137e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fbaf250 con 0x55fd2fc4fd90 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac57fa640 1 -- 172.21.15.42:0/1882447783 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f0abc010ae0 con 0x7f0ac8100f80 2024-03-31T23:18:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc58430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 0x55fd2fc4f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc58430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33440/0 (socket says 172.21.15.42:33440) 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 0x55fd2fc4f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41698/0 (socket says 172.21.15.42:41698) 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac7fff640 1 -- 172.21.15.42:0/2577871850 learned_addr learned my addr 172.21.15.42:0/2577871850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc5ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 -- 172.21.15.42:0/2577871850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 msgr2=0x55fd2fc58430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc58430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 -- 172.21.15.42:0/2577871850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 msgr2=0x55fd2fc5ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc5ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 -- 172.21.15.42:0/2577871850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2fb7b3d0 con 0x55fd2fc4f470 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc58430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0accc5d640 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 0x55fd2fc4f850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009f00 tx=0x7f0ac0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85557ab8c8843724 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac57fa640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0ab00a26a0 0x7f0ab00a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0aae7fc640 1 -- 172.21.15.42:0/2577871850 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0004d20 con 0x55fd2fc4f470 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0ab00a26a0 0x7f0ab00a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0ac57fa640 1 -- 172.21.15.42:0/1882447783 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f0abc0cf310 con 0x7f0ac8100f80 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0aae7fc640 1 -- 172.21.15.42:0/2577871850 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ac0004050 con 0x55fd2fc4f470 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.732+0000 7f0aae7fc640 1 -- 172.21.15.42:0/2577871850 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0005260 con 0x55fd2fc4f470 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 -- 172.21.15.42:0/2577871850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 msgr2=0x55fd2fc4f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 0x55fd2fc4f850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009f00 tx=0x7f0ac0011810 comp rx=0 tx=0).stop 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0ab00a26a0 0x7f0ab00a4b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005c40 tx=0x7f0ab802e040 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 -- 172.21.15.42:0/2577871850 shutdown_connections 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc5ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc58430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2577871850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4f470 0x55fd2fc4f850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 -- 172.21.15.42:0/2577871850 >> 172.21.15.42:0/2577871850 conn(0x55fd2fc49ba0 msgr2=0x55fd2fc49f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 -- 172.21.15.42:0/2577871850 shutdown_connections 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 -- 172.21.15.42:0/2577871850 wait complete. 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.733+0000 7f0ad137e740 1 -- start start 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 Processor -- start 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 0x55fd2fc55a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc55f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc56490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fc5b760 con 0x55fd2fc58970 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fb51470 con 0x55fd2fc4fd90 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fc5b8e0 con 0x55fd2fc4f470 2024-03-31T23:18:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ad137e740 10 client.0 _ll_register_callbacks cb 0x55fd2fb6ecb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 0x55fd2fc55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc56490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 0x55fd2fc55a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33450/0 (socket says 172.21.15.42:33450) 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ac7fff640 1 -- 172.21.15.42:0/1138038355 learned_addr learned my addr 172.21.15.42:0/1138038355 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc56490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56062/0 (socket says 172.21.15.42:56062) 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc55f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 -- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 msgr2=0x55fd2fc55a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 0x55fd2fc55a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 -- 172.21.15.42:0/1138038355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 msgr2=0x55fd2fc55f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc55f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0accc5d640 1 -- 172.21.15.42:0/1138038355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2f8c73f0 con 0x55fd2fc58970 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 0x55fd2fc55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.734+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc55f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0accc5d640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc56490 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0ac001b040 tx=0x7f0ac00044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5d1a0f0b3fe84 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0aa77fe640 1 -- 172.21.15.42:0/1138038355 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0029020 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0aa77fe640 1 -- 172.21.15.42:0/1138038355 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f0ac0004d30 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ac0004050 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0aa77fe640 1 -- 172.21.15.42:0/1138038355 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ac0034050 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0ad137e740 10 client.15861 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fd2f9917d0 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0aa77fe640 1 -- 172.21.15.42:0/1138038355 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ac0004050 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0aa77fe640 1 -- 172.21.15.42:0/1138038355 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0ac00052c0 con 0x55fd2fc58970 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.735+0000 7f0ad137e740 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ad137e740 10 client.15861 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ad137e740 20 client.15861 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ad137e740 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fc68c90 0x55fd2fc6b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ad137e740 4 client.15861 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd2fbc06f0 con 0x55fd2fc68c90 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fc68c90 0x55fd2fc6b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0aa77fe640 10 client.15861 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.736+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fc68c90 0x55fd2fc6b080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=df8fb40ea8b12f25 server_cookie=bf8e5e12b94dbc2c in_seq=0 out_seq=0 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0aa77fe640 1 -- 172.21.15.42:0/1138038355 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fd2fbc06f0 con 0x55fd2fc68c90 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0aa77fe640 10 client.15861 handle_command_reply: tid=0 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 client.15861 shutdown 2024-03-31T23:18:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 msgr2=0x55fd2fc56490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc56490 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0ac001b040 tx=0x7f0ac00044b0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 shutdown_connections 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fc68c90 0x55fd2fc6b080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc58970 0x55fd2fc56490 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc55f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 --2- 172.21.15.42:0/1138038355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc4f470 0x55fd2fc55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0aa77fe640 0 client.15861 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.737+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 >> 172.21.15.42:0/1138038355 conn(0x55fd2fc49ba0 msgr2=0x55fd2fc4b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.738+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 shutdown_connections 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.738+0000 7f0ad137e740 1 -- 172.21.15.42:0/1138038355 wait complete. 2024-03-31T23:18:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.738+0000 7f0ad137e740 20 client.15861 trim_cache size 0 max 16384 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 Processor -- start 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 -- start start 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc58140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc44d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fc562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81b0e00 con 0x55fd2fc4f470 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81b2940 con 0x55fd2fc4fd90 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ad137e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81b14d0 con 0x55fd2fc58970 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc58140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fc562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc44d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fc562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33462/0 (socket says 172.21.15.42:33462) 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 -- 172.21.15.42:0/165810256 learned_addr learned my addr 172.21.15.42:0/165810256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc58140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56072/0 (socket says 172.21.15.42:56072) 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 -- 172.21.15.42:0/165810256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 msgr2=0x55fd2fc44d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc44d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 -- 172.21.15.42:0/165810256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 msgr2=0x55fd2fc58140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.754+0000 7f0accc5d640 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc58140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.755+0000 7f0accc5d640 1 -- 172.21.15.42:0/165810256 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2fc549c0 con 0x55fd2fc58970 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.755+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc44d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.755+0000 7f0accc5d640 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fc562b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0003f00 tx=0x7f0ac0009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe774d551b12f25f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.755+0000 7f0aadffb640 1 -- 172.21.15.42:0/165810256 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0029040 con 0x55fd2fc58970 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.755+0000 7f0aadffb640 1 -- 172.21.15.42:0/165810256 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ac0005900 con 0x55fd2fc58970 2024-03-31T23:18:32.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.755+0000 7f0aadffb640 1 -- 172.21.15.42:0/165810256 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0004d90 con 0x55fd2fc58970 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- 172.21.15.42:0/165810256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 msgr2=0x55fd2fc562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fc562b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0003f00 tx=0x7f0ac0009e00 comp rx=0 tx=0).stop 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- 172.21.15.42:0/165810256 shutdown_connections 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fc562b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc44d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- 172.21.15.42:0/165810256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc58140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- 172.21.15.42:0/165810256 >> 172.21.15.42:0/165810256 conn(0x55fd2fc49ba0 msgr2=0x55fd2fc48d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- 172.21.15.42:0/165810256 shutdown_connections 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- 172.21.15.42:0/165810256 wait complete. 2024-03-31T23:18:32.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- start start 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 Processor -- start 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc6b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fcc5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81b2270 con 0x55fd2fc4f470 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.756+0000 7f0ad137e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81b1ba0 con 0x55fd2fc4fd90 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ad137e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81aedc0 con 0x55fd2fc58970 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ad137e740 10 client.0 _ll_register_callbacks cb 0x7f0ac0003df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc6b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc6b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc6b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56080/0 (socket says 172.21.15.42:56080) 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac7fff640 1 -- 172.21.15.42:0/2951692674 learned_addr learned my addr 172.21.15.42:0/2951692674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0accc5d640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fcc5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 -- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 msgr2=0x55fd2fcc5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fcc5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 -- 172.21.15.42:0/2951692674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 msgr2=0x55fd2fc6b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc6b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 -- 172.21.15.42:0/2951692674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2fcc6220 con 0x55fd2fc4fd90 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc6b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ac77fe640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc6b9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0cc630 tx=0x7f0abc086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2bd28c9b6acc66 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0aa77fe640 1 -- 172.21.15.42:0/2951692674 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc09afc0 con 0x55fd2fc4fd90 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0aa77fe640 1 -- 172.21.15.42:0/2951692674 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f0abc084db0 con 0x55fd2fc4fd90 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ac0005900 con 0x55fd2fc4fd90 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0aa77fe640 1 -- 172.21.15.42:0/2951692674 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0abc0cf170 con 0x55fd2fc4fd90 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ad137e740 10 client.25694 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.757+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fd2fcce7d0 con 0x55fd2fc4fd90 2024-03-31T23:18:32.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0aa77fe640 1 -- 172.21.15.42:0/2951692674 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ac0005900 con 0x55fd2fc4fd90 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0aa77fe640 1 -- 172.21.15.42:0/2951692674 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0abc09aab0 con 0x55fd2fc4fd90 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ad137e740 10 client.25694 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ad137e740 10 client.25694 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ad137e740 20 client.25694 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fccef50 0x55fd2fcd1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ad137e740 4 client.25694 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd2fbbaa40 con 0x55fd2fccef50 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fccef50 0x55fd2fcd1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0aa77fe640 10 client.25694 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.758+0000 7f0ac7fff640 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fccef50 0x55fd2fcd1370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=935b2d4740890fdd server_cookie=3a13dc4673767ec0 in_seq=0 out_seq=0 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0aa77fe640 1 -- 172.21.15.42:0/2951692674 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd2fbbaa40 con 0x55fd2fccef50 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0aa77fe640 10 client.25694 handle_command_reply: tid=0 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 client.25694 shutdown 2024-03-31T23:18:32.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 msgr2=0x55fd2fc6b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc6b9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0cc630 tx=0x7f0abc086040 comp rx=0 tx=0).stop 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 shutdown_connections 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55fd2fccef50 0x55fd2fcd1370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd2fc58970 0x55fd2fcc5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fd2fc4fd90 0x55fd2fc6b9a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 --2- 172.21.15.42:0/2951692674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd2fc4f470 0x55fd2fc6b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0aa77fe640 0 client.25694 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 >> 172.21.15.42:0/2951692674 conn(0x55fd2fc49ba0 msgr2=0x55fd2fc48d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 shutdown_connections 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 1 -- 172.21.15.42:0/2951692674 wait complete. 2024-03-31T23:18:32.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ad137e740 20 client.25694 trim_cache size 0 max 16384 2024-03-31T23:18:32.767 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:18:32.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0ab00a26a0 msgr2=0x7f0ab00a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0ab00a26a0 0x7f0ab00a4b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005c40 tx=0x7f0ab802e040 comp rx=0 tx=0).stop 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8100f80 msgr2=0x7f0ac819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.759+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8100f80 0x7f0ac819a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00e9f0 tx=0x7f0abc00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 shutdown_connections 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ac8106660 0x7f0ac819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ac8100f80 0x7f0ac819a7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0ab00a26a0 0x7f0ab00a4b60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 --2- 172.21.15.42:0/1882447783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac81005c0 0x7f0ac819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 >> 172.21.15.42:0/1882447783 conn(0x7f0ac8077750 msgr2=0x7f0ac80688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 shutdown_connections 2024-03-31T23:18:32.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.760+0000 7f0ace6c0640 1 -- 172.21.15.42:0/1882447783 wait complete. 2024-03-31T23:18:32.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-31T23:18:32.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.876+0000 7f2b97a40640 1 -- 172.21.15.42:0/335529005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 msgr2=0x7f2b90106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.876+0000 7f2b97a40640 1 --2- 172.21.15.42:0/335529005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b90106a40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009930 tx=0x7f2b8c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- 172.21.15.42:0/335529005 shutdown_connections 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 --2- 172.21.15.42:0/335529005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b90100f80 0x7f2b9010d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 --2- 172.21.15.42:0/335529005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b901005c0 0x7f2b90100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 --2- 172.21.15.42:0/335529005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b90106a40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- 172.21.15.42:0/335529005 >> 172.21.15.42:0/335529005 conn(0x7f2b90077750 msgr2=0x7f2b90077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- 172.21.15.42:0/335529005 shutdown_connections 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- 172.21.15.42:0/335529005 wait complete. 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 Processor -- start 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- start start 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b901005c0 0x7f2b9019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 0x7f2b9019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b9019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90111c70 con 0x7f2b90106660 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90069780 con 0x7f2b90100f80 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.877+0000 7f2b97a40640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90111df0 con 0x7f2b901005c0 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b9019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b94fdb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 0x7f2b9019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b9019eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56098/0 (socket says 172.21.15.42:56098) 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b94fdb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 0x7f2b9019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41734/0 (socket says 172.21.15.42:41734) 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b901005c0 0x7f2b9019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 -- 172.21.15.42:0/2947959671 learned_addr learned my addr 172.21.15.42:0/2947959671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 -- 172.21.15.42:0/2947959671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b901005c0 msgr2=0x7f2b9019a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b901005c0 0x7f2b9019a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 -- 172.21.15.42:0/2947959671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 msgr2=0x7f2b9019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 0x7f2b9019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 -- 172.21.15.42:0/2947959671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9019f280 con 0x7f2b90106660 2024-03-31T23:18:32.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 0x7f2b9019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b957dc640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b901005c0 0x7f2b9019a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b95fdd640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b9019eb50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800eb10 tx=0x7f2b8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b867fc640 1 -- 172.21.15.42:0/2947959671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88004b20 con 0x7f2b90106660 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b867fc640 1 -- 172.21.15.42:0/2947959671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b88004cc0 con 0x7f2b90106660 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b867fc640 1 -- 172.21.15.42:0/2947959671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b880107f0 con 0x7f2b90106660 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9019f570 con 0x7f2b90106660 2024-03-31T23:18:32.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.878+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901a6e00 con 0x7f2b90106660 2024-03-31T23:18:32.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.881+0000 7f2b9a627740 1 Processor -- start 2024-03-31T23:18:32.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b867fc640 1 -- 172.21.15.42:0/2947959671 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f2b88005020 con 0x7f2b90106660 2024-03-31T23:18:32.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 -- start start 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a155850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a160d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56326a0b91b0 con 0x56326a155d90 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56326a061c00 con 0x56326a15e970 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b9a627740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56326a0b5250 con 0x56326a155470 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56108/0 (socket says 172.21.15.42:56108) 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b957dc640 1 -- 172.21.15.42:0/3585397251 learned_addr learned my addr 172.21.15.42:0/3585397251 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b867fc640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f2b7c0a26a0 0x7f2b7c0a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.882+0000 7f2b95fdd640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f2b7c0a26a0 0x7f2b7c0a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b867fc640 1 -- 172.21.15.42:0/2947959671 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f2b880cf560 con 0x7f2b90106660 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b957dc640 1 -- 172.21.15.42:0/3585397251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 msgr2=0x56326a155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b957dc640 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b957dc640 1 -- 172.21.15.42:0/3585397251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 msgr2=0x56326a160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b957dc640 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a160d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b957dc640 1 -- 172.21.15.42:0/3585397251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326a0813d0 con 0x56326a155d90 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b957dc640 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15e430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009900 tx=0x7f2b8c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c3ad1c7a25f296 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b95fdd640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f2b7c0a26a0 0x7f2b7c0a4b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b880cc8e0 tx=0x7f2b8806d7c0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b7b7fe640 1 -- 172.21.15.42:0/3585397251 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c02dae0 con 0x56326a155d90 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b7b7fe640 1 -- 172.21.15.42:0/3585397251 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b8c02dc80 con 0x56326a155d90 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.883+0000 7f2b7b7fe640 1 -- 172.21.15.42:0/3585397251 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c004920 con 0x56326a155d90 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 -- 172.21.15.42:0/3585397251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 msgr2=0x56326a15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15e430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009900 tx=0x7f2b8c0095f0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 -- 172.21.15.42:0/3585397251 shutdown_connections 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a160d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15e430 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 --2- 172.21.15.42:0/3585397251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 -- 172.21.15.42:0/3585397251 >> 172.21.15.42:0/3585397251 conn(0x56326a14fba0 msgr2=0x56326a14ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 -- 172.21.15.42:0/3585397251 shutdown_connections 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 -- 172.21.15.42:0/3585397251 wait complete. 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 -- start start 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.884+0000 7f2b9a627740 1 Processor -- start 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56326a161700 con 0x56326a155d90 2024-03-31T23:18:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56326a057470 con 0x56326a15e970 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56326a161880 con 0x56326a155470 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 10 client.0 _ll_register_callbacks cb 0x56326a074cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56120/0 (socket says 172.21.15.42:56120) 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b94fdb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 -- 172.21.15.42:0/2135025756 learned_addr learned my addr 172.21.15.42:0/2135025756 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 -- 172.21.15.42:0/2135025756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 msgr2=0x56326a15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 -- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 msgr2=0x56326a15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 -- 172.21.15.42:0/2135025756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563269dcd3f0 con 0x56326a155d90 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b957dc640 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15bf70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c036040 tx=0x7f2b8c0055b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a3a4589c67887a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b78ff9640 1 -- 172.21.15.42:0/2135025756 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c02dae0 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8c02dc80 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.885+0000 7f2b78ff9640 1 -- 172.21.15.42:0/2135025756 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f2b8c003a00 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b78ff9640 1 -- 172.21.15.42:0/2135025756 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2b8c057050 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563269e977d0 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b78ff9640 1 -- 172.21.15.42:0/2135025756 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b8c02dc80 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b78ff9640 1 -- 172.21.15.42:0/2135025756 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2b8c041480 con 0x56326a155d90 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 10 client.15879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 20 client.15879 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a16e810 0x56326a170c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 4 client.15879 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56326a0c66f0 con 0x56326a16e810 2024-03-31T23:18:32.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.886+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a16e810 0x56326a170c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b78ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a16e810 0x56326a170c00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55e7979a578740e0 server_cookie=e0f98091b4ed5776 in_seq=0 out_seq=0 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b78ff9640 1 -- 172.21.15.42:0/2135025756 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56326a0c66f0 con 0x56326a16e810 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b78ff9640 10 client.15879 handle_command_reply: tid=0 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 client.15879 shutdown 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 msgr2=0x56326a15bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15bf70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c036040 tx=0x7f2b8c0055b0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 shutdown_connections 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a16e810 0x56326a170c00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155d90 0x56326a15bf70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b78ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:18:32.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 --2- 172.21.15.42:0/2135025756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155470 0x56326a15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.887+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 >> 172.21.15.42:0/2135025756 conn(0x56326a14fba0 msgr2=0x56326a1518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.888+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 shutdown_connections 2024-03-31T23:18:32.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.888+0000 7f2b9a627740 1 -- 172.21.15.42:0/2135025756 wait complete. 2024-03-31T23:18:32.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.888+0000 7f2b9a627740 20 client.15879 trim_cache size 0 max 16384 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.901+0000 7f2b9a627740 1 Processor -- start 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.901+0000 7f2b9a627740 1 -- start start 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.901+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a155470 0x56326a176320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.901+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.901+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 0x56326a151a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.901+0000 7f2b9a627740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901b0d40 con 0x56326a15e970 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b9a627740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901b2880 con 0x56326a155470 2024-03-31T23:18:32.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b9a627740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901b1410 con 0x56326a155d90 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b94fdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 0x56326a151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33518/0 (socket says 172.21.15.42:33518) 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 -- 172.21.15.42:0/4274047437 learned_addr learned my addr 172.21.15.42:0/4274047437 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 0x56326a151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56130/0 (socket says 172.21.15.42:56130) 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a155470 0x56326a176320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 -- 172.21.15.42:0/4274047437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a155470 msgr2=0x56326a176320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a155470 0x56326a176320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 -- 172.21.15.42:0/4274047437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 msgr2=0x56326a151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 0x56326a151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 -- 172.21.15.42:0/4274047437 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326a155bc0 con 0x56326a155d90 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 0x56326a151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b957dc640 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a1514e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0418d0 tx=0x7f2b8c004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a4c7158181a1e3f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b7affd640 1 -- 172.21.15.42:0/4274047437 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c060070 con 0x56326a155d90 2024-03-31T23:18:32.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b7affd640 1 -- 172.21.15.42:0/4274047437 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b8c005620 con 0x56326a155d90 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.902+0000 7f2b7affd640 1 -- 172.21.15.42:0/4274047437 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c003c70 con 0x56326a155d90 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 -- 172.21.15.42:0/4274047437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 msgr2=0x56326a1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a1514e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0418d0 tx=0x7f2b8c004610 comp rx=0 tx=0).stop 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 -- 172.21.15.42:0/4274047437 shutdown_connections 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a15e970 0x56326a151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a1514e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 --2- 172.21.15.42:0/4274047437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a155470 0x56326a176320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 -- 172.21.15.42:0/4274047437 >> 172.21.15.42:0/4274047437 conn(0x56326a14fba0 msgr2=0x56326a150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 -- 172.21.15.42:0/4274047437 shutdown_connections 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 -- 172.21.15.42:0/4274047437 wait complete. 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.903+0000 7f2b9a627740 1 -- start start 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 Processor -- start 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 0x56326a1669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a163f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901b21b0 con 0x56326a155470 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901b1ae0 con 0x56326a15e970 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901aed00 con 0x56326a155d90 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b9a627740 10 client.0 _ll_register_callbacks cb 0x7f2b8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 0x56326a1669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 0x56326a1669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56136/0 (socket says 172.21.15.42:56136) 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b957dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33530/0 (socket says 172.21.15.42:33530) 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 -- 172.21.15.42:0/1431079684 learned_addr learned my addr 172.21.15.42:0/1431079684 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 -- 172.21.15.42:0/1431079684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 msgr2=0x56326a166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 -- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 msgr2=0x56326a163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:32.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a163f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b94fdb640 1 -- 172.21.15.42:0/1431079684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326a164730 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.904+0000 7f2b957dc640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b94fdb640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 0x56326a1669a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b80013010 tx=0x7f2b80005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dacff7cbae15cf server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b78ff9640 1 -- 172.21.15.42:0/1431079684 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8002c070 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b78ff9640 1 -- 172.21.15.42:0/1431079684 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f2b8001a040 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8c005620 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b78ff9640 1 -- 172.21.15.42:0/1431079684 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2b80005020 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 10 client.15885 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56326a1d45f0 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b78ff9640 1 -- 172.21.15.42:0/1431079684 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b8c005620 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b78ff9640 1 -- 172.21.15.42:0/1431079684 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2b800047a0 con 0x56326a155470 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 10 client.15885 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 10 client.15885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:18:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 20 client.15885 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a1d4d70 0x56326a1d7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 4 client.15885 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.905+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56326a0c0a40 con 0x56326a1d4d70 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b957dc640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a1d4d70 0x56326a1d7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b957dc640 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a1d4d70 0x56326a1d7190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b49fe5aa08c1279b server_cookie=8bd268ef96873eb2 in_seq=0 out_seq=0 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b78ff9640 10 client.15885 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b78ff9640 1 -- 172.21.15.42:0/1431079684 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56326a0c0a40 con 0x56326a1d4d70 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b78ff9640 10 client.15885 handle_command_reply: tid=0 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 client.15885 shutdown 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 msgr2=0x56326a1669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 0x56326a1669a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b80013010 tx=0x7f2b80005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 shutdown_connections 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x56326a1d4d70 0x56326a1d7190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56326a15e970 0x56326a163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56326a155d90 0x56326a166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b78ff9640 0 client.15885 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 --2- 172.21.15.42:0/1431079684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56326a155470 0x56326a1669a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.906+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 >> 172.21.15.42:0/1431079684 conn(0x56326a14fba0 msgr2=0x56326a1515f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 shutdown_connections 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b9a627740 1 -- 172.21.15.42:0/1431079684 wait complete. 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b9a627740 20 client.15885 trim_cache size 0 max 16384 2024-03-31T23:18:32.914 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f2b7c0a26a0 msgr2=0x7f2b7c0a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f2b7c0a26a0 0x7f2b7c0a4b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b880cc8e0 tx=0x7f2b8806d7c0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 msgr2=0x7f2b9019eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b9019eb50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800eb10 tx=0x7f2b8800c2d0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 shutdown_connections 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f2b7c0a26a0 0x7f2b7c0a4b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b90106660 0x7f2b9019eb50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b90100f80 0x7f2b9019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 --2- 172.21.15.42:0/2947959671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b901005c0 0x7f2b9019a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:32.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 >> 172.21.15.42:0/2947959671 conn(0x7f2b90077750 msgr2=0x7f2b9010c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:32.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 shutdown_connections 2024-03-31T23:18:32.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:32.907+0000 7f2b97a40640 1 -- 172.21.15.42:0/2947959671 wait complete. 2024-03-31T23:18:32.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:32 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/142389993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:18:32.918 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-31T23:18:32.921 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:32 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/142389993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:18:32.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:32 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/142389993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:18:33.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 -- 172.21.15.42:0/3336578478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701016e0 msgr2=0x7f3770101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 --2- 172.21.15.42:0/3336578478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701016e0 0x7f3770101b60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3760009930 tx=0x7f376002bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:33.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 -- 172.21.15.42:0/3336578478 shutdown_connections 2024-03-31T23:18:33.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 --2- 172.21.15.42:0/3336578478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701020a0 0x7f377010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 --2- 172.21.15.42:0/3336578478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701016e0 0x7f3770101b60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 --2- 172.21.15.42:0/3336578478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701076f0 0x7f3770107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 -- 172.21.15.42:0/3336578478 >> 172.21.15.42:0/3336578478 conn(0x7f3770078b50 msgr2=0x7f3770078f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 -- 172.21.15.42:0/3336578478 shutdown_connections 2024-03-31T23:18:33.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.024+0000 7f377489a640 1 -- 172.21.15.42:0/3336578478 wait complete. 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 Processor -- start 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 -- start start 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701016e0 0x7f3770073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701020a0 0x7f3770073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 0x7f37700744d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3770111bd0 con 0x7f37701020a0 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3770111a50 con 0x7f37701076f0 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f377489a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3770111d50 con 0x7f37701016e0 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f376dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701020a0 0x7f3770073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f376e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701016e0 0x7f3770073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f376ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 0x7f37700744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f376ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 0x7f37700744d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41782/0 (socket says 172.21.15.42:41782) 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.025+0000 7f376e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701016e0 0x7f3770073a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33540/0 (socket says 172.21.15.42:33540) 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 -- 172.21.15.42:0/1355894587 learned_addr learned my addr 172.21.15.42:0/1355894587 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 -- 172.21.15.42:0/1355894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701016e0 msgr2=0x7f3770073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701016e0 0x7f3770073a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 -- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701020a0 msgr2=0x7f3770073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701020a0 0x7f3770073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 -- 172.21.15.42:0/1355894587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37701a65f0 con 0x7f37701076f0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f376ed9d640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 0x7f37700744d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f376800efd0 tx=0x7f376800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f375f7fe640 1 -- 172.21.15.42:0/1355894587 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768003b70 con 0x7f37701076f0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f375f7fe640 1 -- 172.21.15.42:0/1355894587 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3768003d10 con 0x7f37701076f0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37701a68e0 con 0x7f37701076f0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f375f7fe640 1 -- 172.21.15.42:0/1355894587 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768010a90 con 0x7f37701076f0 2024-03-31T23:18:33.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.026+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37701a6db0 con 0x7f37701076f0 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.029+0000 7f375f7fe640 1 -- 172.21.15.42:0/1355894587 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f3768004020 con 0x7f37701076f0 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.029+0000 7f377747f740 1 Processor -- start 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.029+0000 7f377747f740 1 -- start start 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f377747f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f55d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f377747f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f566430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f377747f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f568d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f377747f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c21f4c11b0 con 0x55c21f55dd90 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f377747f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55c21f469c00 con 0x55c21f566970 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f377747f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c21f4bd250 con 0x55c21f55d470 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f566430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f55d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f566430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56176/0 (socket says 172.21.15.42:56176) 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376e59c640 1 -- 172.21.15.42:0/170117854 learned_addr learned my addr 172.21.15.42:0/170117854 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f375f7fe640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f37580a26a0 0x7f37580a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f568d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376ed9d640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f37580a26a0 0x7f37580a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 -- 172.21.15.42:0/170117854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 msgr2=0x55c21f568d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f568d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 -- 172.21.15.42:0/170117854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 msgr2=0x55c21f566430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f566430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 -- 172.21.15.42:0/170117854 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21f4893d0 con 0x55c21f55d470 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376e59c640 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f566430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f375f7fe640 1 -- 172.21.15.42:0/1355894587 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f37680cf460 con 0x7f37701076f0 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.030+0000 7f376dd9b640 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f55d850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3760009230 tx=0x7f37600058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ff5b5b4f90287c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f376ed9d640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f37580a26a0 0x7f37580a4b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f37680cc880 tx=0x7f376806e810 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f375cff9640 1 -- 172.21.15.42:0/170117854 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376002cca0 con 0x55c21f55d470 2024-03-31T23:18:33.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f375cff9640 1 -- 172.21.15.42:0/170117854 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f376002ce40 con 0x55c21f55d470 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f375cff9640 1 -- 172.21.15.42:0/170117854 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760003d90 con 0x55c21f55d470 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 -- 172.21.15.42:0/170117854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 msgr2=0x55c21f55d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f55d850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3760009230 tx=0x7f37600058d0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 -- 172.21.15.42:0/170117854 shutdown_connections 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f568d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f566430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 --2- 172.21.15.42:0/170117854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f55d850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 -- 172.21.15.42:0/170117854 >> 172.21.15.42:0/170117854 conn(0x55c21f557ba0 msgr2=0x55c21f557f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 -- 172.21.15.42:0/170117854 shutdown_connections 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.031+0000 7f377747f740 1 -- 172.21.15.42:0/170117854 wait complete. 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 -- start start 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 Processor -- start 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f5639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55dd90 0x55c21f563f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f564460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c21f5696a0 con 0x55c21f55d470 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55c21f45f470 con 0x55c21f566970 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c21f569820 con 0x55c21f55dd90 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f376dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f5639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f377747f740 10 client.0 _ll_register_callbacks cb 0x55c21f47ccb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f376dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f5639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56188/0 (socket says 172.21.15.42:56188) 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f376dd9b640 1 -- 172.21.15.42:0/1239741247 learned_addr learned my addr 172.21.15.42:0/1239741247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f376e59c640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55dd90 0x55c21f563f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.032+0000 7f376dd9b640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f564460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f376dd9b640 1 -- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55dd90 msgr2=0x55c21f563f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f376dd9b640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55dd90 0x55c21f563f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f376dd9b640 1 -- 172.21.15.42:0/1239741247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 msgr2=0x55c21f564460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f376dd9b640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f564460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f376dd9b640 1 -- 172.21.15.42:0/1239741247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21f1d53f0 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f376dd9b640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f5639e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3760005830 tx=0x7f3760005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45225ba610d5bd7f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f3755ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f3755ffb640 1 -- 172.21.15.42:0/1239741247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760034980 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f3755ffb640 1 -- 172.21.15.42:0/1239741247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f3760034b20 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c21f4ce6f0 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f3755ffb640 1 -- 172.21.15.42:0/1239741247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3760061050 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c21f29f7d0 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f3755ffb640 1 -- 172.21.15.42:0/1239741247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55c21f4ce6f0 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f3755ffb640 1 -- 172.21.15.42:0/1239741247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3760040040 con 0x55c21f55d470 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 10 client.15897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 20 client.15897 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.033+0000 7f377747f740 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f576780 0x55c21f578b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.034+0000 7f377747f740 4 client.15897 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:33.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.034+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c21f4c8a40 con 0x55c21f576780 2024-03-31T23:18:33.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.034+0000 7f376e59c640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f576780 0x55c21f578b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.034+0000 7f3755ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:18:33.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.034+0000 7f376e59c640 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f576780 0x55c21f578b70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee15cc3579d02e51 server_cookie=a7d67cd9c5e61cb8 in_seq=0 out_seq=0 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f3755ffb640 1 -- 172.21.15.42:0/1239741247 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c21f4c8a40 con 0x55c21f576780 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f3755ffb640 10 client.15897 handle_command_reply: tid=0 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 client.15897 shutdown 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 msgr2=0x55c21f5639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f5639e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3760005830 tx=0x7f3760005e60 comp rx=0 tx=0).stop 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 shutdown_connections 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f564460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f576780 0x55c21f578b70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55dd90 0x55c21f563f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 --2- 172.21.15.42:0/1239741247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f5639e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f3755ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:18:33.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 >> 172.21.15.42:0/1239741247 conn(0x55c21f557ba0 msgr2=0x55c21f5598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 shutdown_connections 2024-03-31T23:18:33.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 1 -- 172.21.15.42:0/1239741247 wait complete. 2024-03-31T23:18:33.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.035+0000 7f377747f740 20 client.15897 trim_cache size 0 max 16384 2024-03-31T23:18:33.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 Processor -- start 2024-03-31T23:18:33.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 -- start start 2024-03-31T23:18:33.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f566110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f556bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f57bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f37701b0d90 con 0x55c21f55dd90 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f37701b28d0 con 0x55c21f566970 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.048+0000 7f377747f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37701b1460 con 0x55c21f55d470 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f556bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f556bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56194/0 (socket says 172.21.15.42:56194) 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 -- 172.21.15.42:0/238566772 learned_addr learned my addr 172.21.15.42:0/238566772 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376dd9b640 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f566110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376dd9b640 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f57bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 -- 172.21.15.42:0/238566772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 msgr2=0x55c21f566110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f566110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 -- 172.21.15.42:0/238566772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 msgr2=0x55c21f57bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f57bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 -- 172.21.15.42:0/238566772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21f5584e0 con 0x55c21f55dd90 2024-03-31T23:18:33.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f376e59c640 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f556bc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3764005b90 tx=0x7f3764005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a236605337050492 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f3757fff640 1 -- 172.21.15.42:0/238566772 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376401f050 con 0x55c21f55dd90 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f3757fff640 1 -- 172.21.15.42:0/238566772 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f376401f6f0 con 0x55c21f55dd90 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.049+0000 7f3757fff640 1 -- 172.21.15.42:0/238566772 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764010c70 con 0x55c21f55dd90 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- 172.21.15.42:0/238566772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 msgr2=0x55c21f556bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f556bc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3764005b90 tx=0x7f3764005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- 172.21.15.42:0/238566772 shutdown_connections 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f566970 0x55c21f57bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55dd90 0x55c21f556bc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- 172.21.15.42:0/238566772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f55d470 0x55c21f566110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- 172.21.15.42:0/238566772 >> 172.21.15.42:0/238566772 conn(0x55c21f557ba0 msgr2=0x55c21f5564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- 172.21.15.42:0/238566772 shutdown_connections 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- 172.21.15.42:0/238566772 wait complete. 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- start start 2024-03-31T23:18:33.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 Processor -- start 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f579b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f55dd90 0x55c21f57a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f566970 0x55c21f5db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f37701b2200 con 0x55c21f55d470 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f37701b1b30 con 0x55c21f55dd90 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37701aed50 con 0x55c21f566970 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.050+0000 7f377747f740 10 client.0 _ll_register_callbacks cb 0x7f3760003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f579b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f579b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56206/0 (socket says 172.21.15.42:56206) 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f55dd90 0x55c21f57a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 -- 172.21.15.42:0/93661480 learned_addr learned my addr 172.21.15.42:0/93661480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f566970 0x55c21f5db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 -- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f566970 msgr2=0x55c21f5db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f566970 0x55c21f5db720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 -- 172.21.15.42:0/93661480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f55dd90 msgr2=0x55c21f57a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f55dd90 0x55c21f57a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 -- 172.21.15.42:0/93661480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21f5dbc60 con 0x55c21f55d470 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376e59c640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f55dd90 0x55c21f57a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f376dd9b640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f579b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f37600059d0 tx=0x7f3760005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6324e20e885871a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f3755ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f3755ffb640 1 -- 172.21.15.42:0/93661480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760005260 con 0x55c21f55d470 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f3755ffb640 1 -- 172.21.15.42:0/93661480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f3760005400 con 0x55c21f55d470 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f376401f6f0 con 0x55c21f55d470 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f3755ffb640 1 -- 172.21.15.42:0/93661480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3760005600 con 0x55c21f55d470 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f377747f740 10 client.15903 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.051+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c21f5dcf00 con 0x55c21f55d470 2024-03-31T23:18:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f3755ffb640 1 -- 172.21.15.42:0/93661480 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f376401f6f0 con 0x55c21f55d470 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f3755ffb640 1 -- 172.21.15.42:0/93661480 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3760070030 con 0x55c21f55d470 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 10 client.15903 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 10 client.15903 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 20 client.15903 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f5dd5c0 0x55c21f5df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 4 client.15903 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c21f4466a0 con 0x55c21f5dd5c0 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f376e59c640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f5dd5c0 0x55c21f5df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f376e59c640 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f5dd5c0 0x55c21f5df9e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b213eed4acfc8ac7 server_cookie=f1dcdeac6fce6d97 in_seq=0 out_seq=0 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f3755ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f3755ffb640 1 -- 172.21.15.42:0/93661480 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c21f4466a0 con 0x55c21f5dd5c0 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f3755ffb640 10 client.15903 handle_command_reply: tid=0 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.052+0000 7f377747f740 1 client.15903 shutdown 2024-03-31T23:18:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 msgr2=0x55c21f579b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f579b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f37600059d0 tx=0x7f3760005e60 comp rx=0 tx=0).stop 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 shutdown_connections 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55c21f5dd5c0 0x55c21f5df9e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c21f566970 0x55c21f5db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c21f55dd90 0x55c21f57a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f3755ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 --2- 172.21.15.42:0/93661480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21f55d470 0x55c21f579b90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 >> 172.21.15.42:0/93661480 conn(0x55c21f557ba0 msgr2=0x55c21f559780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 shutdown_connections 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 1 -- 172.21.15.42:0/93661480 wait complete. 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377747f740 20 client.15903 trim_cache size 0 max 16384 2024-03-31T23:18:33.060 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:18:33.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f37580a26a0 msgr2=0x7f37580a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f37580a26a0 0x7f37580a4b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f37680cc880 tx=0x7f376806e810 comp rx=0 tx=0).stop 2024-03-31T23:18:33.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 msgr2=0x7f37700744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 0x7f37700744d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f376800efd0 tx=0x7f376800c6a0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 shutdown_connections 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37701076f0 0x7f37700744d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f37580a26a0 0x7f37580a4b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37701020a0 0x7f3770073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 --2- 172.21.15.42:0/1355894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37701016e0 0x7f3770073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 >> 172.21.15.42:0/1355894587 conn(0x7f3770078b50 msgr2=0x7f3770104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 shutdown_connections 2024-03-31T23:18:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.053+0000 7f377489a640 1 -- 172.21.15.42:0/1355894587 wait complete. 2024-03-31T23:18:33.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-31T23:18:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 -- 172.21.15.42:0/1424262818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c106660 msgr2=0x7fac1c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 --2- 172.21.15.42:0/1424262818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c106660 0x7fac1c106a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009930 tx=0x7fac0c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 -- 172.21.15.42:0/1424262818 shutdown_connections 2024-03-31T23:18:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 --2- 172.21.15.42:0/1424262818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac1c100f80 0x7fac1c10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 --2- 172.21.15.42:0/1424262818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac1c1005c0 0x7fac1c100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 --2- 172.21.15.42:0/1424262818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c106660 0x7fac1c106a40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 -- 172.21.15.42:0/1424262818 >> 172.21.15.42:0/1424262818 conn(0x7fac1c077750 msgr2=0x7fac1c077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 -- 172.21.15.42:0/1424262818 shutdown_connections 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.170+0000 7fac224cd640 1 -- 172.21.15.42:0/1424262818 wait complete. 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 Processor -- start 2024-03-31T23:18:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 -- start start 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 0x7fac1c102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac1c100f80 0x7fac1c1027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac1c106660 0x7fac1c102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c110a70 con 0x7fac1c1005c0 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1108f0 con 0x7fac1c106660 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac224cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c110bf0 con 0x7fac1c100f80 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 0x7fac1c102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 0x7fac1c102260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56228/0 (socket says 172.21.15.42:56228) 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 -- 172.21.15.42:0/4191166618 learned_addr learned my addr 172.21.15.42:0/4191166618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac1c100f80 0x7fac1c1027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac20a6a640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac1c106660 0x7fac1c102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 -- 172.21.15.42:0/4191166618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac1c100f80 msgr2=0x7fac1c1027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac1c100f80 0x7fac1c1027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 -- 172.21.15.42:0/4191166618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac1c106660 msgr2=0x7fac1c102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac1c106660 0x7fac1c102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.171+0000 7fac1bfff640 1 -- 172.21.15.42:0/4191166618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c1a6560 con 0x7fac1c1005c0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.172+0000 7fac1bfff640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 0x7fac1c102260 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009230 tx=0x7fac0c02dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.172+0000 7fac197fa640 1 -- 172.21.15.42:0/4191166618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c043020 con 0x7fac1c1005c0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.172+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c1a67f0 con 0x7fac1c1005c0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.172+0000 7fac197fa640 1 -- 172.21.15.42:0/4191166618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac0c004e50 con 0x7fac1c1005c0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.172+0000 7fac197fa640 1 -- 172.21.15.42:0/4191166618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c003a10 con 0x7fac1c1005c0 2024-03-31T23:18:33.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.172+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c1a6d90 con 0x7fac1c1005c0 2024-03-31T23:18:33.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.174+0000 7fac197fa640 1 -- 172.21.15.42:0/4191166618 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7fac0c046020 con 0x7fac1c1005c0 2024-03-31T23:18:33.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.174+0000 7fac25191740 1 Processor -- start 2024-03-31T23:18:33.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 -- start start 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36600850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac197fa640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fac080a26a0 0x7fac080a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36609430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a365641b0 con 0x558a36609970 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x558a3650cc00 con 0x558a36600470 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac25191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558a36560250 con 0x558a36600d90 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1bfff640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fac080a26a0 0x7fac080a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36609430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56232/0 (socket says 172.21.15.42:56232) 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36609430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33612/0 (socket says 172.21.15.42:33612) 2024-03-31T23:18:33.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac20a6a640 1 -- 172.21.15.42:0/3212368140 learned_addr learned my addr 172.21.15.42:0/3212368140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac20a6a640 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36600850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac197fa640 1 -- 172.21.15.42:0/4191166618 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fac0c0f0ef0 con 0x7fac1c1005c0 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 -- 172.21.15.42:0/3212368140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 msgr2=0x558a36600850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36600850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 -- 172.21.15.42:0/3212368140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 msgr2=0x558a3660bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1b7fe640 1 -- 172.21.15.42:0/3212368140 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3652c3d0 con 0x558a36600d90 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.175+0000 7fac1bfff640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fac080a26a0 0x7fac080a4b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0ee340 tx=0x7fac0c009260 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36609430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac04009bf0 tx=0x7fac04011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e681046c269249cb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac127fc640 1 -- 172.21.15.42:0/3212368140 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0401e070 con 0x558a36600d90 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac127fc640 1 -- 172.21.15.42:0/3212368140 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac04009da0 con 0x558a36600d90 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac127fc640 1 -- 172.21.15.42:0/3212368140 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04018830 con 0x558a36600d90 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 -- 172.21.15.42:0/3212368140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 msgr2=0x558a36609430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36609430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac04009bf0 tx=0x7fac04011810 comp rx=0 tx=0).stop 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 -- 172.21.15.42:0/3212368140 shutdown_connections 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36609430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 --2- 172.21.15.42:0/3212368140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36600850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 -- 172.21.15.42:0/3212368140 >> 172.21.15.42:0/3212368140 conn(0x558a365faba0 msgr2=0x558a365faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 -- 172.21.15.42:0/3212368140 shutdown_connections 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.176+0000 7fac25191740 1 -- 172.21.15.42:0/3212368140 wait complete. 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 -- start start 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 Processor -- start 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 0x558a366069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600d90 0x558a36606f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36609970 0x558a36607450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a3660c760 con 0x558a36600470 2024-03-31T23:18:33.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x558a36502470 con 0x558a36600d90 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558a3660c8e0 con 0x558a36609970 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac25191740 10 client.0 _ll_register_callbacks cb 0x558a3651fcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 0x558a366069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 0x558a366069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56234/0 (socket says 172.21.15.42:56234) 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac20a6a640 1 -- 172.21.15.42:0/2982676608 learned_addr learned my addr 172.21.15.42:0/2982676608 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600d90 0x558a36606f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.177+0000 7fac20a6a640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36609970 0x558a36607450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac20a6a640 1 -- 172.21.15.42:0/2982676608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36609970 msgr2=0x558a36607450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac20a6a640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36609970 0x558a36607450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac20a6a640 1 -- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600d90 msgr2=0x558a36606f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac20a6a640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600d90 0x558a36606f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac20a6a640 1 -- 172.21.15.42:0/2982676608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a362783f0 con 0x558a36600470 2024-03-31T23:18:33.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac20a6a640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 0x558a366069d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fac14003fd0 tx=0x7fac14004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db098e6cb4a863ad server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fabfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fabfb7fe640 1 -- 172.21.15.42:0/2982676608 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14004810 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac04009da0 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fabfb7fe640 1 -- 172.21.15.42:0/2982676608 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fac14021430 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fabfb7fe640 1 -- 172.21.15.42:0/2982676608 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fac1402c050 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac25191740 10 client.15915 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a363427d0 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.178+0000 7fabfb7fe640 1 -- 172.21.15.42:0/2982676608 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac04009da0 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fabfb7fe640 1 -- 172.21.15.42:0/2982676608 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fac1401d070 con 0x558a36600470 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac25191740 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac25191740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac25191740 20 client.15915 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac25191740 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a36619950 0x558a3661bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac25191740 4 client.15915 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a365716f0 con 0x558a36619950 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a36619950 0x558a3661bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fabfb7fe640 10 client.15915 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.179+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a36619950 0x558a3661bdb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b5b0ac07edc3cd server_cookie=7995c7854a66c20d in_seq=0 out_seq=0 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fabfb7fe640 1 -- 172.21.15.42:0/2982676608 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558a365716f0 con 0x558a36619950 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fabfb7fe640 10 client.15915 handle_command_reply: tid=0 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 client.15915 shutdown 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 msgr2=0x558a366069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 0x558a366069d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fac14003fd0 tx=0x7fac14004ab0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 shutdown_connections 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a36619950 0x558a3661bdb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36609970 0x558a36607450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600d90 0x558a36606f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fabfb7fe640 0 client.15915 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 --2- 172.21.15.42:0/2982676608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36600470 0x558a366069d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.180+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 >> 172.21.15.42:0/2982676608 conn(0x558a365faba0 msgr2=0x558a365fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.181+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 shutdown_connections 2024-03-31T23:18:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.181+0000 7fac25191740 1 -- 172.21.15.42:0/2982676608 wait complete. 2024-03-31T23:18:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.181+0000 7fac25191740 20 client.15915 trim_cache size 0 max 16384 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 Processor -- start 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 -- start start 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a366062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36615530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a36621680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1b0f10 con 0x558a36609970 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1b2a50 con 0x558a36600470 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.194+0000 7fac25191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1b15e0 con 0x558a36600d90 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a36621680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a366062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36615530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36615530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33626/0 (socket says 172.21.15.42:33626) 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 -- 172.21.15.42:0/2939921290 learned_addr learned my addr 172.21.15.42:0/2939921290 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a366062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41860/0 (socket says 172.21.15.42:41860) 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 -- 172.21.15.42:0/2939921290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 msgr2=0x558a366062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a366062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 -- 172.21.15.42:0/2939921290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 msgr2=0x558a36621680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a36621680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 -- 172.21.15.42:0/2939921290 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3660bd60 con 0x558a36600d90 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac20a6a640 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a366062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36615530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac04009bf0 tx=0x7fac04018450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32326034c9cba51c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac11ffb640 1 -- 172.21.15.42:0/2939921290 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0402e070 con 0x558a36600d90 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac11ffb640 1 -- 172.21.15.42:0/2939921290 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac040291d0 con 0x558a36600d90 2024-03-31T23:18:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.195+0000 7fac11ffb640 1 -- 172.21.15.42:0/2939921290 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04029030 con 0x558a36600d90 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 -- 172.21.15.42:0/2939921290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 msgr2=0x558a36615530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36615530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac04009bf0 tx=0x7fac04018450 comp rx=0 tx=0).stop 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 -- 172.21.15.42:0/2939921290 shutdown_connections 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a36621680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a36615530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 --2- 172.21.15.42:0/2939921290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a366062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 -- 172.21.15.42:0/2939921290 >> 172.21.15.42:0/2939921290 conn(0x558a365faba0 msgr2=0x558a365f9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 -- 172.21.15.42:0/2939921290 shutdown_connections 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 -- 172.21.15.42:0/2939921290 wait complete. 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 -- start start 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.196+0000 7fac25191740 1 Processor -- start 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36611d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a3660d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1b2380 con 0x558a36609970 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1b1cb0 con 0x558a36600470 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1aeed0 con 0x558a36600d90 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 10 client.0 _ll_register_callbacks cb 0x7fac14003da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56264/0 (socket says 172.21.15.42:56264) 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a3660d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 -- 172.21.15.42:0/626360316 learned_addr learned my addr 172.21.15.42:0/626360316 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36611d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 -- 172.21.15.42:0/626360316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 msgr2=0x558a3660d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a3660d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 -- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 msgr2=0x558a36611d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36611d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 -- 172.21.15.42:0/626360316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3660de60 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a3660d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac20a6a640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660d660 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fac14004510 tx=0x7fac14009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e4e9d419d67c18 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fabfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fabfb7fe640 1 -- 172.21.15.42:0/626360316 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140203e0 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fabfb7fe640 1 -- 172.21.15.42:0/626360316 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fac1401a070 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.197+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac040291d0 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fabfb7fe640 1 -- 172.21.15.42:0/626360316 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fac14020580 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 10 client.15921 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a3667fc20 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fabfb7fe640 1 -- 172.21.15.42:0/626360316 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac040291d0 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fabfb7fe640 1 -- 172.21.15.42:0/626360316 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fac1401d040 con 0x558a36609970 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 20 client.15921 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a366802d0 0x558a366826f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 4 client.15921 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a3656ba40 con 0x558a366802d0 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.198+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a366802d0 0x558a366826f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fabfb7fe640 10 client.15921 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac1b7fe640 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a366802d0 0x558a366826f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99814bfb89441233 server_cookie=301c503fe540a726 in_seq=0 out_seq=0 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fabfb7fe640 1 -- 172.21.15.42:0/626360316 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a3656ba40 con 0x558a366802d0 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fabfb7fe640 10 client.15921 handle_command_reply: tid=0 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 client.15921 shutdown 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 msgr2=0x558a3660d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660d660 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fac14004510 tx=0x7fac14009ef0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 shutdown_connections 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x558a366802d0 0x558a366826f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a36609970 0x558a3660d660 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a36600d90 0x558a3660d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fabfb7fe640 0 client.15921 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:33.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 --2- 172.21.15.42:0/626360316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558a36600470 0x558a36611d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 >> 172.21.15.42:0/626360316 conn(0x558a365faba0 msgr2=0x558a36606990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 shutdown_connections 2024-03-31T23:18:33.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 1 -- 172.21.15.42:0/626360316 wait complete. 2024-03-31T23:18:33.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.199+0000 7fac25191740 20 client.15921 trim_cache size 0 max 16384 2024-03-31T23:18:33.206 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fac080a26a0 msgr2=0x7fac080a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fac080a26a0 0x7fac080a4b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0ee340 tx=0x7fac0c009260 comp rx=0 tx=0).stop 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 msgr2=0x7fac1c102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 0x7fac1c102260 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009230 tx=0x7fac0c02dbf0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 shutdown_connections 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac1c106660 0x7fac1c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac1c100f80 0x7fac1c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fac080a26a0 0x7fac080a4b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 --2- 172.21.15.42:0/4191166618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac1c1005c0 0x7fac1c102260 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 >> 172.21.15.42:0/4191166618 conn(0x7fac1c077750 msgr2=0x7fac1c0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 shutdown_connections 2024-03-31T23:18:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:33.200+0000 7fac224cd640 1 -- 172.21.15.42:0/4191166618 wait complete. 2024-03-31T23:18:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:33 smithi094 ceph-mon[36167]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 17 op/s 2024-03-31T23:18:33.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:33 smithi188 ceph-mon[36068]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 17 op/s 2024-03-31T23:18:34.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:33 smithi042 ceph-mon[32380]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 17 op/s 2024-03-31T23:18:34.215 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-31T23:18:34.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:18:34.216 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 -- 172.21.15.42:0/1754379407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4101030 msgr2=0x7efca410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 --2- 172.21.15.42:0/1754379407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4101030 0x7efca410d540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009ca0 tx=0x7efc9c02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 -- 172.21.15.42:0/1754379407 shutdown_connections 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 --2- 172.21.15.42:0/1754379407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4101030 0x7efca410d540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 --2- 172.21.15.42:0/1754379407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efca4100670 0x7efca4100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 --2- 172.21.15.42:0/1754379407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4106680 0x7efca4106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 -- 172.21.15.42:0/1754379407 >> 172.21.15.42:0/1754379407 conn(0x7efca40777b0 msgr2=0x7efca4077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 -- 172.21.15.42:0/1754379407 shutdown_connections 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.332+0000 7efcab6cd640 1 -- 172.21.15.42:0/1754379407 wait complete. 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 Processor -- start 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 -- start start 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4100670 0x7efca4198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 0x7efca41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efca4106680 0x7efca41a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efca4110b70 con 0x7efca4101030 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efca41109f0 con 0x7efca4100670 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efcab6cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efca4110cf0 con 0x7efca4106680 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efca8c68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 0x7efca41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efca9469640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4100670 0x7efca4198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efca8c68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 0x7efca41993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35488/0 (socket says 172.21.15.42:35488) 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efca8c68640 1 -- 172.21.15.42:0/2093056057 learned_addr learned my addr 172.21.15.42:0/2093056057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efca4106680 0x7efca41a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.333+0000 7efca8c68640 1 -- 172.21.15.42:0/2093056057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efca4106680 msgr2=0x7efca41a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efca8c68640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efca4106680 0x7efca41a3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efca8c68640 1 -- 172.21.15.42:0/2093056057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4100670 msgr2=0x7efca4198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efca8c68640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4100670 0x7efca4198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efca8c68640 1 -- 172.21.15.42:0/2093056057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca41a4470 con 0x7efca4101030 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efca9469640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4100670 0x7efca4198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efca8c68640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 0x7efca41993f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7efc9400e9f0 tx=0x7efc9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efc9a7fc640 1 -- 172.21.15.42:0/2093056057 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9400cd80 con 0x7efca4101030 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca4196ca0 con 0x7efca4101030 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca4197240 con 0x7efca4101030 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efc9a7fc640 1 -- 172.21.15.42:0/2093056057 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc94010930 con 0x7efca4101030 2024-03-31T23:18:34.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.334+0000 7efc9a7fc640 1 -- 172.21.15.42:0/2093056057 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94018a10 con 0x7efca4101030 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.336+0000 7efc9a7fc640 1 -- 172.21.15.42:0/2093056057 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7efc94010ae0 con 0x7efca4101030 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 Processor -- start 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 -- start start 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed61add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed6239b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed6262e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed51b0b0 con 0x55f8ed61b310 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed57dea0 con 0x55f8ed61a9f0 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efcae382740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed526c00 con 0x55f8ed623ef0 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efc9a7fc640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efc900a26a0 0x7efc900a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efca9469640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed6239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efca9469640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed6239b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35498/0 (socket says 172.21.15.42:35498) 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efca9469640 1 -- 172.21.15.42:0/2214937037 learned_addr learned my addr 172.21.15.42:0/2214937037 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efca8c68640 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed6262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed61add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.337+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efc900a26a0 0x7efc900a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 -- 172.21.15.42:0/2214937037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 msgr2=0x55f8ed6262e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed6262e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efc9a7fc640 1 -- 172.21.15.42:0/2093056057 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7efc940cf390 con 0x7efca4101030 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 -- 172.21.15.42:0/2214937037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 msgr2=0x55f8ed6239b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed6239b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 -- 172.21.15.42:0/2214937037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ed35a7e0 con 0x55f8ed61a9f0 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9469640 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed6239b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed61add0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02c700 tx=0x7efc9c032970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39ce078b236b4f6b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efc900a26a0 0x7efc900a4b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02c630 tx=0x7efc9c03b000 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efc8f7fe640 1 -- 172.21.15.42:0/2214937037 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c051070 con 0x55f8ed61a9f0 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efc8f7fe640 1 -- 172.21.15.42:0/2214937037 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc9c03a040 con 0x55f8ed61a9f0 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.338+0000 7efc8f7fe640 1 -- 172.21.15.42:0/2214937037 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c039040 con 0x55f8ed61a9f0 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 -- 172.21.15.42:0/2214937037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 msgr2=0x55f8ed61add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed61add0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02c700 tx=0x7efc9c032970 comp rx=0 tx=0).stop 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 -- 172.21.15.42:0/2214937037 shutdown_connections 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed6262e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed6239b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 --2- 172.21.15.42:0/2214937037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed61add0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 -- 172.21.15.42:0/2214937037 >> 172.21.15.42:0/2214937037 conn(0x55f8ed615120 msgr2=0x55f8ed615500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 -- 172.21.15.42:0/2214937037 shutdown_connections 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 -- 172.21.15.42:0/2214937037 wait complete. 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 -- start start 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 Processor -- start 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed620f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.339+0000 7efcae382740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 0x55f8ed621480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efcae382740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 0x55f8ed6219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efcae382740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed51c3d0 con 0x55f8ed623ef0 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efcae382740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed579f40 con 0x55f8ed61b310 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efcae382740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed626c80 con 0x55f8ed61a9f0 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efcae382740 10 client.0 _ll_register_callbacks cb 0x55f8ed539b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca9469640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed620f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 0x55f8ed621480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca9c6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 0x55f8ed6219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 0x55f8ed621480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:35530/0 (socket says 172.21.15.42:35530) 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca9469640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed620f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:51462/0 (socket says 172.21.15.42:51462) 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca9c6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 0x55f8ed6219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35510/0 (socket says 172.21.15.42:35510) 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 -- 172.21.15.42:0/2089258041 learned_addr learned my addr 172.21.15.42:0/2089258041 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 -- 172.21.15.42:0/2089258041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 msgr2=0x55f8ed620f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed620f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 -- 172.21.15.42:0/2089258041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 msgr2=0x55f8ed6219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 0x55f8ed6219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 -- 172.21.15.42:0/2089258041 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ed3baf70 con 0x55f8ed61b310 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca9c6a640 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 0x55f8ed6219c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efca8c68640 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 0x55f8ed621480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc94018520 tx=0x7efc9409b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bdfcb7df3d3a0d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efc8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efc8cff9640 1 -- 172.21.15.42:0/2089258041 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94026040 con 0x55f8ed61b310 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efc8cff9640 1 -- 172.21.15.42:0/2089258041 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7efc940cc960 con 0x55f8ed61b310 2024-03-31T23:18:34.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.340+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9c03a040 con 0x55f8ed61b310 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efc8cff9640 1 -- 172.21.15.42:0/2089258041 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc940a4040 con 0x55f8ed61b310 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 10 client.25760 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f8ed252170 con 0x55f8ed61b310 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efc8cff9640 1 -- 172.21.15.42:0/2089258041 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc9c03a040 con 0x55f8ed61b310 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efc8cff9640 1 -- 172.21.15.42:0/2089258041 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efc9409ab30 con 0x55f8ed61b310 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 10 client.25760 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 10 client.25760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 20 client.25760 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed633df0 0x55f8ed636210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 4 client.25760 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8ed58b3e0 con 0x55f8ed633df0 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efca9469640 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed633df0 0x55f8ed636210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efc8cff9640 10 client.25760 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.341+0000 7efca9469640 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed633df0 0x55f8ed636210 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a5dc4657aa16b6 server_cookie=b0bcf8b6c9e84c61 in_seq=0 out_seq=0 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.342+0000 7efc8cff9640 1 -- 172.21.15.42:0/2089258041 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f8ed58b3e0 con 0x55f8ed633df0 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.342+0000 7efc8cff9640 10 client.25760 handle_command_reply: tid=0 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 client.25760 shutdown 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 msgr2=0x55f8ed621480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 0x55f8ed621480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc94018520 tx=0x7efc9409b040 comp rx=0 tx=0).stop 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 shutdown_connections 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed633df0 0x55f8ed636210 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed623ef0 0x55f8ed6219c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efc8cff9640 0 client.25760 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61b310 0x55f8ed621480 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 --2- 172.21.15.42:0/2089258041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed620f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 >> 172.21.15.42:0/2089258041 conn(0x55f8ed615120 msgr2=0x55f8ed616e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 shutdown_connections 2024-03-31T23:18:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 1 -- 172.21.15.42:0/2089258041 wait complete. 2024-03-31T23:18:34.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.343+0000 7efcae382740 20 client.25760 trim_cache size 0 max 16384 2024-03-31T23:18:34.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.360+0000 7efcae382740 1 Processor -- start 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.360+0000 7efcae382740 1 -- start start 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efcae382740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed623670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efcae382740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efcae382740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed623ef0 0x55f8ed63bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efcae382740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc8800fe40 con 0x55f8ed61b310 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efcae382740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc88011980 con 0x55f8ed623ef0 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efcae382740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc88010510 con 0x55f8ed61a9f0 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35526/0 (socket says 172.21.15.42:35526) 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 -- 172.21.15.42:0/4190928107 learned_addr learned my addr 172.21.15.42:0/4190928107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca9469640 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed623670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca9c6a640 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed623ef0 0x55f8ed63bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 -- 172.21.15.42:0/4190928107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 msgr2=0x55f8ed623670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed623670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 -- 172.21.15.42:0/4190928107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed623ef0 msgr2=0x55f8ed63bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed623ef0 0x55f8ed63bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 -- 172.21.15.42:0/4190928107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ed626650 con 0x55f8ed61b310 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efca8c68640 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62f8d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efc940045f0 tx=0x7efc94000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbf00ac0a90f72e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efc8effd640 1 -- 172.21.15.42:0/4190928107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94097980 con 0x55f8ed61b310 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efc8effd640 1 -- 172.21.15.42:0/4190928107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc9409b6e0 con 0x55f8ed61b310 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.361+0000 7efc8effd640 1 -- 172.21.15.42:0/4190928107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940975d0 con 0x55f8ed61b310 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 -- 172.21.15.42:0/4190928107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 msgr2=0x55f8ed62f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62f8d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efc940045f0 tx=0x7efc94000bc0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 -- 172.21.15.42:0/4190928107 shutdown_connections 2024-03-31T23:18:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed623ef0 0x55f8ed63bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62f8d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 --2- 172.21.15.42:0/4190928107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed61a9f0 0x55f8ed623670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 -- 172.21.15.42:0/4190928107 >> 172.21.15.42:0/4190928107 conn(0x55f8ed615120 msgr2=0x55f8ed6138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 -- 172.21.15.42:0/4190928107 shutdown_connections 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 -- 172.21.15.42:0/4190928107 wait complete. 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 -- start start 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.362+0000 7efcae382740 1 Processor -- start 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed62ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed627fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc880112b0 con 0x55f8ed61b310 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc88010be0 con 0x55f8ed61a9f0 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc8800de00 con 0x55f8ed623ef0 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efcae382740 10 client.0 _ll_register_callbacks cb 0x7efc9409b4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35532/0 (socket says 172.21.15.42:35532) 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 -- 172.21.15.42:0/64215070 learned_addr learned my addr 172.21.15.42:0/64215070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca9c6a640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed627fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca9469640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed62ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 -- 172.21.15.42:0/64215070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 msgr2=0x55f8ed627fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed627fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 -- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 msgr2=0x55f8ed62ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed62ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 -- 172.21.15.42:0/64215070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ed6286e0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efca8c68640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62bf50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc940980b0 tx=0x7efc940cc6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e699afdd4d72845 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efc8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.363+0000 7efc8cff9640 1 -- 172.21.15.42:0/64215070 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9409ab30 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9409b6e0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efc8cff9640 1 -- 172.21.15.42:0/64215070 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7efc940974b0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efc8cff9640 1 -- 172.21.15.42:0/64215070 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc9409acd0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 10 client.15939 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f8ed6286e0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efc8cff9640 1 -- 172.21.15.42:0/64215070 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc9409b6e0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efc8cff9640 1 -- 172.21.15.42:0/64215070 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efc940a09a0 con 0x55f8ed61b310 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 10 client.15939 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 20 client.15939 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:34.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed69ae50 0x55f8ed69d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 4 client.15939 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-31T23:18:34.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f8ed585730 con 0x55f8ed69ae50 2024-03-31T23:18:34.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.364+0000 7efca9469640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed69ae50 0x55f8ed69d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.365+0000 7efc8cff9640 10 client.15939 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.365+0000 7efca9469640 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed69ae50 0x55f8ed69d240 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a455a141524a261 server_cookie=ba84d1dfe1cd1743 in_seq=0 out_seq=0 2024-03-31T23:18:34.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efc8cff9640 1 -- 172.21.15.42:0/64215070 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f8ed585730 con 0x55f8ed69ae50 2024-03-31T23:18:34.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efc8cff9640 10 client.15939 handle_command_reply: tid=0 2024-03-31T23:18:34.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 client.15939 shutdown 2024-03-31T23:18:34.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 msgr2=0x55f8ed62bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62bf50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc940980b0 tx=0x7efc940cc6f0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 shutdown_connections 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8ed69ae50 0x55f8ed69d240 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8ed623ef0 0x55f8ed627fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ed61b310 0x55f8ed62bf50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 --2- 172.21.15.42:0/64215070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f8ed61a9f0 0x55f8ed62ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 >> 172.21.15.42:0/64215070 conn(0x55f8ed615120 msgr2=0x55f8ed621790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efc8cff9640 0 client.15939 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 shutdown_connections 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 1 -- 172.21.15.42:0/64215070 wait complete. 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.366+0000 7efcae382740 20 client.15939 trim_cache size 0 max 16384 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:18:34.373 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-03-31T23:18:34.374 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "48fd2281-c073-4a42-8135-c9b86ca83509", 2024-03-31T23:18:34.374 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-03-31T23:18:34.374 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:18:34.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efc900a26a0 msgr2=0x7efc900a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efc900a26a0 0x7efc900a4b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02c630 tx=0x7efc9c03b000 comp rx=0 tx=0).stop 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 msgr2=0x7efca41993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 0x7efca41993f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7efc9400e9f0 tx=0x7efc9400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 shutdown_connections 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efca4106680 0x7efca41a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efc900a26a0 0x7efc900a4b60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efca4101030 0x7efca41993f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 --2- 172.21.15.42:0/2093056057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca4100670 0x7efca4198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 >> 172.21.15.42:0/2093056057 conn(0x7efca40777b0 msgr2=0x7efca41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 shutdown_connections 2024-03-31T23:18:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.367+0000 7efcab6cd640 1 -- 172.21.15.42:0/2093056057 wait complete. 2024-03-31T23:18:34.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:18:34.378 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:18:34.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 -- 172.21.15.42:0/58696915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001020b0 msgr2=0x7f530010e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 --2- 172.21.15.42:0/58696915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001020b0 0x7f530010e5c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009cd0 tx=0x7f52f802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 -- 172.21.15.42:0/58696915 shutdown_connections 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 --2- 172.21.15.42:0/58696915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001020b0 0x7f530010e5c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 --2- 172.21.15.42:0/58696915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001016f0 0x7f5300101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 --2- 172.21.15.42:0/58696915 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 0x7f5300107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 -- 172.21.15.42:0/58696915 >> 172.21.15.42:0/58696915 conn(0x7f53000fd180 msgr2=0x7f53000ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 -- 172.21.15.42:0/58696915 shutdown_connections 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.483+0000 7f5306756640 1 -- 172.21.15.42:0/58696915 wait complete. 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 Processor -- start 2024-03-31T23:18:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 -- start start 2024-03-31T23:18:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001016f0 0x7f5300198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 0x7f5300198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 0x7f530019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5300111bf0 con 0x7f53001020b0 2024-03-31T23:18:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5300111a70 con 0x7f5300107700 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5306756640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5300111d70 con 0x7f53001016f0 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f52ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 0x7f5300198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f52ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 0x7f5300198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35552/0 (socket says 172.21.15.42:35552) 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f52ff7fe640 1 -- 172.21.15.42:0/975519754 learned_addr learned my addr 172.21.15.42:0/975519754 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f52fffff640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001016f0 0x7f5300198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.484+0000 7f5304cf3640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 0x7f530019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52ff7fe640 1 -- 172.21.15.42:0/975519754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001016f0 msgr2=0x7f5300198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001016f0 0x7f5300198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52ff7fe640 1 -- 172.21.15.42:0/975519754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 msgr2=0x7f530019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 0x7f530019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52ff7fe640 1 -- 172.21.15.42:0/975519754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530019d120 con 0x7f53001020b0 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f5304cf3640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 0x7f530019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 0x7f5300198670 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f52f400e9f0 tx=0x7f52f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52fd7fa640 1 -- 172.21.15.42:0/975519754 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f400cd80 con 0x7f53001020b0 2024-03-31T23:18:34.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530019d410 con 0x7f53001020b0 2024-03-31T23:18:34.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52fd7fa640 1 -- 172.21.15.42:0/975519754 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f4010930 con 0x7f53001020b0 2024-03-31T23:18:34.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f52fd7fa640 1 -- 172.21.15.42:0/975519754 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4018b00 con 0x7f53001020b0 2024-03-31T23:18:34.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.485+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53001a4ca0 con 0x7f53001020b0 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.487+0000 7f52fd7fa640 1 -- 172.21.15.42:0/975519754 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f52f4018ca0 con 0x7f53001020b0 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 Processor -- start 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 -- start start 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f52fd7fa640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52e80a26a0 0x7f52e80a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c33ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a5c3344180 con 0x55a5c33e9790 2024-03-31T23:18:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a5c32ecb70 con 0x55a5c33e0290 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5309413740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a5c3340220 con 0x55a5c33e0bb0 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5304cf3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c33ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5304cf3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c33ebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35568/0 (socket says 172.21.15.42:35568) 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5304cf3640 1 -- 172.21.15.42:0/895269253 learned_addr learned my addr 172.21.15.42:0/895269253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f52fffff640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52e80a26a0 0x7f52e80a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f5304cf3640 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.488+0000 7f52fd7fa640 1 -- 172.21.15.42:0/975519754 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f52f40cf3b0 con 0x7f53001020b0 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f5304cf3640 1 -- 172.21.15.42:0/895269253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 msgr2=0x55a5c33e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f5304cf3640 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f5304cf3640 1 -- 172.21.15.42:0/895269253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 msgr2=0x55a5c33e0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f5304cf3640 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f5304cf3640 1 -- 172.21.15.42:0/895269253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5c33007c0 con 0x55a5c33e9790 2024-03-31T23:18:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f52fffff640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52e80a26a0 0x7f52e80a4b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009b50 tx=0x7f52f0005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f5304cf3640 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c33ebb80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f52f802c700 tx=0x7f52f802e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25ed03a53f988b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f52e67fc640 1 -- 172.21.15.42:0/895269253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f804a070 con 0x55a5c33e9790 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f52e67fc640 1 -- 172.21.15.42:0/895269253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f8003970 con 0x55a5c33e9790 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.489+0000 7f52e67fc640 1 -- 172.21.15.42:0/895269253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8039040 con 0x55a5c33e9790 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- 172.21.15.42:0/895269253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 msgr2=0x55a5c33ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c33ebb80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f52f802c700 tx=0x7f52f802e040 comp rx=0 tx=0).stop 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- 172.21.15.42:0/895269253 shutdown_connections 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c33ebb80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- 172.21.15.42:0/895269253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- 172.21.15.42:0/895269253 >> 172.21.15.42:0/895269253 conn(0x55a5c33da9c0 msgr2=0x55a5c33dada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- 172.21.15.42:0/895269253 shutdown_connections 2024-03-31T23:18:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- 172.21.15.42:0/895269253 wait complete. 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- start start 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 Processor -- start 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0290 0x55a5c33e6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e9790 0x55a5c33e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.490+0000 7f5309413740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a5c33ec520 con 0x55a5c33e0bb0 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5309413740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a5c32e24a0 con 0x55a5c33e9790 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5309413740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a5c33ec6a0 con 0x55a5c33e0290 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5309413740 10 client.0 _ll_register_callbacks cb 0x55a5c32e5d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5304cf3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e9790 0x55a5c33e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52fffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0290 0x55a5c33e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35570/0 (socket says 172.21.15.42:35570) 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 -- 172.21.15.42:0/1211017179 learned_addr learned my addr 172.21.15.42:0/1211017179 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 -- 172.21.15.42:0/1211017179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0290 msgr2=0x55a5c33e6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0290 0x55a5c33e6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 -- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e9790 msgr2=0x55a5c33e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e9790 0x55a5c33e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 -- 172.21.15.42:0/1211017179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c31227d0 con 0x55a5c33e0bb0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5304cf3640 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e9790 0x55a5c33e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e6d60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c6a0 tx=0x7f52f401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a136acc9951058 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52df7fe640 1 -- 172.21.15.42:0/1211017179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4026040 con 0x55a5c33e0bb0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52df7fe640 1 -- 172.21.15.42:0/1211017179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f52f40a3390 con 0x55a5c33e0bb0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52f8003970 con 0x55a5c33e0bb0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f52df7fe640 1 -- 172.21.15.42:0/1211017179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52f40860b0 con 0x55a5c33e0bb0 2024-03-31T23:18:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5309413740 10 client.15951 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.491+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5c30583f0 con 0x55a5c33e0bb0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f52df7fe640 1 -- 172.21.15.42:0/1211017179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f8003970 con 0x55a5c33e0bb0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f52df7fe640 1 -- 172.21.15.42:0/1211017179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f52f40a3790 con 0x55a5c33e0bb0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f5309413740 10 client.15951 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f5309413740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f5309413740 20 client.15951 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f5309413740 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c33f9ab0 0x55a5c33fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f5309413740 4 client.15951 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5c33516c0 con 0x55a5c33f9ab0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f52fffff640 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c33f9ab0 0x55a5c33fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f52df7fe640 10 client.15951 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.492+0000 7f52fffff640 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c33f9ab0 0x55a5c33fbf10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34848509fe634c0f server_cookie=46b7e38a8a98f4ac in_seq=0 out_seq=0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f52df7fe640 1 -- 172.21.15.42:0/1211017179 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a5c33516c0 con 0x55a5c33f9ab0 2024-03-31T23:18:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f52df7fe640 10 client.15951 handle_command_reply: tid=0 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 client.15951 shutdown 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 msgr2=0x55a5c33e6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e6d60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c6a0 tx=0x7f52f401c9e0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 shutdown_connections 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c33f9ab0 0x55a5c33fbf10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e9790 0x55a5c33e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0bb0 0x55a5c33e6d60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f52df7fe640 0 client.15951 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 --2- 172.21.15.42:0/1211017179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0290 0x55a5c33e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 >> 172.21.15.42:0/1211017179 conn(0x55a5c33da9c0 msgr2=0x55a5c33dc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 shutdown_connections 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.493+0000 7f5309413740 1 -- 172.21.15.42:0/1211017179 wait complete. 2024-03-31T23:18:34.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.494+0000 7f5309413740 20 client.15951 trim_cache size 0 max 16384 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 Processor -- start 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 -- start start 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c34017e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53001aed80 con 0x55a5c33e9790 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53001b08c0 con 0x55a5c33e0290 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5309413740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53001af450 con 0x55a5c33e0bb0 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c34017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c34017e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35580/0 (socket says 172.21.15.42:35580) 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 -- 172.21.15.42:0/3970641347 learned_addr learned my addr 172.21.15.42:0/3970641347 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f52fffff640 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 -- 172.21.15.42:0/3970641347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 msgr2=0x55a5c33f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 -- 172.21.15.42:0/3970641347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 msgr2=0x55a5c33e8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.511+0000 7f5304cf3640 1 -- 172.21.15.42:0/3970641347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5c30180f0 con 0x55a5c33e9790 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5304cf3640 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c34017e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f52f8004140 tx=0x7f52f8004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1f792c1a1b2df1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f52e5ffb640 1 -- 172.21.15.42:0/3970641347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8054070 con 0x55a5c33e9790 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f52e5ffb640 1 -- 172.21.15.42:0/3970641347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f804b040 con 0x55a5c33e9790 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f52e5ffb640 1 -- 172.21.15.42:0/3970641347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f804a070 con 0x55a5c33e9790 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 -- 172.21.15.42:0/3970641347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 msgr2=0x55a5c34017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c34017e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f52f8004140 tx=0x7f52f8004210 comp rx=0 tx=0).stop 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 -- 172.21.15.42:0/3970641347 shutdown_connections 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e9790 0x55a5c34017e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e0bb0 0x55a5c33f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 --2- 172.21.15.42:0/3970641347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0290 0x55a5c33e8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 -- 172.21.15.42:0/3970641347 >> 172.21.15.42:0/3970641347 conn(0x55a5c33da9c0 msgr2=0x55a5c33d9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 -- 172.21.15.42:0/3970641347 shutdown_connections 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.512+0000 7f5309413740 1 -- 172.21.15.42:0/3970641347 wait complete. 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 -- start start 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 Processor -- start 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 0x55a5c33ed870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0bb0 0x55a5c33eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e9790 0x55a5c345ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53001b01f0 con 0x55a5c33e0290 2024-03-31T23:18:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53001afb20 con 0x55a5c33e0bb0 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53001acd40 con 0x55a5c33e9790 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5309413740 10 client.0 _ll_register_callbacks cb 0x7f52f400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f52fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 0x55a5c33ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f52fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 0x55a5c33ed870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35594/0 (socket says 172.21.15.42:35594) 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f52fffff640 1 -- 172.21.15.42:0/4266568753 learned_addr learned my addr 172.21.15.42:0/4266568753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0bb0 0x55a5c33eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.513+0000 7f5304cf3640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e9790 0x55a5c345ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52fffff640 1 -- 172.21.15.42:0/4266568753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e9790 msgr2=0x55a5c345ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52fffff640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e9790 0x55a5c345ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52fffff640 1 -- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0bb0 msgr2=0x55a5c33eddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52fffff640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0bb0 0x55a5c33eddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52fffff640 1 -- 172.21.15.42:0/4266568753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c345f350 con 0x55a5c33e0290 2024-03-31T23:18:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52fffff640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 0x55a5c33ed870 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009fd0 tx=0x7f52f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b239a738053ec231 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52df7fe640 1 -- 172.21.15.42:0/4266568753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f001e920 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52df7fe640 1 -- 172.21.15.42:0/4266568753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f52f001eac0 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52f804b040 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52df7fe640 1 -- 172.21.15.42:0/4266568753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52f0039050 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f5309413740 10 client.15957 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5c3460620 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52df7fe640 1 -- 172.21.15.42:0/4266568753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f804b040 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f52df7fe640 1 -- 172.21.15.42:0/4266568753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f52f000f3c0 con 0x55a5c33e0290 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f5309413740 10 client.15957 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f5309413740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.514+0000 7f5309413740 20 client.15957 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c3460cf0 0x55a5c3463110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 4 client.15957 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:18:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5c334ba10 con 0x55a5c3460cf0 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c3460cf0 0x55a5c3463110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f52df7fe640 10 client.15957 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f52ff7fe640 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c3460cf0 0x55a5c3463110 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5815c7b89baa528 server_cookie=da12d27eab2d532 in_seq=0 out_seq=0 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f52df7fe640 1 -- 172.21.15.42:0/4266568753 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a5c334ba10 con 0x55a5c3460cf0 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f52df7fe640 10 client.15957 handle_command_reply: tid=0 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 client.15957 shutdown 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 msgr2=0x55a5c33ed870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 0x55a5c33ed870 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009fd0 tx=0x7f52f0004730 comp rx=0 tx=0).stop 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 shutdown_connections 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a5c3460cf0 0x55a5c3463110 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a5c33e9790 0x55a5c345ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f52df7fe640 0 client.15957 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a5c33e0bb0 0x55a5c33eddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 --2- 172.21.15.42:0/4266568753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5c33e0290 0x55a5c33ed870 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.515+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 >> 172.21.15.42:0/4266568753 conn(0x55a5c33da9c0 msgr2=0x55a5c33e67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 shutdown_connections 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5309413740 1 -- 172.21.15.42:0/4266568753 wait complete. 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5309413740 20 client.15957 trim_cache size 0 max 16384 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stdout: "48fd2281-c073-4a42-8135-c9b86ca83509": { 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-03-31T23:18:34.523 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "48fd2281-c073-4a42-8135-c9b86ca83509", 2024-03-31T23:18:34.524 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-03-31T23:18:34.524 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:18:34.524 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:18:34.524 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52e80a26a0 msgr2=0x7f52e80a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52e80a26a0 0x7f52e80a4b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009b50 tx=0x7f52f0005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 msgr2=0x7f5300198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 0x7f5300198670 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f52f400e9f0 tx=0x7f52f400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 shutdown_connections 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300107700 0x7f530019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52e80a26a0 0x7f52e80a4b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53001020b0 0x7f5300198670 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 --2- 172.21.15.42:0/975519754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53001016f0 0x7f5300198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 >> 172.21.15.42:0/975519754 conn(0x7f53000fd180 msgr2=0x7f53000fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 shutdown_connections 2024-03-31T23:18:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:18:34.516+0000 7f5306756640 1 -- 172.21.15.42:0/975519754 wait complete. 2024-03-31T23:18:34.527 INFO:tasks.cephfs.filesystem:scrub status for tag:48fd2281-c073-4a42-8135-c9b86ca83509 - {'path': '/', 'tag': '48fd2281-c073-4a42-8135-c9b86ca83509', 'options': 'recursive,force'} 2024-03-31T23:18:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:35 smithi094 ceph-mon[36167]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-03-31T23:18:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:35 smithi094 ceph-mon[36167]: scrub queued for path: / 2024-03-31T23:18:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:35 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:35 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:18:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:35 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:35.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:35 smithi188 ceph-mon[36068]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-03-31T23:18:35.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:35 smithi188 ceph-mon[36068]: scrub queued for path: / 2024-03-31T23:18:35.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:35 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:35.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:35 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:18:35.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:35 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:35 smithi042 ceph-mon[32380]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-03-31T23:18:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:35 smithi042 ceph-mon[32380]: scrub queued for path: / 2024-03-31T23:18:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:35 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:35 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:18:36.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:35 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:18:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:37 smithi094 ceph-mon[36167]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-03-31T23:18:37.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:37 smithi188 ceph-mon[36068]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-03-31T23:18:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:37 smithi042 ceph-mon[32380]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-03-31T23:18:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 -- 172.21.15.42:0/252229848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364107730 msgr2=0x7f4364107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 --2- 172.21.15.42:0/252229848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364107730 0x7f4364107b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4354009930 tx=0x7f435402bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 -- 172.21.15.42:0/252229848 shutdown_connections 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 --2- 172.21.15.42:0/252229848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43641020e0 0x7f436410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 --2- 172.21.15.42:0/252229848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364101720 0x7f4364101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 --2- 172.21.15.42:0/252229848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364107730 0x7f4364107b10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 -- 172.21.15.42:0/252229848 >> 172.21.15.42:0/252229848 conn(0x7f43640fd230 msgr2=0x7f43640ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 -- 172.21.15.42:0/252229848 shutdown_connections 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 -- 172.21.15.42:0/252229848 wait complete. 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 Processor -- start 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.408+0000 7f43692ed640 1 -- start start 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43692ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 0x7f43641980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43692ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43641020e0 0x7f43641985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43692ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364107730 0x7f436419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43692ed640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4364111c10 con 0x7f4364101720 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43692ed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4364111a90 con 0x7f4364107730 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43692ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4364111d90 con 0x7f43641020e0 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 0x7f43641980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43627fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43641020e0 0x7f43641985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 0x7f43641980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35618/0 (socket says 172.21.15.42:35618) 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364107730 0x7f436419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f4362ffd640 1 -- 172.21.15.42:0/2167221256 learned_addr learned my addr 172.21.15.42:0/2167221256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 -- 172.21.15.42:0/2167221256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43641020e0 msgr2=0x7f43641985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43641020e0 0x7f43641985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 -- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 msgr2=0x7f43641980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 0x7f43641980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 -- 172.21.15.42:0/2167221256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436419d050 con 0x7f4364107730 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f4362ffd640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 0x7f43641980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f43637fe640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364107730 0x7f436419c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f435c009fd0 tx=0x7f435c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.409+0000 7f434bfff640 1 -- 172.21.15.42:0/2167221256 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c00ce20 con 0x7f4364107730 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.410+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f436419d340 con 0x7f4364107730 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.410+0000 7f434bfff640 1 -- 172.21.15.42:0/2167221256 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f435c004b20 con 0x7f4364107730 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.410+0000 7f434bfff640 1 -- 172.21.15.42:0/2167221256 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c010790 con 0x7f4364107730 2024-03-31T23:18:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.410+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43641a4bd0 con 0x7f4364107730 2024-03-31T23:18:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f434bfff640 1 -- 172.21.15.42:0/2167221256 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7f435c004cd0 con 0x7f4364107730 2024-03-31T23:18:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f436bfab740 1 Processor -- start 2024-03-31T23:18:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f434bfff640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f434c0a2750 0x7f434c0a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f436bfab740 1 -- start start 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f43627fc640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f434c0a2750 0x7f434c0a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f434bfff640 1 -- 172.21.15.42:0/2167221256 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f435c0cf6f0 con 0x7f4364107730 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f436bfab740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.412+0000 7f436bfab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f436bfab740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f436bfab740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55651b2198f0 con 0x55651b2b66c0 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f436bfab740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55651b1c28d0 con 0x55651b2bfdb0 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f436bfab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55651b215990 con 0x55651b2b6fe0 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35622/0 (socket says 172.21.15.42:35622) 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43627fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 -- 172.21.15.42:0/2224995376 learned_addr learned my addr 172.21.15.42:0/2224995376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43637fe640 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43627fc640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f434c0a2750 0x7f434c0a4c10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4364106cb0 tx=0x7f4358011920 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 -- 172.21.15.42:0/2224995376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 msgr2=0x55651b2bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 -- 172.21.15.42:0/2224995376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 msgr2=0x55651b2c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 -- 172.21.15.42:0/2224995376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55651af2e210 con 0x55651b2b66c0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43627fc640 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f4362ffd640 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2b6aa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4354009a50 tx=0x7f43540095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33520c0dd21b456 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43497fa640 1 -- 172.21.15.42:0/2224995376 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435402db20 con 0x55651b2b66c0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43497fa640 1 -- 172.21.15.42:0/2224995376 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f435402dcc0 con 0x55651b2b66c0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.413+0000 7f43497fa640 1 -- 172.21.15.42:0/2224995376 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354004920 con 0x55651b2b66c0 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 -- 172.21.15.42:0/2224995376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 msgr2=0x55651b2b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2b6aa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4354009a50 tx=0x7f43540095f0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 -- 172.21.15.42:0/2224995376 shutdown_connections 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 --2- 172.21.15.42:0/2224995376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2b6aa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 -- 172.21.15.42:0/2224995376 >> 172.21.15.42:0/2224995376 conn(0x55651b2b0fe0 msgr2=0x55651b2b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 -- 172.21.15.42:0/2224995376 shutdown_connections 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 -- 172.21.15.42:0/2224995376 wait complete. 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.414+0000 7f436bfab740 1 -- start start 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 Processor -- start 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b66c0 0x55651b2bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2b6fe0 0x55651b2bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 0x55651b2bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55651b2c2980 con 0x55651b2bfdb0 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55651b1b7f80 con 0x55651b2b6fe0 2024-03-31T23:18:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55651b2c2b00 con 0x55651b2b66c0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f436bfab740 10 client.0 _ll_register_callbacks cb 0x55651b210290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 0x55651b2bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 0x55651b2bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35632/0 (socket says 172.21.15.42:35632) 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 -- 172.21.15.42:0/1499208028 learned_addr learned my addr 172.21.15.42:0/1499208028 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f4362ffd640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b66c0 0x55651b2bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43627fc640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2b6fe0 0x55651b2bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 -- 172.21.15.42:0/1499208028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b66c0 msgr2=0x55651b2bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b66c0 0x55651b2bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 -- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2b6fe0 msgr2=0x55651b2bd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2b6fe0 0x55651b2bd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 -- 172.21.15.42:0/1499208028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55651affa620 con 0x55651b2bfdb0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f43637fe640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 0x55651b2bd770 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f435c097df0 tx=0x7f435c09ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e59057bf38abcaf server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.415+0000 7f4346ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f4346ff5640 1 -- 172.21.15.42:0/1499208028 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c0b3070 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f4346ff5640 1 -- 172.21.15.42:0/1499208028 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f435c0cf300 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f435402dcc0 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f4346ff5640 1 -- 172.21.15.42:0/1499208028 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f435c0ccec0 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 10 client.15969 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55651b2ce7d0 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f4346ff5640 1 -- 172.21.15.42:0/1499208028 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f435402dcc0 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f4346ff5640 1 -- 172.21.15.42:0/1499208028 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f435c0a4010 con 0x55651b2bfdb0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 20 client.15969 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b2cfce0 0x55651b2d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 4 client.15969 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55651b22d120 con 0x55651b2cfce0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.416+0000 7f4362ffd640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b2cfce0 0x55651b2d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.417+0000 7f4346ff5640 10 client.15969 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.417+0000 7f4362ffd640 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b2cfce0 0x55651b2d2130 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddce00ac07e7a9b9 server_cookie=9a366e046e0a8487 in_seq=0 out_seq=0 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.417+0000 7f4346ff5640 1 -- 172.21.15.42:0/1499208028 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55651b22d120 con 0x55651b2cfce0 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.417+0000 7f4346ff5640 10 client.15969 handle_command_reply: tid=0 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.417+0000 7f436bfab740 1 client.15969 shutdown 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 msgr2=0x55651b2bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 0x55651b2bd770 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f435c097df0 tx=0x7f435c09ba50 comp rx=0 tx=0).stop 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 shutdown_connections 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b2cfce0 0x55651b2d2130 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2bfdb0 0x55651b2bd770 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2b6fe0 0x55651b2bd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 --2- 172.21.15.42:0/1499208028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b66c0 0x55651b2bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 >> 172.21.15.42:0/1499208028 conn(0x55651b2b0fe0 msgr2=0x55651b2b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f4346ff5640 0 client.15969 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 shutdown_connections 2024-03-31T23:18:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 1 -- 172.21.15.42:0/1499208028 wait complete. 2024-03-31T23:18:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.418+0000 7f436bfab740 20 client.15969 trim_cache size 0 max 16384 2024-03-31T23:18:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.434+0000 7f436bfab740 1 Processor -- start 2024-03-31T23:18:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.434+0000 7f436bfab740 1 -- start start 2024-03-31T23:18:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f436bfab740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2bf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f436bfab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f436bfab740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f436bfab740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43641aec30 con 0x55651b2b66c0 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f436bfab740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f43641b0770 con 0x55651b2bfdb0 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f436bfab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43641af300 con 0x55651b2b6fe0 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f43637fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2bf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35648/0 (socket says 172.21.15.42:35648) 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 -- 172.21.15.42:0/978921586 learned_addr learned my addr 172.21.15.42:0/978921586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f43627fc640 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 -- 172.21.15.42:0/978921586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 msgr2=0x55651b2cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 -- 172.21.15.42:0/978921586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 msgr2=0x55651b2afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 -- 172.21.15.42:0/978921586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55651b2bb240 con 0x55651b2b66c0 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f43637fe640 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f43627fc640 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.435+0000 7f4362ffd640 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2bf420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4354005bc0 tx=0x7f43540055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5334ee3a2625c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f4348ff9640 1 -- 172.21.15.42:0/978921586 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354005650 con 0x55651b2b66c0 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f4348ff9640 1 -- 172.21.15.42:0/978921586 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f435404e070 con 0x55651b2b66c0 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f4348ff9640 1 -- 172.21.15.42:0/978921586 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354003b30 con 0x55651b2b66c0 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 -- 172.21.15.42:0/978921586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 msgr2=0x55651b2bf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2bf420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4354005bc0 tx=0x7f43540055e0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 -- 172.21.15.42:0/978921586 shutdown_connections 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 --2- 172.21.15.42:0/978921586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2bf420 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 -- 172.21.15.42:0/978921586 >> 172.21.15.42:0/978921586 conn(0x55651b2b0fe0 msgr2=0x55651b2af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 -- 172.21.15.42:0/978921586 shutdown_connections 2024-03-31T23:18:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.436+0000 7f436bfab740 1 -- 172.21.15.42:0/978921586 wait complete. 2024-03-31T23:18:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 -- start start 2024-03-31T23:18:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 Processor -- start 2024-03-31T23:18:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43641b00a0 con 0x55651b2b66c0 2024-03-31T23:18:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f43641af9d0 con 0x55651b2bfdb0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43641acbf0 con 0x55651b2b6fe0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f436bfab740 10 client.0 _ll_register_callbacks cb 0x7f435c09b850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35656/0 (socket says 172.21.15.42:35656) 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 -- 172.21.15.42:0/4041547665 learned_addr learned my addr 172.21.15.42:0/4041547665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f43637fe640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f43627fc640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 -- 172.21.15.42:0/4041547665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 msgr2=0x55651b2b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 -- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 msgr2=0x55651b2b9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2b9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.437+0000 7f4362ffd640 1 -- 172.21.15.42:0/4041547665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55651b335070 con 0x55651b2b66c0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4362ffd640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2c8100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4354005ec0 tx=0x7f4354005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cc1b10dcda4379 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4346ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4346ff5640 1 -- 172.21.15.42:0/4041547665 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435405d020 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4346ff5640 1 -- 172.21.15.42:0/4041547665 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f435402cbd0 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f435404e070 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4346ff5640 1 -- 172.21.15.42:0/4041547665 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f435402cdd0 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 10 client.15975 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55651b336120 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4346ff5640 1 -- 172.21.15.42:0/4041547665 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f435404e070 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f4346ff5640 1 -- 172.21.15.42:0/4041547665 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f435402d300 con 0x55651b2b66c0 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 10 client.15975 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 10 client.15975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 20 client.15975 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b3363a0 0x55651b338790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 4 client.15975 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:18:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.438+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55651b226e30 con 0x55651b3363a0 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.439+0000 7f43627fc640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b3363a0 0x55651b338790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.439+0000 7f4346ff5640 10 client.15975 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.439+0000 7f43627fc640 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b3363a0 0x55651b338790 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6ced35a2df3305e server_cookie=664ec15bdfb76822 in_seq=0 out_seq=0 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f4346ff5640 1 -- 172.21.15.42:0/4041547665 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55651b226e30 con 0x55651b3363a0 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f4346ff5640 10 client.15975 handle_command_reply: tid=0 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 client.15975 shutdown 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 msgr2=0x55651b2c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2c8100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4354005ec0 tx=0x7f4354005b50 comp rx=0 tx=0).stop 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 shutdown_connections 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55651b3363a0 0x55651b338790 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55651b2bfdb0 0x55651b2b9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651b2b6fe0 0x55651b2b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f4346ff5640 0 client.15975 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 --2- 172.21.15.42:0/4041547665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55651b2b66c0 0x55651b2c8100 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 >> 172.21.15.42:0/4041547665 conn(0x55651b2b0fe0 msgr2=0x55651b2aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 shutdown_connections 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 1 -- 172.21.15.42:0/4041547665 wait complete. 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.442+0000 7f436bfab740 20 client.15975 trim_cache size 0 max 16384 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:18:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:18:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f434c0a2750 msgr2=0x7f434c0a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f434c0a2750 0x7f434c0a4c10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4364106cb0 tx=0x7f4358011920 comp rx=0 tx=0).stop 2024-03-31T23:18:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364107730 msgr2=0x7f436419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364107730 0x7f436419c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f435c009fd0 tx=0x7f435c00ef10 comp rx=0 tx=0).stop 2024-03-31T23:18:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 shutdown_connections 2024-03-31T23:18:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4364107730 0x7f436419c920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43641020e0 0x7f43641985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f434c0a2750 0x7f434c0a4c10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 --2- 172.21.15.42:0/2167221256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4364101720 0x7f43641980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 >> 172.21.15.42:0/2167221256 conn(0x7f43640fd230 msgr2=0x7f43640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 shutdown_connections 2024-03-31T23:18:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:38.443+0000 7f43692ed640 1 -- 172.21.15.42:0/2167221256 wait complete. 2024-03-31T23:18:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:39 smithi094 ceph-mon[36167]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 15 op/s 2024-03-31T23:18:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:39 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:18:39.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:39 smithi188 ceph-mon[36068]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 15 op/s 2024-03-31T23:18:39.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:39 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:18:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:39 smithi042 ceph-mon[32380]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 15 op/s 2024-03-31T23:18:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:39 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:18:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:41 smithi094 ceph-mon[36167]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:18:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:41 smithi188 ceph-mon[36068]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:18:42.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:41 smithi042 ceph-mon[32380]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:18:43.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:43 smithi094 ceph-mon[36167]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-03-31T23:18:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:43 smithi188 ceph-mon[36068]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-03-31T23:18:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:43 smithi042 ceph-mon[32380]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-03-31T23:18:45.925 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:45 smithi094 ceph-mon[36167]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-31T23:18:45.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:45 smithi188 ceph-mon[36068]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-31T23:18:46.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:45 smithi042 ceph-mon[32380]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-31T23:18:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:47 smithi094 ceph-mon[36167]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-31T23:18:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:47 smithi188 ceph-mon[36068]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-31T23:18:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:47 smithi042 ceph-mon[32380]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-31T23:18:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:49 smithi094 ceph-mon[36167]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-31T23:18:49.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:49 smithi188 ceph-mon[36068]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-31T23:18:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:49 smithi042 ceph-mon[32380]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-31T23:18:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 -- 172.21.15.42:0/215943320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984103900 msgr2=0x7fd984103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 --2- 172.21.15.42:0/215943320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984103900 0x7fd984103d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd974009930 tx=0x7fd97402bc30 comp rx=0 tx=0).stop 2024-03-31T23:18:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 -- 172.21.15.42:0/215943320 shutdown_connections 2024-03-31T23:18:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 --2- 172.21.15.42:0/215943320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9841042c0 0x7fd9841107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 --2- 172.21.15.42:0/215943320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984103900 0x7fd984103d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 --2- 172.21.15.42:0/215943320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd984109910 0x7fd984109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 -- 172.21.15.42:0/215943320 >> 172.21.15.42:0/215943320 conn(0x7fd9840ff3d0 msgr2=0x7fd9841017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:51.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 -- 172.21.15.42:0/215943320 shutdown_connections 2024-03-31T23:18:51.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.563+0000 7fd98bc98640 1 -- 172.21.15.42:0/215943320 wait complete. 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 Processor -- start 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 -- start start 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 0x7fd98410f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9841042c0 0x7fd98410fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984109910 0x7fd9841b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd984077370 con 0x7fd984103900 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9840771f0 con 0x7fd9841042c0 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98bc98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9840774f0 con 0x7fd984109910 2024-03-31T23:18:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd989a34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 0x7fd98410f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd989a34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 0x7fd98410f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32920/0 (socket says 172.21.15.42:32920) 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd989a34640 1 -- 172.21.15.42:0/132276353 learned_addr learned my addr 172.21.15.42:0/132276353 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd989233640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9841042c0 0x7fd98410fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.564+0000 7fd98a235640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984109910 0x7fd9841b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989233640 1 -- 172.21.15.42:0/132276353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984109910 msgr2=0x7fd9841b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989233640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984109910 0x7fd9841b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989233640 1 -- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 msgr2=0x7fd98410f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989233640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 0x7fd98410f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989233640 1 -- 172.21.15.42:0/132276353 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9841b3190 con 0x7fd9841042c0 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989a34640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 0x7fd98410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd989233640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9841042c0 0x7fd98410fdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd97402c170 tx=0x7fd97402dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd97affd640 1 -- 172.21.15.42:0/132276353 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974042020 con 0x7fd9841042c0 2024-03-31T23:18:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9841b3420 con 0x7fd9841042c0 2024-03-31T23:18:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd97affd640 1 -- 172.21.15.42:0/132276353 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd974004250 con 0x7fd9841042c0 2024-03-31T23:18:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd97affd640 1 -- 172.21.15.42:0/132276353 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974003bb0 con 0x7fd9841042c0 2024-03-31T23:18:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.565+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9841b3940 con 0x7fd9841042c0 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.567+0000 7fd97affd640 1 -- 172.21.15.42:0/132276353 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 23) ==== 137496+0+0 (secure 0 0 0) 0x7fd974045020 con 0x7fd9841042c0 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.568+0000 7fd97affd640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fd9700a2750 0x7fd9700a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.568+0000 7fd97affd640 1 -- 172.21.15.42:0/132276353 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fd9740f0c40 con 0x7fd9841042c0 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.568+0000 7fd989a34640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fd9700a2750 0x7fd9700a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 Processor -- start 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd989a34640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fd9700a2750 0x7fd9700a4c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd980011490 tx=0x7fd980005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 -- start start 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445951aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564445951fe0 0x56444595a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x56444595d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5644458b48f0 con 0x5644459516c0 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56444585d8d0 con 0x56444595adb0 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98e870740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5644458b0990 con 0x564445951fe0 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd989a34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445951aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd989a34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445951aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32934/0 (socket says 172.21.15.42:32934) 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd989a34640 1 -- 172.21.15.42:0/1887444214 learned_addr learned my addr 172.21.15.42:0/1887444214 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd989233640 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564445951fe0 0x56444595a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.569+0000 7fd98a235640 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x56444595d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989233640 1 -- 172.21.15.42:0/1887444214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 msgr2=0x56444595d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989233640 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x56444595d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989233640 1 -- 172.21.15.42:0/1887444214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 msgr2=0x564445951aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989233640 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445951aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989233640 1 -- 172.21.15.42:0/1887444214 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644455c9210 con 0x564445951fe0 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989a34640 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445951aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd989233640 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564445951fe0 0x56444595a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd9740ee070 tx=0x7fd9740bce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a09ec52bacccf305 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd96ffff640 1 -- 172.21.15.42:0/1887444214 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9740bd6f0 con 0x564445951fe0 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd96ffff640 1 -- 172.21.15.42:0/1887444214 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9740bcff0 con 0x564445951fe0 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.570+0000 7fd96ffff640 1 -- 172.21.15.42:0/1887444214 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974005450 con 0x564445951fe0 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 -- 172.21.15.42:0/1887444214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564445951fe0 msgr2=0x56444595a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564445951fe0 0x56444595a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd9740ee070 tx=0x7fd9740bce80 comp rx=0 tx=0).stop 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 -- 172.21.15.42:0/1887444214 shutdown_connections 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x56444595d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564445951fe0 0x56444595a870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 --2- 172.21.15.42:0/1887444214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445951aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 -- 172.21.15.42:0/1887444214 >> 172.21.15.42:0/1887444214 conn(0x56444594bfe0 msgr2=0x56444594c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 -- 172.21.15.42:0/1887444214 shutdown_connections 2024-03-31T23:18:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.571+0000 7fd98e870740 1 -- 172.21.15.42:0/1887444214 wait complete. 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.572+0000 7fd98e870740 1 -- start start 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.572+0000 7fd98e870740 1 Processor -- start 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.572+0000 7fd98e870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445957d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.572+0000 7fd98e870740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445951fe0 0x5644459582d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.572+0000 7fd98e870740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56444595adb0 0x564445958810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.572+0000 7fd98e870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56444595d7a0 con 0x5644459516c0 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445957d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445957d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32936/0 (socket says 172.21.15.42:32936) 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 -- 172.21.15.42:0/285535225 learned_addr learned my addr 172.21.15.42:0/285535225 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd98e870740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x564445852f80 con 0x564445951fe0 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56444595d920 con 0x56444595adb0 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd98a235640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56444595adb0 0x564445958810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989233640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445951fe0 0x5644459582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd98e870740 10 client.0 _ll_register_callbacks cb 0x5644458ab290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 -- 172.21.15.42:0/285535225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56444595adb0 msgr2=0x564445958810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56444595adb0 0x564445958810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 -- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445951fe0 msgr2=0x5644459582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445951fe0 0x5644459582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 -- 172.21.15.42:0/285535225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564445695620 con 0x5644459516c0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd98a235640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56444595adb0 0x564445958810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd989a34640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445957d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd98000fda0 tx=0x7fd980013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37ef192585397c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd96d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd96d7fa640 1 -- 172.21.15.42:0/285535225 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980005220 con 0x5644459516c0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.573+0000 7fd96d7fa640 1 -- 172.21.15.42:0/285535225 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fd9800053c0 con 0x5644459516c0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9740bcff0 con 0x5644459516c0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd96d7fa640 1 -- 172.21.15.42:0/285535225 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd98000fe90 con 0x5644459516c0 2024-03-31T23:18:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5644459695d0 con 0x5644459516c0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd96d7fa640 1 -- 172.21.15.42:0/285535225 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9740bcff0 con 0x5644459516c0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd96d7fa640 1 -- 172.21.15.42:0/285535225 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd98001a9e0 con 0x5644459516c0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 20 client.15987 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56444596aae0 0x56444596cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 4 client.15987 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644458c8120 con 0x56444596aae0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.574+0000 7fd989233640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56444596aae0 0x56444596cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.575+0000 7fd989233640 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56444596aae0 0x56444596cef0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243cd5381ab1f2a8 server_cookie=f1b7f74182b7c783 in_seq=0 out_seq=0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.575+0000 7fd96d7fa640 10 client.15987 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd96d7fa640 1 -- 172.21.15.42:0/285535225 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5644458c8120 con 0x56444596aae0 2024-03-31T23:18:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd96d7fa640 10 client.15987 handle_command_reply: tid=0 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 client.15987 shutdown 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 msgr2=0x564445957d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445957d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd98000fda0 tx=0x7fd980013040 comp rx=0 tx=0).stop 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 shutdown_connections 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56444596aae0 0x56444596cef0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56444595adb0 0x564445958810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445951fe0 0x5644459582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd96d7fa640 0 client.15987 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 --2- 172.21.15.42:0/285535225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644459516c0 0x564445957d90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 >> 172.21.15.42:0/285535225 conn(0x56444594bfe0 msgr2=0x56444594dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 shutdown_connections 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 1 -- 172.21.15.42:0/285535225 wait complete. 2024-03-31T23:18:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.576+0000 7fd98e870740 20 client.15987 trim_cache size 0 max 16384 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.605+0000 7fd98e870740 1 Processor -- start 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 -- start start 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x56444595a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 0x564445966410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x564445972800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841bda30 con 0x564445951fe0 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841bf570 con 0x56444595adb0 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98e870740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841be100 con 0x5644459516c0 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 0x564445966410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989a34640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x56444595a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 0x564445966410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32948/0 (socket says 172.21.15.42:32948) 2024-03-31T23:18:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 -- 172.21.15.42:0/1994048056 learned_addr learned my addr 172.21.15.42:0/1994048056 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98a235640 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x564445972800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 -- 172.21.15.42:0/1994048056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 msgr2=0x56444595a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x56444595a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 -- 172.21.15.42:0/1994048056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 msgr2=0x564445972800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x564445972800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd989233640 1 -- 172.21.15.42:0/1994048056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564445951dd0 con 0x564445951fe0 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.606+0000 7fd98a235640 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x564445972800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.607+0000 7fd989233640 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 0x564445966410 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c1160 tx=0x7fd9740d5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527146774bcee035 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.607+0000 7fd96f7fe640 1 -- 172.21.15.42:0/1994048056 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9740c5a00 con 0x564445951fe0 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.607+0000 7fd96f7fe640 1 -- 172.21.15.42:0/1994048056 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9740bcff0 con 0x564445951fe0 2024-03-31T23:18:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.607+0000 7fd96f7fe640 1 -- 172.21.15.42:0/1994048056 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974005450 con 0x564445951fe0 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 -- 172.21.15.42:0/1994048056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 msgr2=0x564445966410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 0x564445966410 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c1160 tx=0x7fd9740d5f90 comp rx=0 tx=0).stop 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 -- 172.21.15.42:0/1994048056 shutdown_connections 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56444595adb0 0x564445972800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564445951fe0 0x564445966410 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 --2- 172.21.15.42:0/1994048056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x56444595a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 -- 172.21.15.42:0/1994048056 >> 172.21.15.42:0/1994048056 conn(0x56444594bfe0 msgr2=0x56444594c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 -- 172.21.15.42:0/1994048056 shutdown_connections 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 -- 172.21.15.42:0/1994048056 wait complete. 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 -- start start 2024-03-31T23:18:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.608+0000 7fd98e870740 1 Processor -- start 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x564445954b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 0x5644459550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445955610 0x5644459cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841beea0 con 0x56444595adb0 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841be7d0 con 0x564445955610 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841bb9f0 con 0x5644459516c0 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98e870740 10 client.0 _ll_register_callbacks cb 0x7fd98000f6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 0x5644459550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989a34640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x564445954b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 0x5644459550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:32960/0 (socket says 172.21.15.42:32960) 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 -- 172.21.15.42:0/2824046269 learned_addr learned my addr 172.21.15.42:0/2824046269 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989a34640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x564445954b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:44164/0 (socket says 172.21.15.42:44164) 2024-03-31T23:18:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd98a235640 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445955610 0x5644459cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 -- 172.21.15.42:0/2824046269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 msgr2=0x564445954b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x564445954b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 -- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445955610 msgr2=0x5644459cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445955610 0x5644459cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 -- 172.21.15.42:0/2824046269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644459d0520 con 0x56444595adb0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd989233640 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 0x5644459550d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd9740bb2a0 tx=0x7fd9740035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2168b78ebe33a042 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.609+0000 7fd96d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd96d7fa640 1 -- 172.21.15.42:0/2824046269 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97409f070 con 0x56444595adb0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd96d7fa640 1 -- 172.21.15.42:0/2824046269 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fd9740b96d0 con 0x56444595adb0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9740bcff0 con 0x56444595adb0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd96d7fa640 1 -- 172.21.15.42:0/2824046269 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9740ca050 con 0x56444595adb0 2024-03-31T23:18:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd98e870740 10 client.15993 fetch_fsmap learned FSMap version 29 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5644459d1810 con 0x56444595adb0 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.610+0000 7fd96d7fa640 1 -- 172.21.15.42:0/2824046269 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9740bcff0 con 0x56444595adb0 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd96d7fa640 1 -- 172.21.15.42:0/2824046269 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd9740a60d0 con 0x56444595adb0 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd98e870740 10 client.15993 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd98e870740 10 client.15993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd98e870740 20 client.15993 populate_metadata read hostname 'smithi042' 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd98e870740 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5644459d1b50 0x5644459d3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd98e870740 4 client.15993 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644458c1e30 con 0x5644459d1b50 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd989a34640 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5644459d1b50 0x5644459d3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd96d7fa640 10 client.15993 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.611+0000 7fd989a34640 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5644459d1b50 0x5644459d3f40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914409fd4ec9fc54 server_cookie=197a24115dc3bd58 in_seq=0 out_seq=0 2024-03-31T23:18:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd96d7fa640 1 -- 172.21.15.42:0/2824046269 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644458c1e30 con 0x5644459d1b50 2024-03-31T23:18:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd96d7fa640 10 client.15993 handle_command_reply: tid=0 2024-03-31T23:18:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 client.15993 shutdown 2024-03-31T23:18:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 msgr2=0x5644459550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 0x5644459550d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd9740bb2a0 tx=0x7fd9740035f0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 shutdown_connections 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5644459d1b50 0x5644459d3f40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564445955610 0x5644459cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56444595adb0 0x5644459550d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 --2- 172.21.15.42:0/2824046269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644459516c0 0x564445954b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 >> 172.21.15.42:0/2824046269 conn(0x56444594bfe0 msgr2=0x56444594d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd96d7fa640 0 client.15993 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 shutdown_connections 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.618+0000 7fd98e870740 1 -- 172.21.15.42:0/2824046269 wait complete. 2024-03-31T23:18:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98e870740 20 client.15993 trim_cache size 0 max 16384 2024-03-31T23:18:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:18:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:18:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:18:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fd9700a2750 msgr2=0x7fd9700a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fd9700a2750 0x7fd9700a4c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd980011490 tx=0x7fd980005f90 comp rx=0 tx=0).stop 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9841042c0 msgr2=0x7fd98410fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9841042c0 0x7fd98410fdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd97402c170 tx=0x7fd97402dc10 comp rx=0 tx=0).stop 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 shutdown_connections 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd984109910 0x7fd9841b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9841042c0 0x7fd98410fdf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fd9700a2750 0x7fd9700a4c10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 --2- 172.21.15.42:0/132276353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd984103900 0x7fd98410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 >> 172.21.15.42:0/132276353 conn(0x7fd9840ff3d0 msgr2=0x7fd984077b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 shutdown_connections 2024-03-31T23:18:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:18:51.619+0000 7fd98bc98640 1 -- 172.21.15.42:0/132276353 wait complete. 2024-03-31T23:18:51.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:51 smithi094 ceph-mon[36167]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:18:51.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:51 smithi188 ceph-mon[36068]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:18:52.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:51 smithi042 ceph-mon[32380]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:18:53.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:53 smithi094 ceph-mon[36167]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-31T23:18:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:53 smithi188 ceph-mon[36068]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-31T23:18:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:53 smithi042 ceph-mon[32380]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-31T23:18:55.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:55 smithi094 ceph-mon[36167]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-03-31T23:18:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:55 smithi188 ceph-mon[36068]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-03-31T23:18:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:55 smithi042 ceph-mon[32380]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-03-31T23:18:57.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:57 smithi094 ceph-mon[36167]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-03-31T23:18:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:57 smithi188 ceph-mon[36068]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-03-31T23:18:58.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:57 smithi042 ceph-mon[32380]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-03-31T23:18:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:18:59 smithi094 ceph-mon[36167]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-31T23:18:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:18:59 smithi188 ceph-mon[36068]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-31T23:19:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:18:59 smithi042 ceph-mon[32380]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-31T23:19:00.825 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:19:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:19:00.332+0000 7f1e4e20a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:19:00.826 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:19:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:19:00.333+0000 7f1e4e20a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:19:00.826 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:19:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:19:00.333+0000 7f1e4e20a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:19:00.826 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:19:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:19:00.333+0000 7f1e4e20a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:19:00.826 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:19:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:19:00.333+0000 7f1e4e20a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-31T23:19:01.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:01 smithi094 ceph-mon[36167]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-31T23:19:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:01 smithi188 ceph-mon[36068]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-31T23:19:02.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:01 smithi042 ceph-mon[32380]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-31T23:19:03.877 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:03 smithi042 ceph-mon[32380]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-03-31T23:19:03.877 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:03 smithi042 ceph-mon[32380]: mgrmap e24: x(active, since 52s), standbys: z, y 2024-03-31T23:19:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:03 smithi094 ceph-mon[36167]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-03-31T23:19:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:03 smithi094 ceph-mon[36167]: mgrmap e24: x(active, since 52s), standbys: z, y 2024-03-31T23:19:03.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:03 smithi188 ceph-mon[36068]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-03-31T23:19:03.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:03 smithi188 ceph-mon[36068]: mgrmap e24: x(active, since 52s), standbys: z, y 2024-03-31T23:19:04.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:19:04.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:19:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 -- 172.21.15.42:0/543724711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 msgr2=0x7ff0041003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 --2- 172.21.15.42:0/543724711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff0041003b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feff4009900 tx=0x7feff402bc50 comp rx=0 tx=0).stop 2024-03-31T23:19:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 -- 172.21.15.42:0/543724711 shutdown_connections 2024-03-31T23:19:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 --2- 172.21.15.42:0/543724711 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff00410cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 --2- 172.21.15.42:0/543724711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff004100980 0x7ff0041049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 --2- 172.21.15.42:0/543724711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff0041003b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.694+0000 7ff0096f4640 1 -- 172.21.15.42:0/543724711 >> 172.21.15.42:0/543724711 conn(0x7ff004076b70 msgr2=0x7ff0040fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.695+0000 7ff0096f4640 1 -- 172.21.15.42:0/543724711 shutdown_connections 2024-03-31T23:19:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.695+0000 7ff0096f4640 1 -- 172.21.15.42:0/543724711 wait complete. 2024-03-31T23:19:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.696+0000 7ff0096f4640 1 Processor -- start 2024-03-31T23:19:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.696+0000 7ff0096f4640 1 -- start start 2024-03-31T23:19:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0096f4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff004195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0096f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff0041963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0096f4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00419a750 0x7ff00419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff004195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0027fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff0041963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff004195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58250/0 (socket says 172.21.15.42:58250) 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0027fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff0041963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:32994/0 (socket says 172.21.15.42:32994) 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff002ffd640 1 -- 172.21.15.42:0/4047751606 learned_addr learned my addr 172.21.15.42:0/4047751606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff00410fa30 con 0x7ff00419a750 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff00410f8b0 con 0x7ff0041050a0 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff00410fbb0 con 0x7ff0040fffd0 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.697+0000 7ff0037fe640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00419a750 0x7ff00419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0027fc640 1 -- 172.21.15.42:0/4047751606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 msgr2=0x7ff004195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0027fc640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff004195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0027fc640 1 -- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00419a750 msgr2=0x7ff00419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0027fc640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00419a750 0x7ff00419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0027fc640 1 -- 172.21.15.42:0/4047751606 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00419b240 con 0x7ff0041050a0 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff002ffd640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff004195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0037fe640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00419a750 0x7ff00419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7ff0027fc640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff0041963d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feff800e9c0 tx=0x7feff800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.698+0000 7fefebfff640 1 -- 172.21.15.42:0/4047751606 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff800ccc0 con 0x7ff0041050a0 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.699+0000 7fefebfff640 1 -- 172.21.15.42:0/4047751606 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feff8010930 con 0x7ff0041050a0 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.699+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00419b530 con 0x7ff0041050a0 2024-03-31T23:19:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.699+0000 7fefebfff640 1 -- 172.21.15.42:0/4047751606 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff80189c0 con 0x7ff0041050a0 2024-03-31T23:19:04.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.699+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0041a2cb0 con 0x7ff0041050a0 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.702+0000 7fefebfff640 1 -- 172.21.15.42:0/4047751606 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7feff8010ae0 con 0x7ff0041050a0 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.702+0000 7ff00c3a8740 1 Processor -- start 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.702+0000 7ff00c3a8740 1 -- start start 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.702+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0e0a0 0x55ea79f0e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f22390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ea79e72180 con 0x55ea79f0e0a0 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55ea79e1ab70 con 0x55ea79f1ffa0 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58264/0 (socket says 172.21.15.42:58264) 2024-03-31T23:19:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 -- 172.21.15.42:0/2781419964 learned_addr learned my addr 172.21.15.42:0/2781419964 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff0027fc640 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f22390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff0037fe640 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0e0a0 0x55ea79f0e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff00c3a8740 1 -- 172.21.15.42:0/2781419964 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ea79e6e220 con 0x55ea79f0ea50 2024-03-31T23:19:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7fefebfff640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fefec0a2890 0x7fefec0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 -- 172.21.15.42:0/2781419964 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 msgr2=0x55ea79f22390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f22390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 -- 172.21.15.42:0/2781419964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0e0a0 msgr2=0x55ea79f0e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7fefebfff640 1 -- 172.21.15.42:0/4047751606 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7feff80cf3d0 con 0x7ff0041050a0 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0e0a0 0x55ea79f0e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.703+0000 7ff002ffd640 1 -- 172.21.15.42:0/2781419964 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea79e2e7c0 con 0x55ea79f0ea50 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.704+0000 7ff0037fe640 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0e0a0 0x55ea79f0e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.704+0000 7ff002ffd640 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feff4004a70 tx=0x7feff4004aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36bcfc0b079b37a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.704+0000 7ff0037fe640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fefec0a2890 0x7fefec0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.704+0000 7fefe97fa640 1 -- 172.21.15.42:0/2781419964 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4043020 con 0x55ea79f0ea50 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.704+0000 7fefe97fa640 1 -- 172.21.15.42:0/2781419964 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feff402caf0 con 0x55ea79f0ea50 2024-03-31T23:19:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.704+0000 7fefe97fa640 1 -- 172.21.15.42:0/2781419964 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff40055a0 con 0x55ea79f0ea50 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 -- 172.21.15.42:0/2781419964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 msgr2=0x55ea79f1fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff0037fe640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fefec0a2890 0x7fefec0a4d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feffc00a380 tx=0x7feffc004ab0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feff4004a70 tx=0x7feff4004aa0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 -- 172.21.15.42:0/2781419964 shutdown_connections 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f22390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/2781419964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0e0a0 0x55ea79f0e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.705+0000 7ff00c3a8740 1 -- 172.21.15.42:0/2781419964 >> 172.21.15.42:0/2781419964 conn(0x55ea79f089c0 msgr2=0x55ea79f08da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 -- 172.21.15.42:0/2781419964 shutdown_connections 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 -- 172.21.15.42:0/2781419964 wait complete. 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 -- start start 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 Processor -- start 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f19ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f1ffa0 0x55ea79f150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ea79f0f590 con 0x55ea79f1ffa0 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55ea79e104a0 con 0x55ea79f0ea50 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ea79f0f710 con 0x55ea79f0e0a0 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.706+0000 7ff00c3a8740 10 client.0 _ll_register_callbacks cb 0x55ea79e13d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f19ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f19ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58278/0 (socket says 172.21.15.42:58278) 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff002ffd640 1 -- 172.21.15.42:0/1698878092 learned_addr learned my addr 172.21.15.42:0/1698878092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0027fc640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0037fe640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f1ffa0 0x55ea79f150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0027fc640 1 -- 172.21.15.42:0/1698878092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 msgr2=0x55ea79f19ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0027fc640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f19ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0027fc640 1 -- 172.21.15.42:0/1698878092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f1ffa0 msgr2=0x55ea79f150e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0027fc640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f1ffa0 0x55ea79f150e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0027fc640 1 -- 172.21.15.42:0/1698878092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea79c507d0 con 0x55ea79f0ea50 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.707+0000 7ff0037fe640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f1ffa0 0x55ea79f150e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7ff0027fc640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feff80cc5f0 tx=0x7feff8009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893336a3ddc60faf server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7fefe6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7fefe6ff5640 1 -- 172.21.15.42:0/1698878092 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff809af60 con 0x55ea79f0ea50 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7fefe6ff5640 1 -- 172.21.15.42:0/1698878092 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7feff80cf130 con 0x55ea79f0ea50 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feff402caf0 con 0x55ea79f0ea50 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7fefe6ff5640 1 -- 172.21.15.42:0/1698878092 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feff800ce60 con 0x55ea79f0ea50 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7ff00c3a8740 10 client.25838 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.708+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ea79b863f0 con 0x55ea79f0ea50 2024-03-31T23:19:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7fefe6ff5640 1 -- 172.21.15.42:0/1698878092 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feff402caf0 con 0x55ea79f0ea50 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7fefe6ff5640 1 -- 172.21.15.42:0/1698878092 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7feff8018b60 con 0x55ea79f0ea50 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff00c3a8740 10 client.25838 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff00c3a8740 10 client.25838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff00c3a8740 20 client.25838 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f38c50 0x55ea79f3b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff00c3a8740 4 client.25838 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea79e7f6c0 con 0x55ea79f38c50 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.709+0000 7ff002ffd640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f38c50 0x55ea79f3b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.710+0000 7fefe6ff5640 10 client.25838 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.710+0000 7ff002ffd640 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f38c50 0x55ea79f3b090 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f68b66e699f78128 server_cookie=a5806c8d0eae3eb6 in_seq=0 out_seq=0 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7fefe6ff5640 1 -- 172.21.15.42:0/1698878092 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ea79e7f6c0 con 0x55ea79f38c50 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7fefe6ff5640 10 client.25838 handle_command_reply: tid=0 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 client.25838 shutdown 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0ea50 msgr2=0x55ea79f1fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feff80cc5f0 tx=0x7feff8009700 comp rx=0 tx=0).stop 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 shutdown_connections 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f38c50 0x55ea79f3b090 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f1ffa0 0x55ea79f150e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0ea50 0x55ea79f1fa00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/1698878092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f19ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 >> 172.21.15.42:0/1698878092 conn(0x55ea79f089c0 msgr2=0x55ea79f0a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7fefe6ff5640 0 client.25838 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 shutdown_connections 2024-03-31T23:19:04.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 1 -- 172.21.15.42:0/1698878092 wait complete. 2024-03-31T23:19:04.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.711+0000 7ff00c3a8740 20 client.25838 trim_cache size 0 max 16384 2024-03-31T23:19:04.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.746+0000 7ff00c3a8740 1 Processor -- start 2024-03-31T23:19:04.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.746+0000 7ff00c3a8740 1 -- start start 2024-03-31T23:19:04.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.746+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.746+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f40960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f07aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58294/0 (socket says 172.21.15.42:58294) 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff0027fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f40960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff0027fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f40960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54286/0 (socket says 172.21.15.42:54286) 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff002ffd640 1 -- 172.21.15.42:0/3215360246 learned_addr learned my addr 172.21.15.42:0/3215360246 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f4bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041aca20 con 0x55ea79f0ea50 2024-03-31T23:19:04.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041ae560 con 0x55ea79f1ffa0 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041ad0f0 con 0x55ea79f0e0a0 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff0037fe640 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f4bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff0027fc640 1 -- 172.21.15.42:0/3215360246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 msgr2=0x55ea79f07aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.747+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f07aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7ff0027fc640 1 -- 172.21.15.42:0/3215360246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 msgr2=0x55ea79f4bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f4bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7ff0027fc640 1 -- 172.21.15.42:0/3215360246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea79f0e7f0 con 0x55ea79f0ea50 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f40960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7feff8097f80 tx=0x7feff8097210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714d7968e5878fd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7fefe8ff9640 1 -- 172.21.15.42:0/3215360246 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff80bb0b0 con 0x55ea79f0ea50 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7fefe8ff9640 1 -- 172.21.15.42:0/3215360246 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feff809b600 con 0x55ea79f0ea50 2024-03-31T23:19:04.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.748+0000 7fefe8ff9640 1 -- 172.21.15.42:0/3215360246 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff80cf1c0 con 0x55ea79f0ea50 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.749+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 msgr2=0x55ea79f40960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.749+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f40960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7feff8097f80 tx=0x7feff8097210 comp rx=0 tx=0).stop 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 shutdown_connections 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f1ffa0 0x55ea79f4bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f40960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3215360246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f0e0a0 0x55ea79f07aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 >> 172.21.15.42:0/3215360246 conn(0x55ea79f089c0 msgr2=0x55ea79f07390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 shutdown_connections 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3215360246 wait complete. 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 -- start start 2024-03-31T23:19:04.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.750+0000 7ff00c3a8740 1 Processor -- start 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 0x55ea79f47a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f47f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f1ffa0 0x55ea79f9d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041ade90 con 0x55ea79f0ea50 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041ad7c0 con 0x55ea79f0e0a0 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041aa9e0 con 0x55ea79f1ffa0 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff00c3a8740 10 client.0 _ll_register_callbacks cb 0x7feff80cc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 0x55ea79f47a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 0x55ea79f47a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33050/0 (socket says 172.21.15.42:33050) 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff002ffd640 1 -- 172.21.15.42:0/3499346107 learned_addr learned my addr 172.21.15.42:0/3499346107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f47f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff0037fe640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f1ffa0 0x55ea79f9d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff002ffd640 1 -- 172.21.15.42:0/3499346107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f1ffa0 msgr2=0x55ea79f9d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff002ffd640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f1ffa0 0x55ea79f9d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.751+0000 7ff002ffd640 1 -- 172.21.15.42:0/3499346107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 msgr2=0x55ea79f47f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff002ffd640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f47f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff002ffd640 1 -- 172.21.15.42:0/3499346107 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea79b460f0 con 0x55ea79f0e0a0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f47f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff002ffd640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 0x55ea79f47a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feff4005c40 tx=0x7feff4005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab61f62cab6d3cc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7fefe6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7fefe6ff5640 1 -- 172.21.15.42:0/3499346107 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4043040 con 0x55ea79f0e0a0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7fefe6ff5640 1 -- 172.21.15.42:0/3499346107 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7feff4039040 con 0x55ea79f0e0a0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feff809b600 con 0x55ea79f0e0a0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7fefe6ff5640 1 -- 172.21.15.42:0/3499346107 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feff405d050 con 0x55ea79f0e0a0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff00c3a8740 10 client.25844 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ea79f9ee50 con 0x55ea79f0e0a0 2024-03-31T23:19:04.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.752+0000 7fefe6ff5640 1 -- 172.21.15.42:0/3499346107 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feff809b600 con 0x55ea79f0e0a0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7fefe6ff5640 1 -- 172.21.15.42:0/3499346107 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7feff402cbd0 con 0x55ea79f0e0a0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff00c3a8740 10 client.25844 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff00c3a8740 10 client.25844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff00c3a8740 20 client.25844 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f9f1f0 0x55ea79fa1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff00c3a8740 4 client.25844 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ea79e79a10 con 0x55ea79f9f1f0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f9f1f0 0x55ea79fa1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7ff0027fc640 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f9f1f0 0x55ea79fa1600 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3142bab963026f4 server_cookie=4b82416c7b22c2ea in_seq=0 out_seq=0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.753+0000 7fefe6ff5640 10 client.25844 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7fefe6ff5640 1 -- 172.21.15.42:0/3499346107 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ea79e79a10 con 0x55ea79f9f1f0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7fefe6ff5640 10 client.25844 handle_command_reply: tid=0 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 client.25844 shutdown 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 msgr2=0x55ea79f47a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 0x55ea79f47a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feff4005c40 tx=0x7feff4005fd0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 shutdown_connections 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55ea79f9f1f0 0x55ea79fa1600 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7fefe6ff5640 0 client.25844 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea79f1ffa0 0x55ea79f9d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea79f0ea50 0x55ea79f47f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 --2- 172.21.15.42:0/3499346107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ea79f0e0a0 0x55ea79f47a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 >> 172.21.15.42:0/3499346107 conn(0x55ea79f089c0 msgr2=0x55ea79f07c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 shutdown_connections 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 1 -- 172.21.15.42:0/3499346107 wait complete. 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.754+0000 7ff00c3a8740 20 client.25844 trim_cache size 0 max 16384 2024-03-31T23:19:04.760 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:19:04.761 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-03-31T23:19:04.761 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-03-31T23:19:04.761 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:19:04.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fefec0a2890 msgr2=0x7fefec0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fefec0a2890 0x7fefec0a4d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feffc00a380 tx=0x7feffc004ab0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 msgr2=0x7ff0041963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff0041963d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feff800e9c0 tx=0x7feff800ee80 comp rx=0 tx=0).stop 2024-03-31T23:19:04.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 shutdown_connections 2024-03-31T23:19:04.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fefec0a2890 0x7fefec0a4d50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00419a750 0x7ff00419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0041050a0 0x7ff0041963d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 --2- 172.21.15.42:0/4047751606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0040fffd0 0x7ff004195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 >> 172.21.15.42:0/4047751606 conn(0x7ff004076b70 msgr2=0x7ff0041031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 shutdown_connections 2024-03-31T23:19:04.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.755+0000 7ff0096f4640 1 -- 172.21.15.42:0/4047751606 wait complete. 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 -- 172.21.15.42:0/1212725532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 msgr2=0x7fc274108390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 --2- 172.21.15.42:0/1212725532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc274108390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009900 tx=0x7fc25c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 -- 172.21.15.42:0/1212725532 shutdown_connections 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 --2- 172.21.15.42:0/1212725532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc27410d080 0x7fc274114c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 --2- 172.21.15.42:0/1212725532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc274108960 0x7fc27410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 --2- 172.21.15.42:0/1212725532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc274108390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 -- 172.21.15.42:0/1212725532 >> 172.21.15.42:0/1212725532 conn(0x7fc274075cc0 msgr2=0x7fc2740780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 -- 172.21.15.42:0/1212725532 shutdown_connections 2024-03-31T23:19:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.760+0000 7fc279e6d640 1 -- 172.21.15.42:0/1212725532 wait complete. 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 Processor -- start 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 -- start start 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc27419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc27410d080 0x7fc27419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2741a2f70 0x7fc2741a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc274118200 con 0x7fc2741a2f70 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc274118080 con 0x7fc274107fb0 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.761+0000 7fc279e6d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc274118380 con 0x7fc27410d080 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc27419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc27419e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33076/0 (socket says 172.21.15.42:33076) 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 -- 172.21.15.42:0/2210500560 learned_addr learned my addr 172.21.15.42:0/2210500560 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc272ffd640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc27410d080 0x7fc27419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc273fff640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2741a2f70 0x7fc2741a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 -- 172.21.15.42:0/2210500560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc27410d080 msgr2=0x7fc27419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc27410d080 0x7fc27419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 -- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2741a2f70 msgr2=0x7fc2741a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2741a2f70 0x7fc2741a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 -- 172.21.15.42:0/2210500560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741a3a60 con 0x7fc274107fb0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc2737fe640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc27419e700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc25c005ab0 tx=0x7fc25c02dd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc270ff9640 1 -- 172.21.15.42:0/2210500560 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c043020 con 0x7fc274107fb0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.762+0000 7fc270ff9640 1 -- 172.21.15.42:0/2210500560 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc25c004250 con 0x7fc274107fb0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.763+0000 7fc270ff9640 1 -- 172.21.15.42:0/2210500560 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0039b0 con 0x7fc274107fb0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.763+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2741a3cf0 con 0x7fc274107fb0 2024-03-31T23:19:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.763+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741ab4c0 con 0x7fc274107fb0 2024-03-31T23:19:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.766+0000 7fc270ff9640 1 -- 172.21.15.42:0/2210500560 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7fc25c046020 con 0x7fc274107fb0 2024-03-31T23:19:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.766+0000 7fc27ca45740 1 Processor -- start 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.766+0000 7fc27ca45740 1 -- start start 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.766+0000 7fc270ff9640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2600a27d0 0x7fc2600a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6b6c0 0x5614a0d6baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 0x5614a0d74870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc270ff9640 1 -- 172.21.15.42:0/2210500560 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc25c0f1170 con 0x7fc274107fb0 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc27ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5614a0cce8f0 con 0x5614a0d6b6c0 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc27ca45740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5614a0c778d0 con 0x5614a0d74db0 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc27ca45740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5614a0cca990 con 0x5614a0d6bfe0 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc273fff640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2600a27d0 0x7fc2600a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 0x5614a0d74870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 0x5614a0d74870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58334/0 (socket says 172.21.15.42:58334) 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 -- 172.21.15.42:0/303896796 learned_addr learned my addr 172.21.15.42:0/303896796 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 -- 172.21.15.42:0/303896796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 msgr2=0x5614a0d771a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d771a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 -- 172.21.15.42:0/303896796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6b6c0 msgr2=0x5614a0d6baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc2737fe640 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6b6c0 0x5614a0d6baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6b6c0 0x5614a0d6baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.767+0000 7fc272ffd640 1 -- 172.21.15.42:0/303896796 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a09e3210 con 0x5614a0d6bfe0 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.768+0000 7fc273fff640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2600a27d0 0x7fc2600a4c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005fd0 tx=0x7fc26c009500 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.768+0000 7fc2737fe640 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6b6c0 0x5614a0d6baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.768+0000 7fc272ffd640 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 0x5614a0d74870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc26400bc40 tx=0x7fc26400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4571070ce97abe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.768+0000 7fc269ffb640 1 -- 172.21.15.42:0/303896796 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264015070 con 0x5614a0d6bfe0 2024-03-31T23:19:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.768+0000 7fc269ffb640 1 -- 172.21.15.42:0/303896796 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc26401a960 con 0x5614a0d6bfe0 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc269ffb640 1 -- 172.21.15.42:0/303896796 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264011aa0 con 0x5614a0d6bfe0 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 -- 172.21.15.42:0/303896796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 msgr2=0x5614a0d74870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 0x5614a0d74870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc26400bc40 tx=0x7fc26400f730 comp rx=0 tx=0).stop 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 -- 172.21.15.42:0/303896796 shutdown_connections 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6bfe0 0x5614a0d74870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 --2- 172.21.15.42:0/303896796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6b6c0 0x5614a0d6baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 -- 172.21.15.42:0/303896796 >> 172.21.15.42:0/303896796 conn(0x5614a0d65fe0 msgr2=0x5614a0d663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 -- 172.21.15.42:0/303896796 shutdown_connections 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 -- 172.21.15.42:0/303896796 wait complete. 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.769+0000 7fc27ca45740 1 -- start start 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 Processor -- start 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d71d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d6bfe0 0x5614a0d72290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5614a0d77a30 con 0x5614a0d74db0 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5614a0c6cf80 con 0x5614a0d6bfe0 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5614a0d77bb0 con 0x5614a0d6b6c0 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc27ca45740 10 client.0 _ll_register_callbacks cb 0x5614a0cc5290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d71d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d71d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58336/0 (socket says 172.21.15.42:58336) 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc2737fe640 1 -- 172.21.15.42:0/572790020 learned_addr learned my addr 172.21.15.42:0/572790020 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc272ffd640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d6bfe0 0x5614a0d72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.770+0000 7fc273fff640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc2737fe640 1 -- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d6bfe0 msgr2=0x5614a0d72290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc2737fe640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d6bfe0 0x5614a0d72290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc2737fe640 1 -- 172.21.15.42:0/572790020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 msgr2=0x5614a0d727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc2737fe640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.776 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-31T23:19:04.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc2737fe640 1 -- 172.21.15.42:0/572790020 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a0aaf620 con 0x5614a0d6b6c0 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc272ffd640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d6bfe0 0x5614a0d72290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc2737fe640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d71d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0b98a0 tx=0x7fc25c03c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d837e1fd18d352d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc252ffd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc252ffd640 1 -- 172.21.15.42:0/572790020 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0dd2b0 con 0x5614a0d6b6c0 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc26401a960 con 0x5614a0d6b6c0 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc252ffd640 1 -- 172.21.15.42:0/572790020 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc25c0c1120 con 0x5614a0d6b6c0 2024-03-31T23:19:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.771+0000 7fc252ffd640 1 -- 172.21.15.42:0/572790020 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc25c0c1590 con 0x5614a0d6b6c0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.772+0000 7fc27ca45740 10 client.25813 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.772+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5614a0d77a80 con 0x5614a0d6b6c0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.772+0000 7fc252ffd640 1 -- 172.21.15.42:0/572790020 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc26401a960 con 0x5614a0d6b6c0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.772+0000 7fc252ffd640 1 -- 172.21.15.42:0/572790020 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc25c0ee6b0 con 0x5614a0d6b6c0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc27ca45740 10 client.25813 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc27ca45740 10 client.25813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc27ca45740 20 client.25813 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc27ca45740 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0d84ce0 0x5614a0d870d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc27ca45740 4 client.25813 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614a0ce2120 con 0x5614a0d84ce0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc272ffd640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0d84ce0 0x5614a0d870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc272ffd640 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0d84ce0 0x5614a0d870d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555bc839a3feab46 server_cookie=fd4c3e763c0487b6 in_seq=0 out_seq=0 2024-03-31T23:19:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.773+0000 7fc252ffd640 10 client.25813 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc252ffd640 1 -- 172.21.15.42:0/572790020 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5614a0ce2120 con 0x5614a0d84ce0 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc252ffd640 10 client.25813 handle_command_reply: tid=0 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 client.25813 shutdown 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 msgr2=0x5614a0d71d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d71d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0b98a0 tx=0x7fc25c03c350 comp rx=0 tx=0).stop 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 shutdown_connections 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0d84ce0 0x5614a0d870d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d6bfe0 0x5614a0d72290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 --2- 172.21.15.42:0/572790020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d71d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 >> 172.21.15.42:0/572790020 conn(0x5614a0d65fe0 msgr2=0x5614a0d67d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc252ffd640 0 client.25813 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 shutdown_connections 2024-03-31T23:19:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 1 -- 172.21.15.42:0/572790020 wait complete. 2024-03-31T23:19:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.774+0000 7fc27ca45740 20 client.25813 trim_cache size 0 max 16384 2024-03-31T23:19:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 Processor -- start 2024-03-31T23:19:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 -- start start 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d74480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 0x5614a0d80820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b51a0 con 0x5614a0d6bfe0 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b6ce0 con 0x5614a0d74db0 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.791+0000 7fc27ca45740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b5870 con 0x5614a0d6b6c0 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d74480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 0x5614a0d80820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 0x5614a0d80820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54334/0 (socket says 172.21.15.42:54334) 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 -- 172.21.15.42:0/2792890493 learned_addr learned my addr 172.21.15.42:0/2792890493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc273fff640 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 -- 172.21.15.42:0/2792890493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 msgr2=0x5614a0d74480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d74480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 -- 172.21.15.42:0/2792890493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 msgr2=0x5614a0d725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 -- 172.21.15.42:0/2792890493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a0d72b30 con 0x5614a0d6bfe0 2024-03-31T23:19:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc272ffd640 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 0x5614a0d80820 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x5614a0d6b170 tx=0x7fc26400ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4cbf7b082becef server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.792+0000 7fc2697fa640 1 -- 172.21.15.42:0/2792890493 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264015040 con 0x5614a0d6bfe0 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc2697fa640 1 -- 172.21.15.42:0/2792890493 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc26402e070 con 0x5614a0d6bfe0 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc2697fa640 1 -- 172.21.15.42:0/2792890493 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264028410 con 0x5614a0d6bfe0 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 -- 172.21.15.42:0/2792890493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 msgr2=0x5614a0d80820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 0x5614a0d80820 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x5614a0d6b170 tx=0x7fc26400ffa0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 -- 172.21.15.42:0/2792890493 shutdown_connections 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d74db0 0x5614a0d725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d6bfe0 0x5614a0d80820 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2792890493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d74480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 -- 172.21.15.42:0/2792890493 >> 172.21.15.42:0/2792890493 conn(0x5614a0d65fe0 msgr2=0x5614a0d663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.793+0000 7fc27ca45740 1 -- 172.21.15.42:0/2792890493 shutdown_connections 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.794+0000 7fc27ca45740 1 -- 172.21.15.42:0/2792890493 wait complete. 2024-03-31T23:19:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.794+0000 7fc27ca45740 1 -- start start 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.794+0000 7fc27ca45740 1 Processor -- start 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.794+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d7ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.794+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc27ca45740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d7d390 0x5614a0d6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc27ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b6610 con 0x5614a0d74db0 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d7ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc27ca45740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b5f40 con 0x5614a0d7d390 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc27ca45740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b3160 con 0x5614a0d6b6c0 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc272ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc272ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d6e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54344/0 (socket says 172.21.15.42:54344) 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc272ffd640 1 -- 172.21.15.42:0/2807833901 learned_addr learned my addr 172.21.15.42:0/2807833901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d7ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58340/0 (socket says 172.21.15.42:58340) 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d7d390 0x5614a0d6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc27ca45740 10 client.0 _ll_register_callbacks cb 0x7fc25c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 -- 172.21.15.42:0/2807833901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 msgr2=0x5614a0d7ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d7ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 -- 172.21.15.42:0/2807833901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 msgr2=0x5614a0d6e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d6e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 -- 172.21.15.42:0/2807833901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a0d6ee90 con 0x5614a0d7d390 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc272ffd640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d6e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc2737fe640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d7ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc273fff640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d7d390 0x5614a0d6e660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097f0 tx=0x7fc26c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d625c6ed3d12dc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.795+0000 7fc252ffd640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc252ffd640 1 -- 172.21.15.42:0/2807833901 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c01fa90 con 0x5614a0d7d390 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc252ffd640 1 -- 172.21.15.42:0/2807833901 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc26c01fc30 con 0x5614a0d7d390 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc26402e070 con 0x5614a0d7d390 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc252ffd640 1 -- 172.21.15.42:0/2807833901 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc26c01fe30 con 0x5614a0d7d390 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc27ca45740 10 client.25859 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5614a0dfbfa0 con 0x5614a0d7d390 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc252ffd640 1 -- 172.21.15.42:0/2807833901 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc26402e070 con 0x5614a0d7d390 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc252ffd640 1 -- 172.21.15.42:0/2807833901 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc26c0294b0 con 0x5614a0d7d390 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc27ca45740 10 client.25859 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc27ca45740 10 client.25859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.796+0000 7fc27ca45740 20 client.25859 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.797+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0dfc720 0x5614a0dfeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.797+0000 7fc27ca45740 4 client.25859 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.797+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614a0cdbe30 con 0x5614a0dfc720 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.797+0000 7fc2737fe640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0dfc720 0x5614a0dfeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.797+0000 7fc252ffd640 10 client.25859 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.797+0000 7fc2737fe640 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0dfc720 0x5614a0dfeb40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f392bb55fe4af4d7 server_cookie=59a4ef04cffe08ff in_seq=0 out_seq=0 2024-03-31T23:19:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc252ffd640 1 -- 172.21.15.42:0/2807833901 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614a0cdbe30 con 0x5614a0dfc720 2024-03-31T23:19:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc252ffd640 10 client.25859 handle_command_reply: tid=0 2024-03-31T23:19:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 client.25859 shutdown 2024-03-31T23:19:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d7d390 msgr2=0x5614a0d6e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d7d390 0x5614a0d6e660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097f0 tx=0x7fc26c004ab0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 shutdown_connections 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5614a0dfc720 0x5614a0dfeb40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5614a0d7d390 0x5614a0d6e660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc252ffd640 0 client.25859 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5614a0d74db0 0x5614a0d6e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 --2- 172.21.15.42:0/2807833901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614a0d6b6c0 0x5614a0d7ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.802+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 >> 172.21.15.42:0/2807833901 conn(0x5614a0d65fe0 msgr2=0x5614a0d6d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.803+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 shutdown_connections 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.803+0000 7fc27ca45740 1 -- 172.21.15.42:0/2807833901 wait complete. 2024-03-31T23:19:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.803+0000 7fc27ca45740 20 client.25859 trim_cache size 0 max 16384 2024-03-31T23:19:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:19:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:19:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:19:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:19:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.803+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2600a27d0 msgr2=0x7fc2600a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.803+0000 7fc279e6d640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2600a27d0 0x7fc2600a4c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005fd0 tx=0x7fc26c009500 comp rx=0 tx=0).stop 2024-03-31T23:19:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 msgr2=0x7fc27419e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc27419e700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc25c005ab0 tx=0x7fc25c02dd00 comp rx=0 tx=0).stop 2024-03-31T23:19:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 shutdown_connections 2024-03-31T23:19:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2600a27d0 0x7fc2600a4c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2741a2f70 0x7fc2741a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc27410d080 0x7fc27419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 --2- 172.21.15.42:0/2210500560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc274107fb0 0x7fc27419e700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 >> 172.21.15.42:0/2210500560 conn(0x7fc274075cc0 msgr2=0x7fc274078030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 shutdown_connections 2024-03-31T23:19:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:04.804+0000 7fc279e6d640 1 -- 172.21.15.42:0/2210500560 wait complete. 2024-03-31T23:19:04.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 -- 172.21.15.42:0/1805810466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530100350 msgr2=0x7f7530100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 --2- 172.21.15.42:0/1805810466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530100350 0x7f7530100730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f752c009860 tx=0x7f752c02bb70 comp rx=0 tx=0).stop 2024-03-31T23:19:04.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 -- 172.21.15.42:0/1805810466 shutdown_connections 2024-03-31T23:19:04.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 --2- 172.21.15.42:0/1805810466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7530106b10 0x7f753010e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 --2- 172.21.15.42:0/1805810466 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100d00 0x7f7530106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 --2- 172.21.15.42:0/1805810466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530100350 0x7f7530100730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 -- 172.21.15.42:0/1805810466 >> 172.21.15.42:0/1805810466 conn(0x7f7530075960 msgr2=0x7f7530075d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:04.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 -- 172.21.15.42:0/1805810466 shutdown_connections 2024-03-31T23:19:04.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.930+0000 7f7537aeb640 1 -- 172.21.15.42:0/1805810466 wait complete. 2024-03-31T23:19:04.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.931+0000 7f7537aeb640 1 Processor -- start 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.931+0000 7f7537aeb640 1 -- start start 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.931+0000 7f7537aeb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100350 0x7f75301981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.931+0000 7f7537aeb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 0x7f7530198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.931+0000 7f7537aeb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f753019caa0 0x7f753019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7537aeb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7530111d40 con 0x7f753019caa0 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7537aeb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7530111bc0 con 0x7f7530100350 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7537aeb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7530111ec0 con 0x7f7530106b10 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 0x7f7530198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 0x7f7530198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58364/0 (socket says 172.21.15.42:58364) 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 -- 172.21.15.42:0/873206775 learned_addr learned my addr 172.21.15.42:0/873206775 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535887640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100350 0x7f75301981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7536088640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f753019caa0 0x7f753019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 -- 172.21.15.42:0/873206775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100350 msgr2=0x7f75301981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100350 0x7f75301981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 -- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f753019caa0 msgr2=0x7f753019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f753019caa0 0x7f753019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 -- 172.21.15.42:0/873206775 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753019d590 con 0x7f7530106b10 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535887640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100350 0x7f75301981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7535086640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 0x7f7530198720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f752000e9f0 tx=0x7f752000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.932+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752000ccc0 con 0x7f7530106b10 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.933+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7520005520 con 0x7f7530106b10 2024-03-31T23:19:04.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.933+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520010690 con 0x7f7530106b10 2024-03-31T23:19:04.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.934+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753019d880 con 0x7f7530106b10 2024-03-31T23:19:04.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.934+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7530101430 con 0x7f7530106b10 2024-03-31T23:19:04.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.935+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7530069880 con 0x7f7530106b10 2024-03-31T23:19:04.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.936+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f7520004f70 con 0x7f7530106b10 2024-03-31T23:19:04.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.937+0000 7f7526ffd640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f751c0a27b0 0x7f751c0a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:04.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.937+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f75200cf4c0 con 0x7f7530106b10 2024-03-31T23:19:04.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.938+0000 7f7535887640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f751c0a27b0 0x7f751c0a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:04.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.938+0000 7f7535887640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f751c0a27b0 0x7f751c0a4c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f752c02c180 tx=0x7f752c02e040 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:04.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:04.942+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f752009bd80 con 0x7f7530106b10 2024-03-31T23:19:05.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.392+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7530199560 con 0x7f7530106b10 2024-03-31T23:19:05.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.393+0000 7f7526ffd640 1 -- 172.21.15.42:0/873206775 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11923 (secure 0 0 0) 0x7f7530199560 con 0x7f7530106b10 2024-03-31T23:19:05.394 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:19:05.394 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:17:54.070406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:19:05.395 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-03-31T23:19:05.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f751c0a27b0 msgr2=0x7f751c0a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f751c0a27b0 0x7f751c0a4c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f752c02c180 tx=0x7f752c02e040 comp rx=0 tx=0).stop 2024-03-31T23:19:05.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 msgr2=0x7f7530198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 0x7f7530198720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f752000e9f0 tx=0x7f752000eeb0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 shutdown_connections 2024-03-31T23:19:05.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f751c0a27b0 0x7f751c0a4c70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f753019caa0 0x7f753019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7530106b10 0x7f7530198720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 --2- 172.21.15.42:0/873206775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7530100350 0x7f75301981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 >> 172.21.15.42:0/873206775 conn(0x7f7530075960 msgr2=0x7f75300fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 shutdown_connections 2024-03-31T23:19:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.396+0000 7f7537aeb640 1 -- 172.21.15.42:0/873206775 wait complete. 2024-03-31T23:19:05.413 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 -- 172.21.15.42:0/1165023818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc106660 msgr2=0x7fc2cc106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 --2- 172.21.15.42:0/1165023818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc106660 0x7fc2cc106a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009900 tx=0x7fc2bc02bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 -- 172.21.15.42:0/1165023818 shutdown_connections 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 --2- 172.21.15.42:0/1165023818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2cc100f80 0x7fc2cc10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 --2- 172.21.15.42:0/1165023818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 --2- 172.21.15.42:0/1165023818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc106660 0x7fc2cc106a40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 -- 172.21.15.42:0/1165023818 >> 172.21.15.42:0/1165023818 conn(0x7fc2cc077750 msgr2=0x7fc2cc077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 -- 172.21.15.42:0/1165023818 shutdown_connections 2024-03-31T23:19:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.568+0000 7fc2d249d640 1 -- 172.21.15.42:0/1165023818 wait complete. 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 Processor -- start 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 -- start start 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2cc100f80 0x7fc2cc197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2cc106660 0x7fc2cc197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc110b00 con 0x7fc2cc100f80 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc110980 con 0x7fc2cc1005c0 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2d249d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc110c80 con 0x7fc2cc106660 2024-03-31T23:19:05.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2cb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2cc100f80 0x7fc2cc197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33140/0 (socket says 172.21.15.42:33140) 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.569+0000 7fc2cbfff640 1 -- 172.21.15.42:0/938313159 learned_addr learned my addr 172.21.15.42:0/938313159 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2cc106660 0x7fc2cc197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2cbfff640 1 -- 172.21.15.42:0/938313159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2cc106660 msgr2=0x7fc2cc197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2cc106660 0x7fc2cc197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2cbfff640 1 -- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2cc100f80 msgr2=0x7fc2cc197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2cc100f80 0x7fc2cc197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2cbfff640 1 -- 172.21.15.42:0/938313159 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc1a64b0 con 0x7fc2cc1005c0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc196cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc036040 tx=0x7fc2bc02dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2c97fa640 1 -- 172.21.15.42:0/938313159 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc043020 con 0x7fc2cc1005c0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2c97fa640 1 -- 172.21.15.42:0/938313159 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2bc02de20 con 0x7fc2cc1005c0 2024-03-31T23:19:05.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2cc1a6740 con 0x7fc2cc1005c0 2024-03-31T23:19:05.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2c97fa640 1 -- 172.21.15.42:0/938313159 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc003a10 con 0x7fc2cc1005c0 2024-03-31T23:19:05.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.570+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2cc1a6c40 con 0x7fc2cc1005c0 2024-03-31T23:19:05.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.573+0000 7fc2c97fa640 1 -- 172.21.15.42:0/938313159 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7fc2bc046020 con 0x7fc2cc1005c0 2024-03-31T23:19:05.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 Processor -- start 2024-03-31T23:19:05.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 -- start start 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6470 0x55b391be6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bef430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bf1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b391b4a1b0 con 0x55b391be6470 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b391af2c00 con 0x55b391bef970 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2d5084740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b391b46250 con 0x55b391be6d90 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2c97fa640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2b40a27b0 0x7fc2b40a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2cb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bf1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.574+0000 7fc2c97fa640 1 -- 172.21.15.42:0/938313159 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc2bc0f0ff0 con 0x7fc2cc1005c0 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bf1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33154/0 (socket says 172.21.15.42:33154) 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 -- 172.21.15.42:0/3818845438 learned_addr learned my addr 172.21.15.42:0/3818845438 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2b40a27b0 0x7fc2b40a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6470 0x55b391be6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 -- 172.21.15.42:0/3818845438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 msgr2=0x55b391bef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 -- 172.21.15.42:0/3818845438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6470 msgr2=0x55b391be6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6470 0x55b391be6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 -- 172.21.15.42:0/3818845438 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b391b123d0 con 0x55b391bef970 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6470 0x55b391be6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.575+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bf1d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009ca0 tx=0x7fc2c0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f08a71ce6374d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2b27fc640 1 -- 172.21.15.42:0/3818845438 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0005220 con 0x55b391bef970 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2b27fc640 1 -- 172.21.15.42:0/3818845438 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2c0004ca0 con 0x55b391bef970 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2b27fc640 1 -- 172.21.15.42:0/3818845438 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0019920 con 0x55b391bef970 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 -- 172.21.15.42:0/3818845438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 msgr2=0x55b391bf1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2b40a27b0 0x7fc2b40a4c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005fd0 tx=0x7fc2c4009bf0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bf1d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009ca0 tx=0x7fc2c0011810 comp rx=0 tx=0).stop 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 -- 172.21.15.42:0/3818845438 shutdown_connections 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bf1d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3818845438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6470 0x55b391be6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.576+0000 7fc2d5084740 1 -- 172.21.15.42:0/3818845438 >> 172.21.15.42:0/3818845438 conn(0x55b391be0ba0 msgr2=0x55b391be0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 -- 172.21.15.42:0/3818845438 shutdown_connections 2024-03-31T23:19:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 -- 172.21.15.42:0/3818845438 wait complete. 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 -- start start 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 Processor -- start 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391becf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bed450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.577+0000 7fc2d5084740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b391bf2760 con 0x55b391be6d90 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d5084740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b391ae8470 con 0x55b391bef970 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d5084740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b391bf28e0 con 0x55b391be6470 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33166/0 (socket says 172.21.15.42:33166) 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 -- 172.21.15.42:0/2703559414 learned_addr learned my addr 172.21.15.42:0/2703559414 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391becf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d5084740 10 client.0 _ll_register_callbacks cb 0x55b391b05cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 -- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 msgr2=0x55b391bec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 -- 172.21.15.42:0/2703559414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 msgr2=0x55b391becf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391becf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 -- 172.21.15.42:0/2703559414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b39185e3f0 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391becf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bed450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400fff0 tx=0x7fc2c4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68a7cfee2020b44 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2703559414 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c400e5f0 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2703559414 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc2c400e790 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.578+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2c0004ca0 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2703559414 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2c4033050 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 10 client.25877 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3919287d0 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2703559414 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2c400ee90 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2703559414 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc2c40273a0 con 0x55b391bef970 2024-03-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 10 client.25877 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 10 client.25877 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 20 client.25877 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391bff9b0 0x55b391c01de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 4 client.25877 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.579+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc2c0004ca0 con 0x55b391bff9b0 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.580+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391bff9b0 0x55b391c01de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.580+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391bff9b0 0x55b391c01de0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7b6b76a5aac904d4 server_cookie=f6a47c1cf7128683 in_seq=0 out_seq=0 2024-03-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.580+0000 7fc2ab7fe640 10 client.25877 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2703559414 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fc2c0004ca0 con 0x55b391bff9b0 2024-03-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2ab7fe640 10 client.25877 handle_command_reply: tid=0 2024-03-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 client.25877 shutdown 2024-03-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 msgr2=0x55b391bed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bed450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400fff0 tx=0x7fc2c4004a40 comp rx=0 tx=0).stop 2024-03-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 shutdown_connections 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391bed450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391bff9b0 0x55b391c01de0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391becf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2703559414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 >> 172.21.15.42:0/2703559414 conn(0x55b391be0ba0 msgr2=0x55b391be28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2ab7fe640 0 client.25877 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 shutdown_connections 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 1 -- 172.21.15.42:0/2703559414 wait complete. 2024-03-31T23:19:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.581+0000 7fc2d5084740 20 client.25877 trim_cache size 0 max 16384 2024-03-31T23:19:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2d5084740 1 Processor -- start 2024-03-31T23:19:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2d5084740 1 -- start start 2024-03-31T23:19:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bef100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391bfb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bef100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58404/0 (socket says 172.21.15.42:58404) 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.595+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391c076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391bfb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 -- 172.21.15.42:0/3291731676 learned_addr learned my addr 172.21.15.42:0/3291731676 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1b0dc0 con 0x55b391be6d90 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1b2900 con 0x55b391bef970 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1b1490 con 0x55b391be6470 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391c076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 -- 172.21.15.42:0/3291731676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 msgr2=0x55b391c076b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391c076b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 -- 172.21.15.42:0/3291731676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 msgr2=0x55b391bfb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391bfb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 -- 172.21.15.42:0/3291731676 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b391be6bc0 con 0x55b391be6470 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391c076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391bfb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bef100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f334cf4258c9d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2b1ffb640 1 -- 172.21.15.42:0/3291731676 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0c1170 con 0x55b391be6470 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2b1ffb640 1 -- 172.21.15.42:0/3291731676 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2bc0b9a60 con 0x55b391be6470 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.596+0000 7fc2b1ffb640 1 -- 172.21.15.42:0/3291731676 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ee770 con 0x55b391be6470 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 msgr2=0x55b391bef100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bef100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc004610 comp rx=0 tx=0).stop 2024-03-31T23:19:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 shutdown_connections 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391bef970 0x55b391c076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391be6d90 0x55b391bfb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 --2- 172.21.15.42:0/3291731676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6470 0x55b391bef100 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 >> 172.21.15.42:0/3291731676 conn(0x55b391be0ba0 msgr2=0x55b391be2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 shutdown_connections 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.597+0000 7fc2d5084740 1 -- 172.21.15.42:0/3291731676 wait complete. 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 -- start start 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 Processor -- start 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 0x55b391be9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391bef970 0x55b391c6d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1b2230 con 0x55b391bef970 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1b1b60 con 0x55b391be6470 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1aed80 con 0x55b391be6d90 2024-03-31T23:19:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d5084740 10 client.0 _ll_register_callbacks cb 0x7fc2c400fb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 0x55b391be9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2cbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 0x55b391be9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33188/0 (socket says 172.21.15.42:33188) 2024-03-31T23:19:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2cbfff640 1 -- 172.21.15.42:0/2769173500 learned_addr learned my addr 172.21.15.42:0/2769173500 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.598+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391bef970 0x55b391c6d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2cbfff640 1 -- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 msgr2=0x55b391bea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2cbfff640 1 -- 172.21.15.42:0/2769173500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391bef970 msgr2=0x55b391c6d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391bef970 0x55b391c6d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2cbfff640 1 -- 172.21.15.42:0/2769173500 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b391c6dab0 con 0x55b391be6470 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2d0a3a640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391bef970 0x55b391c6d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2cbfff640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 0x55b391be9d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc005c20 tx=0x7fc2bc005680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58bb38a3741b6b60 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2769173500 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc004450 con 0x55b391be6470 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2bc0b9a60 con 0x55b391be6470 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2769173500 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc2bc003bb0 con 0x55b391be6470 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2769173500 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc003db0 con 0x55b391be6470 2024-03-31T23:19:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.599+0000 7fc2d5084740 10 client.25883 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b391c6edb0 con 0x55b391be6470 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2769173500 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2bc0b9a60 con 0x55b391be6470 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2769173500 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc2bc09d020 con 0x55b391be6470 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 10 client.25883 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 10 client.25883 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 20 client.25883 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391c6f510 0x55b391c71930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 4 client.25883 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b391b576f0 con 0x55b391c6f510 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.600+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391c6f510 0x55b391c71930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2ab7fe640 10 client.25883 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2cb7fe640 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391c6f510 0x55b391c71930 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=99f34d7300f8a5b3 server_cookie=3bdb3090f736fd9c in_seq=0 out_seq=0 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2ab7fe640 1 -- 172.21.15.42:0/2769173500 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b391b576f0 con 0x55b391c6f510 2024-03-31T23:19:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2ab7fe640 10 client.25883 handle_command_reply: tid=0 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 client.25883 shutdown 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 msgr2=0x55b391be9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 0x55b391be9d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc005c20 tx=0x7fc2bc005680 comp rx=0 tx=0).stop 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 shutdown_connections 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55b391c6f510 0x55b391c71930 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b391bef970 0x55b391c6d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b391be6d90 0x55b391bea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 --2- 172.21.15.42:0/2769173500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b391be6470 0x55b391be9d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 >> 172.21.15.42:0/2769173500 conn(0x55b391be0ba0 msgr2=0x55b391bdf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.601+0000 7fc2ab7fe640 0 client.25883 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 shutdown_connections 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d5084740 1 -- 172.21.15.42:0/2769173500 wait complete. 2024-03-31T23:19:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d5084740 20 client.25883 trim_cache size 0 max 16384 2024-03-31T23:19:05.607 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2b40a27b0 msgr2=0x7fc2b40a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2b40a27b0 0x7fc2b40a4c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005fd0 tx=0x7fc2c4009bf0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 msgr2=0x7fc2cc196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc196cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc036040 tx=0x7fc2bc02dc00 comp rx=0 tx=0).stop 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 shutdown_connections 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2cc106660 0x7fc2cc197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc2b40a27b0 0x7fc2b40a4c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2cc100f80 0x7fc2cc197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 --2- 172.21.15.42:0/938313159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2cc1005c0 0x7fc2cc196cd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 >> 172.21.15.42:0/938313159 conn(0x7fc2cc077750 msgr2=0x7fc2cc0ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 shutdown_connections 2024-03-31T23:19:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.602+0000 7fc2d249d640 1 -- 172.21.15.42:0/938313159 wait complete. 2024-03-31T23:19:05.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-31T23:19:05.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 -- 172.21.15.42:0/185230971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 msgr2=0x7f53b010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 --2- 172.21.15.42:0/185230971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b010e5b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009c40 tx=0x7f53a802bed0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 -- 172.21.15.42:0/185230971 shutdown_connections 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 --2- 172.21.15.42:0/185230971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b010e5b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 --2- 172.21.15.42:0/185230971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53b0068950 0x7f53b0068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 --2- 172.21.15.42:0/185230971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b01077a0 0x7f53b0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 -- 172.21.15.42:0/185230971 >> 172.21.15.42:0/185230971 conn(0x7f53b0077750 msgr2=0x7f53b0077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 -- 172.21.15.42:0/185230971 shutdown_connections 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.722+0000 7f53b81c7640 1 -- 172.21.15.42:0/185230971 wait complete. 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 Processor -- start 2024-03-31T23:19:05.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 -- start start 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b0068950 0x7f53b0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53b01077a0 0x7f53b019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111c10 con 0x7f53b01077a0 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111a90 con 0x7f53b0069310 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b81c7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111d90 con 0x7f53b0068950 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b5762640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b5f63640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b0068950 0x7f53b0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b5762640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33206/0 (socket says 172.21.15.42:33206) 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b5762640 1 -- 172.21.15.42:0/2076403306 learned_addr learned my addr 172.21.15.42:0/2076403306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.723+0000 7f53b6764640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53b01077a0 0x7f53b019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b5f63640 1 -- 172.21.15.42:0/2076403306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 msgr2=0x7f53b0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b5f63640 1 -- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53b01077a0 msgr2=0x7f53b019c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53b01077a0 0x7f53b019c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b5f63640 1 -- 172.21.15.42:0/2076403306 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b019cee0 con 0x7f53b0068950 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b0068950 0x7f53b0197ef0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00d6d0 tx=0x7f53ac00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53a6ffd640 1 -- 172.21.15.42:0/2076403306 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac017070 con 0x7f53b0068950 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53a6ffd640 1 -- 172.21.15.42:0/2076403306 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53ac009820 con 0x7f53b0068950 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b019d1d0 con 0x7f53b0068950 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53a6ffd640 1 -- 172.21.15.42:0/2076403306 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac004e00 con 0x7f53b0068950 2024-03-31T23:19:05.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.724+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b01a4a60 con 0x7f53b0068950 2024-03-31T23:19:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 Processor -- start 2024-03-31T23:19:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 -- start start 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 0x55f2716c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716cd970 0x55f2716cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f2716281b0 con 0x55f2716c4470 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f2715d0c00 con 0x55f2716cd970 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.727+0000 7f53bada3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f271624250 con 0x55f2716c4d90 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.728+0000 7f53a6ffd640 1 -- 172.21.15.42:0/2076403306 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f53ac0099d0 con 0x7f53b0068950 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.728+0000 7f53b6764640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 0x55f2716c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.728+0000 7f53b6764640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 0x55f2716c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54436/0 (socket says 172.21.15.42:54436) 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.728+0000 7f53b6764640 1 -- 172.21.15.42:0/1542040968 learned_addr learned my addr 172.21.15.42:0/1542040968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.728+0000 7f53b5762640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716cd970 0x55f2716cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.728+0000 7f53b5f63640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53a6ffd640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f539c0a2830 0x7f539c0a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5762640 1 -- 172.21.15.42:0/1542040968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 msgr2=0x55f2716cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5762640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5762640 1 -- 172.21.15.42:0/1542040968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 msgr2=0x55f2716c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5762640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 0x55f2716c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5762640 1 -- 172.21.15.42:0/1542040968 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2715f03d0 con 0x55f2716cd970 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53a6ffd640 1 -- 172.21.15.42:0/2076403306 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f53ac0ceaf0 con 0x7f53b0068950 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5f63640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b6764640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 0x55f2716c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b5762640 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716cd970 0x55f2716cfd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53a00058c0 tx=0x7f53a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e679a2a0dd64e270 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f53b6764640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f539c0a2830 0x7f539c0a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f539bfff640 1 -- 172.21.15.42:0/1542040968 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0004230 con 0x55f2716cd970 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f539bfff640 1 -- 172.21.15.42:0/1542040968 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53a00043d0 con 0x55f2716cd970 2024-03-31T23:19:05.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.729+0000 7f539bfff640 1 -- 172.21.15.42:0/1542040968 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0019810 con 0x55f2716cd970 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 -- 172.21.15.42:0/1542040968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716cd970 msgr2=0x55f2716cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716cd970 0x55f2716cfd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53a00058c0 tx=0x7f53a0011810 comp rx=0 tx=0).stop 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53b6764640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f539c0a2830 0x7f539c0a4cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f53a80099a0 tx=0x7f53a8005fd0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 -- 172.21.15.42:0/1542040968 shutdown_connections 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716cd970 0x55f2716cfd60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 --2- 172.21.15.42:0/1542040968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4470 0x55f2716c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 -- 172.21.15.42:0/1542040968 >> 172.21.15.42:0/1542040968 conn(0x55f2716beba0 msgr2=0x55f2716bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 -- 172.21.15.42:0/1542040968 shutdown_connections 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.730+0000 7f53bada3740 1 -- 172.21.15.42:0/1542040968 wait complete. 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 -- start start 2024-03-31T23:19:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 Processor -- start 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4470 0x55f2716ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4d90 0x55f2716caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f2716d4b70 con 0x55f2716cd970 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f2715c6470 con 0x55f2716c4d90 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f2716d4cf0 con 0x55f2716c4470 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.731+0000 7f53bada3740 10 client.0 _ll_register_callbacks cb 0x55f2715e3cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b5762640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4d90 0x55f2716caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b5762640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4d90 0x55f2716caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33230/0 (socket says 172.21.15.42:33230) 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b5762640 1 -- 172.21.15.42:0/1997050257 learned_addr learned my addr 172.21.15.42:0/1997050257 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54438/0 (socket says 172.21.15.42:54438) 2024-03-31T23:19:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b5f63640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4470 0x55f2716ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 -- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4470 msgr2=0x55f2716ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4470 0x55f2716ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 -- 172.21.15.42:0/1997050257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4d90 msgr2=0x55f2716caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4d90 0x55f2716caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 -- 172.21.15.42:0/1997050257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27133c3f0 con 0x55f2716cd970 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53b6764640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716cb3f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009560 tx=0x7f53a8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38922cd9275fd40 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.732+0000 7f53997fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53997fa640 1 -- 172.21.15.42:0/1997050257 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8050070 con 0x55f2716cd970 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53997fa640 1 -- 172.21.15.42:0/1997050257 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f53a8004590 con 0x55f2716cd970 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53a00043d0 con 0x55f2716cd970 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53997fa640 1 -- 172.21.15.42:0/1997050257 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f53a805c050 con 0x55f2716cd970 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53bada3740 10 client.16068 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f2714067d0 con 0x55f2716cd970 2024-03-31T23:19:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53997fa640 1 -- 172.21.15.42:0/1997050257 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53a00043d0 con 0x55f2716cd970 2024-03-31T23:19:05.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53997fa640 1 -- 172.21.15.42:0/1997050257 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f53a8034430 con 0x55f2716cd970 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.733+0000 7f53bada3740 10 client.16068 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53bada3740 10 client.16068 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53bada3740 20 client.16068 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53bada3740 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f2716e1d30 0x55f2716e4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53bada3740 4 client.16068 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2716356f0 con 0x55f2716e1d30 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53b5f63640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f2716e1d30 0x55f2716e4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53b5f63640 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f2716e1d30 0x55f2716e4190 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d550dc400a3b395 server_cookie=499bb1edf30f8ae6 in_seq=0 out_seq=0 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.734+0000 7f53997fa640 10 client.16068 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.735+0000 7f53997fa640 1 -- 172.21.15.42:0/1997050257 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f2716356f0 con 0x55f2716e1d30 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.735+0000 7f53997fa640 10 client.16068 handle_command_reply: tid=0 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.735+0000 7f53bada3740 1 client.16068 shutdown 2024-03-31T23:19:05.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 msgr2=0x55f2716cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716cb3f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009560 tx=0x7f53a8009280 comp rx=0 tx=0).stop 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 shutdown_connections 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f2716e1d30 0x55f2716e4190 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716cb3f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4d90 0x55f2716caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 --2- 172.21.15.42:0/1997050257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4470 0x55f2716ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 >> 172.21.15.42:0/1997050257 conn(0x55f2716beba0 msgr2=0x55f2716c08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53997fa640 0 client.16068 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 shutdown_connections 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 1 -- 172.21.15.42:0/1997050257 wait complete. 2024-03-31T23:19:05.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.736+0000 7f53bada3740 20 client.16068 trim_cache size 0 max 16384 2024-03-31T23:19:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.749+0000 7f53bada3740 1 Processor -- start 2024-03-31T23:19:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.749+0000 7f53bada3740 1 -- start start 2024-03-31T23:19:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.749+0000 7f53bada3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53bada3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53bada3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53bada3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ac800 con 0x55f2716cd970 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53bada3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ae340 con 0x55f2716c4470 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53bada3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01aced0 con 0x55f2716c4d90 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5762640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716dd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33242/0 (socket says 172.21.15.42:33242) 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5762640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58446/0 (socket says 172.21.15.42:58446) 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 -- 172.21.15.42:0/2843495316 learned_addr learned my addr 172.21.15.42:0/2843495316 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b6764640 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 -- 172.21.15.42:0/2843495316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 msgr2=0x55f2716cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 -- 172.21.15.42:0/2843495316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 msgr2=0x55f2716e9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716e9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 -- 172.21.15.42:0/2843495316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2716ba460 con 0x55f2716c4470 2024-03-31T23:19:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716dd910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53ac09aa20 tx=0x7f53ac0d3040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db23db1fb1822886 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f539b7fe640 1 -- 172.21.15.42:0/2843495316 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0b3070 con 0x55f2716c4470 2024-03-31T23:19:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f539b7fe640 1 -- 172.21.15.42:0/2843495316 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53ac09edc0 con 0x55f2716c4470 2024-03-31T23:19:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.750+0000 7f539b7fe640 1 -- 172.21.15.42:0/2843495316 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac020040 con 0x55f2716c4470 2024-03-31T23:19:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 -- 172.21.15.42:0/2843495316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 msgr2=0x55f2716dd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716dd910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53ac09aa20 tx=0x7f53ac0d3040 comp rx=0 tx=0).stop 2024-03-31T23:19:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 -- 172.21.15.42:0/2843495316 shutdown_connections 2024-03-31T23:19:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716cd970 0x55f2716e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716c4d90 0x55f2716cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 --2- 172.21.15.42:0/2843495316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716dd910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 -- 172.21.15.42:0/2843495316 >> 172.21.15.42:0/2843495316 conn(0x55f2716beba0 msgr2=0x55f2716cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 -- 172.21.15.42:0/2843495316 shutdown_connections 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 -- 172.21.15.42:0/2843495316 wait complete. 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.751+0000 7f53bada3740 1 -- start start 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 Processor -- start 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4d90 0x55f2716d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716cd970 0x55f2716d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01adc70 con 0x55f2716c4d90 2024-03-31T23:19:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ad5a0 con 0x55f2716c4470 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01aa7c0 con 0x55f2716cd970 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53bada3740 10 client.0 _ll_register_callbacks cb 0x7f53a8003ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53b5f63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716d9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53b5f63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716d9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33254/0 (socket says 172.21.15.42:33254) 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53b5f63640 1 -- 172.21.15.42:0/2446911283 learned_addr learned my addr 172.21.15.42:0/2446911283 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53b5762640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4d90 0x55f2716d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53b5f63640 1 -- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716cd970 msgr2=0x55f2716d3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.752+0000 7f53b6764640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716cd970 0x55f2716d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716cd970 0x55f2716d3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53b5f63640 1 -- 172.21.15.42:0/2446911283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4d90 msgr2=0x55f2716d3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4d90 0x55f2716d3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53b5f63640 1 -- 172.21.15.42:0/2446911283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2716da6b0 con 0x55f2716c4470 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53b6764640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716cd970 0x55f2716d3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53b5f63640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716d9f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009610 tx=0x7f53ac009dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7a4b1185c61295 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53997fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53997fa640 1 -- 172.21.15.42:0/2446911283 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac020040 con 0x55f2716c4470 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53997fa640 1 -- 172.21.15.42:0/2446911283 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f53ac0cc1f0 con 0x55f2716c4470 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53ac09edc0 con 0x55f2716c4470 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53997fa640 1 -- 172.21.15.42:0/2446911283 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f53ac07e050 con 0x55f2716c4470 2024-03-31T23:19:05.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53bada3740 10 client.25901 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f27174c910 con 0x55f2716c4470 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.753+0000 7f53997fa640 1 -- 172.21.15.42:0/2446911283 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53ac0b9120 con 0x55f2716c4470 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53997fa640 1 -- 172.21.15.42:0/2446911283 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f53ac09a170 con 0x55f2716c4470 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53bada3740 10 client.25901 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53bada3740 10 client.25901 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53bada3740 20 client.25901 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53bada3740 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f27174cf00 0x55f27174f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53bada3740 4 client.25901 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f53ac09edc0 con 0x55f27174cf00 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53b5762640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f27174cf00 0x55f27174f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53b5762640 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f27174cf00 0x55f27174f320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c385682748df6951 server_cookie=aab579ddb5d44ed2 in_seq=0 out_seq=0 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.754+0000 7f53997fa640 10 client.25901 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53997fa640 1 -- 172.21.15.42:0/2446911283 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f53ac09edc0 con 0x55f27174cf00 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53997fa640 10 client.25901 handle_command_reply: tid=0 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 client.25901 shutdown 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 msgr2=0x55f2716d9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716d9f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009610 tx=0x7f53ac009dd0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 shutdown_connections 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55f27174cf00 0x55f27174f320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2716cd970 0x55f2716d3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53997fa640 0 client.25901 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2716c4d90 0x55f2716d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 --2- 172.21.15.42:0/2446911283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2716c4470 0x55f2716d9f40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 >> 172.21.15.42:0/2446911283 conn(0x55f2716beba0 msgr2=0x55f2716bdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 shutdown_connections 2024-03-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 1 -- 172.21.15.42:0/2446911283 wait complete. 2024-03-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.755+0000 7f53bada3740 20 client.25901 trim_cache size 0 max 16384 2024-03-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f539c0a2830 msgr2=0x7f539c0a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f539c0a2830 0x7f539c0a4cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f53a80099a0 tx=0x7f53a8005fd0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b0068950 msgr2=0x7f53b0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b0068950 0x7f53b0197ef0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00d6d0 tx=0x7f53ac00db90 comp rx=0 tx=0).stop 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 shutdown_connections 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f539c0a2830 0x7f539c0a4cf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53b01077a0 0x7f53b019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53b0069310 0x7f53b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 --2- 172.21.15.42:0/2076403306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53b0068950 0x7f53b0197ef0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 >> 172.21.15.42:0/2076403306 conn(0x7f53b0077750 msgr2=0x7f53b01051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 shutdown_connections 2024-03-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.756+0000 7f53b81c7640 1 -- 172.21.15.42:0/2076403306 wait complete. 2024-03-31T23:19:05.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-31T23:19:05.768 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:05 smithi042 ceph-mon[32380]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-03-31T23:19:05.768 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:05 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/873206775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:19:05.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 -- 172.21.15.42:0/1729006695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3300100600 msgr2=0x7f3300100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 --2- 172.21.15.42:0/1729006695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3300100600 0x7f3300100a80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009860 tx=0x7f32f402bb90 comp rx=0 tx=0).stop 2024-03-31T23:19:05.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 -- 172.21.15.42:0/1729006695 shutdown_connections 2024-03-31T23:19:05.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 --2- 172.21.15.42:0/1729006695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100fc0 0x7f330010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 --2- 172.21.15.42:0/1729006695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3300100600 0x7f3300100a80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 --2- 172.21.15.42:0/1729006695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33001066a0 0x7f3300106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 -- 172.21.15.42:0/1729006695 >> 172.21.15.42:0/1729006695 conn(0x7f33000769d0 msgr2=0x7f3300076de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 -- 172.21.15.42:0/1729006695 shutdown_connections 2024-03-31T23:19:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.881+0000 7f33062c0640 1 -- 172.21.15.42:0/1729006695 wait complete. 2024-03-31T23:19:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.882+0000 7f33062c0640 1 Processor -- start 2024-03-31T23:19:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.882+0000 7f33062c0640 1 -- start start 2024-03-31T23:19:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.882+0000 7f33062c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100600 0x7f3300197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f33062c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 0x7f3300198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f33062c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33001066a0 0x7f330019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f33062c0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3300111c80 con 0x7f3300100600 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f33062c0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3300111b00 con 0x7f33001066a0 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f33062c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3300111e00 con 0x7f3300100fc0 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 0x7f3300198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 0x7f3300198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58480/0 (socket says 172.21.15.42:58480) 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 -- 172.21.15.42:0/3357821089 learned_addr learned my addr 172.21.15.42:0/3357821089 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32fffff640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100600 0x7f3300197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f330485d640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33001066a0 0x7f330019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 -- 172.21.15.42:0/3357821089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33001066a0 msgr2=0x7f330019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33001066a0 0x7f330019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 -- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100600 msgr2=0x7f3300197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100600 0x7f3300197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32ff7fe640 1 -- 172.21.15.42:0/3357821089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330019ced0 con 0x7f3300100fc0 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f330485d640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33001066a0 0x7f330019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.883+0000 7f32fffff640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100600 0x7f3300197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.884+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 0x7f3300198420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f32f40057c0 tx=0x7f32f40344c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.884+0000 7f32fd7fa640 1 -- 172.21.15.42:0/3357821089 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4039040 con 0x7f3300100fc0 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.884+0000 7f32fd7fa640 1 -- 172.21.15.42:0/3357821089 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32f4044070 con 0x7f3300100fc0 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.884+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330019d160 con 0x7f3300100fc0 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.884+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33001a4a50 con 0x7f3300100fc0 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.884+0000 7f32fd7fa640 1 -- 172.21.15.42:0/3357821089 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4032e30 con 0x7f3300100fc0 2024-03-31T23:19:05.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.887+0000 7f32fd7fa640 1 -- 172.21.15.42:0/3357821089 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f32f4032640 con 0x7f3300100fc0 2024-03-31T23:19:05.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.887+0000 7f3308f7f740 1 Processor -- start 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.887+0000 7f3308f7f740 1 -- start start 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f261b10 0x55662f261ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f24e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f24f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f3308f7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55662f1b81b0 con 0x55662f24ec70 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f3308f7f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55662f160c00 con 0x55662f261b10 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f3308f7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55662f1b4250 con 0x55662f2624c0 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f24f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f24f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54482/0 (socket says 172.21.15.42:54482) 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f32ff7fe640 1 -- 172.21.15.42:0/2098288015 learned_addr learned my addr 172.21.15.42:0/2098288015 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f32fffff640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f24e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f330485d640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f261b10 0x55662f261ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f32fd7fa640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f32e80a27b0 0x7f32e80a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f330485d640 1 -- 172.21.15.42:0/2098288015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 msgr2=0x55662f24e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f330485d640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f24e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f330485d640 1 -- 172.21.15.42:0/2098288015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 msgr2=0x55662f24f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.888+0000 7f330485d640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f24f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f330485d640 1 -- 172.21.15.42:0/2098288015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662f1803d0 con 0x55662f261b10 2024-03-31T23:19:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f330485d640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f32e80a27b0 0x7f32e80a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f32fffff640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f24e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f24f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f330485d640 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f261b10 0x55662f261ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009fd0 tx=0x7f32f800ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1776c02e8ce8bb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f32e67fc640 1 -- 172.21.15.42:0/2098288015 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f801b9e0 con 0x55662f261b10 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f32e67fc640 1 -- 172.21.15.42:0/2098288015 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32f801bb80 con 0x55662f261b10 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f32e67fc640 1 -- 172.21.15.42:0/2098288015 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f801a610 con 0x55662f261b10 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.889+0000 7f32fd7fa640 1 -- 172.21.15.42:0/3357821089 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f32f40f0d30 con 0x7f3300100fc0 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 -- 172.21.15.42:0/2098288015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f261b10 msgr2=0x55662f261ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f330485d640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f32e80a27b0 0x7f32e80a4c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32f8023000 tx=0x7f32f8020000 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f261b10 0x55662f261ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009fd0 tx=0x7f32f800ed50 comp rx=0 tx=0).stop 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 -- 172.21.15.42:0/2098288015 shutdown_connections 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f24f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f24e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2098288015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f261b10 0x55662f261ef0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 -- 172.21.15.42:0/2098288015 >> 172.21.15.42:0/2098288015 conn(0x55662f251110 msgr2=0x55662f2514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 -- 172.21.15.42:0/2098288015 shutdown_connections 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 -- 172.21.15.42:0/2098288015 wait complete. 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.890+0000 7f3308f7f740 1 -- start start 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 Processor -- start 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f265af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f266030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f266570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55662f268f50 con 0x55662f24ec70 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55662f156470 con 0x55662f2624c0 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55662f2690d0 con 0x55662f261b10 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f3308f7f740 10 client.0 _ll_register_callbacks cb 0x55662f173cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f266030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f266030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58498/0 (socket says 172.21.15.42:58498) 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f32ff7fe640 1 -- 172.21.15.42:0/2358838530 learned_addr learned my addr 172.21.15.42:0/2358838530 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f32fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f265af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.891+0000 7f330485d640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f266570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32ff7fe640 1 -- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 msgr2=0x55662f266570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f266570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32ff7fe640 1 -- 172.21.15.42:0/2358838530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 msgr2=0x55662f265af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f265af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32ff7fe640 1 -- 172.21.15.42:0/2358838530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662eecc3f0 con 0x55662f261b10 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f330485d640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f266570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32fffff640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f265af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f266030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32f40bcd00 tx=0x7f32f4032930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21cd98d2faa2cbf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32df7fe640 1 -- 172.21.15.42:0/2358838530 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40bcdd0 con 0x55662f261b10 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f32df7fe640 1 -- 172.21.15.42:0/2358838530 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f32f40bd460 con 0x55662f261b10 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.892+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f801bb80 con 0x55662f261b10 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.893+0000 7f32df7fe640 1 -- 172.21.15.42:0/2358838530 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32f40bc960 con 0x55662f261b10 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.893+0000 7f3308f7f740 10 client.25864 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.893+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55662ef967d0 con 0x55662f261b10 2024-03-31T23:19:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.893+0000 7f32df7fe640 1 -- 172.21.15.42:0/2358838530 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32f801bb80 con 0x55662f261b10 2024-03-31T23:19:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f32df7fe640 1 -- 172.21.15.42:0/2358838530 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f32f403c030 con 0x55662f261b10 2024-03-31T23:19:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f3308f7f740 10 client.25864 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f3308f7f740 10 client.25864 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f3308f7f740 20 client.25864 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f278900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f3308f7f740 4 client.25864 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55662f1c56f0 con 0x55662f276480 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f32fffff640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f278900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f32df7fe640 10 client.25864 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.894+0000 7f32fffff640 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f278900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efc80148287bfee7 server_cookie=5f829245ec9982cd in_seq=0 out_seq=0 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f32df7fe640 1 -- 172.21.15.42:0/2358838530 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55662f1c56f0 con 0x55662f276480 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f32df7fe640 10 client.25864 handle_command_reply: tid=0 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 client.25864 shutdown 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 msgr2=0x55662f266030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f266030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32f40bcd00 tx=0x7f32f4032930 comp rx=0 tx=0).stop 2024-03-31T23:19:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 shutdown_connections 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f278900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f266570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f266030 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f32df7fe640 0 client.25864 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2358838530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f265af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 >> 172.21.15.42:0/2358838530 conn(0x55662f251110 msgr2=0x55662f24dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 shutdown_connections 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 1 -- 172.21.15.42:0/2358838530 wait complete. 2024-03-31T23:19:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.895+0000 7f3308f7f740 20 client.25864 trim_cache size 0 max 16384 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 Processor -- start 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 -- start start 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f24ec70 0x55662f271dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 0x55662f27e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f260b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec00fe90 con 0x55662f261b10 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0119d0 con 0x55662f24ec70 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f3308f7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec010560 con 0x55662f2624c0 2024-03-31T23:19:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 0x55662f27e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f32fffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f24ec70 0x55662f271dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 0x55662f27e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54496/0 (socket says 172.21.15.42:54496) 2024-03-31T23:19:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f32ff7fe640 1 -- 172.21.15.42:0/2432301653 learned_addr learned my addr 172.21.15.42:0/2432301653 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.909+0000 7f330485d640 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f260b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32fffff640 1 -- 172.21.15.42:0/2432301653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 msgr2=0x55662f260b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32fffff640 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f260b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32fffff640 1 -- 172.21.15.42:0/2432301653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 msgr2=0x55662f27e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32fffff640 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 0x55662f27e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32fffff640 1 -- 172.21.15.42:0/2432301653 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662f24a240 con 0x55662f24ec70 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 0x55662f27e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32fffff640 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f24ec70 0x55662f271dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55662f279150 tx=0x7f32f0008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bae9b09d9d05388 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32e5ffb640 1 -- 172.21.15.42:0/2432301653 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0014e00 con 0x55662f24ec70 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32e5ffb640 1 -- 172.21.15.42:0/2432301653 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32f001d750 con 0x55662f24ec70 2024-03-31T23:19:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.910+0000 7f32e5ffb640 1 -- 172.21.15.42:0/2432301653 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0016c20 con 0x55662f24ec70 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 -- 172.21.15.42:0/2432301653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f24ec70 msgr2=0x55662f271dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f24ec70 0x55662f271dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55662f279150 tx=0x7f32f0008040 comp rx=0 tx=0).stop 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 -- 172.21.15.42:0/2432301653 shutdown_connections 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f2624c0 0x55662f260b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f261b10 0x55662f27e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 --2- 172.21.15.42:0/2432301653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f24ec70 0x55662f271dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 -- 172.21.15.42:0/2432301653 >> 172.21.15.42:0/2432301653 conn(0x55662f251110 msgr2=0x55662f25fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 -- 172.21.15.42:0/2432301653 shutdown_connections 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.911+0000 7f3308f7f740 1 -- 172.21.15.42:0/2432301653 wait complete. 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 -- start start 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 Processor -- start 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f27d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f27db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f27e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec011300 con 0x55662f24ec70 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec010c30 con 0x55662f2624c0 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.912+0000 7f3308f7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec00de50 con 0x55662f261b10 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f3308f7f740 10 client.0 _ll_register_callbacks cb 0x7f32f40f44f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f27d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f27d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54502/0 (socket says 172.21.15.42:54502) 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 -- 172.21.15.42:0/1378923656 learned_addr learned my addr 172.21.15.42:0/1378923656 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f27db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f330485d640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f27e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 -- 172.21.15.42:0/1378923656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 msgr2=0x55662f27db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f27db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 -- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 msgr2=0x55662f27e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f27e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 -- 172.21.15.42:0/1378923656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662f2db840 con 0x55662f24ec70 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32fffff640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f27d610 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f32f0008010 tx=0x7f32f001d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cc7427b68d7862 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:05.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.913+0000 7f32df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f32df7fe640 1 -- 172.21.15.42:0/1378923656 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f002a070 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f32df7fe640 1 -- 172.21.15.42:0/1378923656 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f32f0016da0 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f001d750 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f32df7fe640 1 -- 172.21.15.42:0/1378923656 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32f001d220 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f3308f7f740 10 client.16092 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55662f2dcaf0 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.914+0000 7f32df7fe640 1 -- 172.21.15.42:0/1378923656 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32f001d750 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f32df7fe640 1 -- 172.21.15.42:0/1378923656 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f32f0026a40 con 0x55662f24ec70 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f3308f7f740 10 client.16092 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:05.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f3308f7f740 10 client.16092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f3308f7f740 20 client.16092 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f3308f7f740 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f2df190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f3308f7f740 4 client.16092 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55662f1bfa40 con 0x55662f276480 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f2df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f32df7fe640 10 client.16092 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.915+0000 7f32ff7fe640 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f2df190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=381046f489045cfb server_cookie=49995a62bf95da10 in_seq=0 out_seq=0 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f32df7fe640 1 -- 172.21.15.42:0/1378923656 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55662f1bfa40 con 0x55662f276480 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f32df7fe640 10 client.16092 handle_command_reply: tid=0 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 client.16092 shutdown 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 msgr2=0x55662f27d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f27d610 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f32f0008010 tx=0x7f32f001d900 comp rx=0 tx=0).stop 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 shutdown_connections 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x55662f276480 0x55662f2df190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55662f2624c0 0x55662f27e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55662f261b10 0x55662f27db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 --2- 172.21.15.42:0/1378923656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55662f24ec70 0x55662f27d610 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 >> 172.21.15.42:0/1378923656 conn(0x55662f251110 msgr2=0x55662f260b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f32df7fe640 0 client.16092 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 shutdown_connections 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 1 -- 172.21.15.42:0/1378923656 wait complete. 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.916+0000 7f3308f7f740 20 client.16092 trim_cache size 0 max 16384 2024-03-31T23:19:05.921 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:05 smithi094 ceph-mon[36167]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-03-31T23:19:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:05 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/873206775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:19:05.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f32e80a27b0 msgr2=0x7f32e80a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f32e80a27b0 0x7f32e80a4c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32f8023000 tx=0x7f32f8020000 comp rx=0 tx=0).stop 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 msgr2=0x7f3300198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 0x7f3300198420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f32f40057c0 tx=0x7f32f40344c0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 shutdown_connections 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33001066a0 0x7f330019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300100fc0 0x7f3300198420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f32e80a27b0 0x7f32e80a4c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 --2- 172.21.15.42:0/3357821089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3300100600 0x7f3300197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 >> 172.21.15.42:0/3357821089 conn(0x7f33000769d0 msgr2=0x7f33000feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 shutdown_connections 2024-03-31T23:19:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:05.917+0000 7f33062c0640 1 -- 172.21.15.42:0/3357821089 wait complete. 2024-03-31T23:19:05.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-31T23:19:05.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:05 smithi188 ceph-mon[36068]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-03-31T23:19:05.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:05 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/873206775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 -- 172.21.15.42:0/3558997383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8068950 msgr2=0x7f36d8068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/3558997383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8068950 0x7f36d8068dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009930 tx=0x7f36c802bc20 comp rx=0 tx=0).stop 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 -- 172.21.15.42:0/3558997383 shutdown_connections 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/3558997383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8069310 0x7f36d810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/3558997383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8068950 0x7f36d8068dd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/3558997383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 0x7f36d8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 -- 172.21.15.42:0/3558997383 >> 172.21.15.42:0/3558997383 conn(0x7f36d8077750 msgr2=0x7f36d8077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 -- 172.21.15.42:0/3558997383 shutdown_connections 2024-03-31T23:19:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.036+0000 7f36dfb3e640 1 -- 172.21.15.42:0/3558997383 wait complete. 2024-03-31T23:19:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 Processor -- start 2024-03-31T23:19:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 -- start start 2024-03-31T23:19:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 0x7f36d8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8069310 0x7f36d8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 0x7f36d819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 0x7f36d8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 0x7f36d8197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54534/0 (socket says 172.21.15.42:54534) 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8069310 0x7f36d8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8069310 0x7f36d8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58538/0 (socket says 172.21.15.42:58538) 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dd8da640 1 -- 172.21.15.42:0/393655052 learned_addr learned my addr 172.21.15.42:0/393655052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8111bd0 con 0x7f36d8068950 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8111a50 con 0x7f36d81077a0 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8111d50 con 0x7f36d8069310 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.037+0000 7f36de0db640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 0x7f36d819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36de0db640 1 -- 172.21.15.42:0/393655052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8069310 msgr2=0x7f36d8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36de0db640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8069310 0x7f36d8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36de0db640 1 -- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 msgr2=0x7f36d8197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36de0db640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 0x7f36d8197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36de0db640 1 -- 172.21.15.42:0/393655052 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d819ced0 con 0x7f36d81077a0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36dd8da640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 0x7f36d8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36de0db640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 0x7f36d819c7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36d000ec50 tx=0x7f36d000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36ceffd640 1 -- 172.21.15.42:0/393655052 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0003b70 con 0x7f36d81077a0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36ceffd640 1 -- 172.21.15.42:0/393655052 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36d0003d10 con 0x7f36d81077a0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d819d1c0 con 0x7f36d81077a0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36ceffd640 1 -- 172.21.15.42:0/393655052 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0010920 con 0x7f36d81077a0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.038+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d8100540 con 0x7f36d81077a0 2024-03-31T23:19:06.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.041+0000 7f36ceffd640 1 -- 172.21.15.42:0/393655052 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f36d0004020 con 0x7f36d81077a0 2024-03-31T23:19:06.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 Processor -- start 2024-03-31T23:19:06.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 -- start start 2024-03-31T23:19:06.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 0x55f5c57d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2d90 0x55f5c57db430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f5c57361b0 con 0x55f5c57db970 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f5c56dec00 con 0x55f5c57d2d90 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36e27fc740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f5c5732250 con 0x55f5c57d2470 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 0x55f5c57d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 0x55f5c57d2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58548/0 (socket says 172.21.15.42:58548) 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36dd0d9640 1 -- 172.21.15.42:0/2020762852 learned_addr learned my addr 172.21.15.42:0/2020762852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.042+0000 7f36dd8da640 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2d90 0x55f5c57db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd0d9640 1 -- 172.21.15.42:0/2020762852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2d90 msgr2=0x55f5c57db430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2d90 0x55f5c57db430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd0d9640 1 -- 172.21.15.42:0/2020762852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 msgr2=0x55f5c57ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57ddd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd0d9640 1 -- 172.21.15.42:0/2020762852 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5c56fe3d0 con 0x55f5c57d2470 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36ceffd640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f36c40a2880 0x7f36c40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 0x55f5c57d2850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36c8036040 tx=0x7f36c80056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15c5701853ab4a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36c3fff640 1 -- 172.21.15.42:0/2020762852 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c802c9b0 con 0x55f5c57d2470 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36dd8da640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f36c40a2880 0x7f36c40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36ceffd640 1 -- 172.21.15.42:0/393655052 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f36d00cf5b0 con 0x7f36d81077a0 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36c3fff640 1 -- 172.21.15.42:0/2020762852 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36c8003af0 con 0x55f5c57d2470 2024-03-31T23:19:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.043+0000 7f36c3fff640 1 -- 172.21.15.42:0/2020762852 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8034a20 con 0x55f5c57d2470 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 -- 172.21.15.42:0/2020762852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 msgr2=0x55f5c57d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 0x55f5c57d2850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36c8036040 tx=0x7f36c80056d0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36dd8da640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f36c40a2880 0x7f36c40a4d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55f5c57d1f40 tx=0x7f36d400b480 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 -- 172.21.15.42:0/2020762852 shutdown_connections 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2d90 0x55f5c57db430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2020762852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2470 0x55f5c57d2850 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 -- 172.21.15.42:0/2020762852 >> 172.21.15.42:0/2020762852 conn(0x55f5c57ccba0 msgr2=0x55f5c57ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 -- 172.21.15.42:0/2020762852 shutdown_connections 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 -- 172.21.15.42:0/2020762852 wait complete. 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 -- start start 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.044+0000 7f36e27fc740 1 Processor -- start 2024-03-31T23:19:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f5c57de6a0 con 0x55f5c57db970 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f5c56d4470 con 0x55f5c57d2470 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f5c57de820 con 0x55f5c57d2d90 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36e27fc740 10 client.0 _ll_register_callbacks cb 0x55f5c56f1cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57d89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33330/0 (socket says 172.21.15.42:33330) 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 -- 172.21.15.42:0/2763252538 learned_addr learned my addr 172.21.15.42:0/2763252538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36de0db640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 -- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 msgr2=0x55f5c57d8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 -- 172.21.15.42:0/2763252538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 msgr2=0x55f5c57d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57d9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36dd8da640 1 -- 172.21.15.42:0/2763252538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5c544a3f0 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.045+0000 7f36de0db640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36dd8da640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57d89d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36d4010a10 tx=0x7f36d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8532351b31da3e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36c17fa640 1 -- 172.21.15.42:0/2763252538 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d401fb40 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36c8003af0 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36c17fa640 1 -- 172.21.15.42:0/2763252538 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f36d401fce0 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36c17fa640 1 -- 172.21.15.42:0/2763252538 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36d4005020 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36e27fc740 10 client.25931 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5c55147d0 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36c17fa640 1 -- 172.21.15.42:0/2763252538 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36c8003af0 con 0x55f5c57d2470 2024-03-31T23:19:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36c17fa640 1 -- 172.21.15.42:0/2763252538 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f36d4026070 con 0x55f5c57d2470 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36e27fc740 10 client.25931 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.046+0000 7f36e27fc740 10 client.25931 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36e27fc740 20 client.25931 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c57ebd00 0x55f5c57ee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36e27fc740 4 client.25931 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5c57436f0 con 0x55f5c57ebd00 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c57ebd00 0x55f5c57ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c57ebd00 0x55f5c57ee180 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ad06967a6307649 server_cookie=13c3efed7a6a3914 in_seq=0 out_seq=0 2024-03-31T23:19:06.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.047+0000 7f36c17fa640 10 client.25931 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36c17fa640 1 -- 172.21.15.42:0/2763252538 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f5c57436f0 con 0x55f5c57ebd00 2024-03-31T23:19:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36c17fa640 10 client.25931 handle_command_reply: tid=0 2024-03-31T23:19:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 client.25931 shutdown 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 msgr2=0x55f5c57d89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57d89d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36d4010a10 tx=0x7f36d4004730 comp rx=0 tx=0).stop 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 shutdown_connections 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c57ebd00 0x55f5c57ee180 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 --2- 172.21.15.42:0/2763252538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57d89d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 >> 172.21.15.42:0/2763252538 conn(0x55f5c57ccba0 msgr2=0x55f5c57ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36c17fa640 0 client.25931 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 shutdown_connections 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 1 -- 172.21.15.42:0/2763252538 wait complete. 2024-03-31T23:19:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.048+0000 7f36e27fc740 20 client.25931 trim_cache size 0 max 16384 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 Processor -- start 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 -- start start 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57e7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81b0bb0 con 0x55f5c57db970 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81b26f0 con 0x55f5c57d2470 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36e27fc740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81b1280 con 0x55f5c57d2d90 2024-03-31T23:19:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58580/0 (socket says 172.21.15.42:58580) 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3802168445 learned_addr learned my addr 172.21.15.42:0/3802168445 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36de0db640 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3802168445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 msgr2=0x55f5c57db100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57db100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3802168445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 msgr2=0x55f5c57f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.062+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3802168445 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5c57de090 con 0x55f5c57d2d90 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.063+0000 7f36de0db640 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.063+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57e7440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36c80345f0 tx=0x7f36c8034580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65fa36f004726239 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.063+0000 7f36c37fe640 1 -- 172.21.15.42:0/3802168445 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8003f20 con 0x55f5c57d2d90 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.063+0000 7f36c37fe640 1 -- 172.21.15.42:0/3802168445 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36c80035f0 con 0x55f5c57d2d90 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.063+0000 7f36c37fe640 1 -- 172.21.15.42:0/3802168445 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c80052a0 con 0x55f5c57d2d90 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 -- 172.21.15.42:0/3802168445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 msgr2=0x55f5c57e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57e7440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36c80345f0 tx=0x7f36c8034580 comp rx=0 tx=0).stop 2024-03-31T23:19:06.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 -- 172.21.15.42:0/3802168445 shutdown_connections 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57db970 0x55f5c57f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57e7440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3802168445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57d2470 0x55f5c57db100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 -- 172.21.15.42:0/3802168445 >> 172.21.15.42:0/3802168445 conn(0x55f5c57ccba0 msgr2=0x55f5c57cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 -- 172.21.15.42:0/3802168445 shutdown_connections 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 -- 172.21.15.42:0/3802168445 wait complete. 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 -- start start 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.064+0000 7f36e27fc740 1 Processor -- start 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 0x55f5c57d5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57db970 0x55f5c57d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 0x55f5c57d5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd8da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 0x55f5c57d5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54574/0 (socket says 172.21.15.42:54574) 2024-03-31T23:19:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd0d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58586/0 (socket says 172.21.15.42:58586) 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd8da640 1 -- 172.21.15.42:0/3193961715 learned_addr learned my addr 172.21.15.42:0/3193961715 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81b2020 con 0x55f5c57d2470 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81b1950 con 0x55f5c57db970 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81aeb70 con 0x55f5c57d2d90 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36e27fc740 10 client.0 _ll_register_callbacks cb 0x7f36d4010920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36de0db640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57db970 0x55f5c57d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3193961715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57db970 msgr2=0x55f5c57d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57db970 0x55f5c57d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.065+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3193961715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 msgr2=0x55f5c57d5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 0x55f5c57d5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36dd0d9640 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5c5851170 con 0x55f5c57d2d90 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36de0db640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57db970 0x55f5c57d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36dd8da640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 0x55f5c57d5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36dd0d9640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d5b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55f5c57d2d60 tx=0x7f36c8009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2448a08027208d84 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36c17fa640 1 -- 172.21.15.42:0/3193961715 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c805f060 con 0x55f5c57d2d90 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36c80035f0 con 0x55f5c57d2d90 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36c17fa640 1 -- 172.21.15.42:0/3193961715 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f36c80039a0 con 0x55f5c57d2d90 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36c17fa640 1 -- 172.21.15.42:0/3193961715 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36c8066050 con 0x55f5c57d2d90 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.066+0000 7f36e27fc740 10 client.25888 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5c58523c0 con 0x55f5c57d2d90 2024-03-31T23:19:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36c17fa640 1 -- 172.21.15.42:0/3193961715 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36c8005550 con 0x55f5c57d2d90 2024-03-31T23:19:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36c17fa640 1 -- 172.21.15.42:0/3193961715 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f36c8052650 con 0x55f5c57d2d90 2024-03-31T23:19:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 10 client.25888 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 10 client.25888 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 20 client.25888 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c5852640 0x55f5c5854a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 4 client.25888 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f36c80035f0 con 0x55f5c5852640 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.067+0000 7f36dd8da640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c5852640 0x55f5c5854a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.068+0000 7f36c17fa640 10 client.25888 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.068+0000 7f36dd8da640 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c5852640 0x55f5c5854a30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f5be4938687ce20a server_cookie=918bdaa4a351c1f in_seq=0 out_seq=0 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.068+0000 7f36c17fa640 1 -- 172.21.15.42:0/3193961715 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f36c80035f0 con 0x55f5c5852640 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.068+0000 7f36c17fa640 10 client.25888 handle_command_reply: tid=0 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 client.25888 shutdown 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 msgr2=0x55f5c57d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d5b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55f5c57d2d60 tx=0x7f36c8009300 comp rx=0 tx=0).stop 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 shutdown_connections 2024-03-31T23:19:06.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5c57db970 0x55f5c57d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55f5c5852640 0x55f5c5854a30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5c57d2d90 0x55f5c57d5b80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36c17fa640 0 client.25888 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 --2- 172.21.15.42:0/3193961715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5c57d2470 0x55f5c57d5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 >> 172.21.15.42:0/3193961715 conn(0x55f5c57ccba0 msgr2=0x55f5c57d9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 shutdown_connections 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 1 -- 172.21.15.42:0/3193961715 wait complete. 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.069+0000 7f36e27fc740 20 client.25888 trim_cache size 0 max 16384 2024-03-31T23:19:06.074 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:06.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.070+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f36c40a2880 msgr2=0x7f36c40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.070+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f36c40a2880 0x7f36c40a4d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55f5c57d1f40 tx=0x7f36d400b480 comp rx=0 tx=0).stop 2024-03-31T23:19:06.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.070+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 msgr2=0x7f36d819c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.070+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 0x7f36d819c7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36d000ec50 tx=0x7f36d000c6a0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.070+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 shutdown_connections 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d81077a0 0x7f36d819c7a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36d8069310 0x7f36d8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f36c40a2880 0x7f36c40a4d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 --2- 172.21.15.42:0/393655052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36d8068950 0x7f36d8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 >> 172.21.15.42:0/393655052 conn(0x7f36d8077750 msgr2=0x7f36d80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 shutdown_connections 2024-03-31T23:19:06.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.071+0000 7f36dfb3e640 1 -- 172.21.15.42:0/393655052 wait complete. 2024-03-31T23:19:06.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 -- 172.21.15.42:0/1888868634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac1005c0 msgr2=0x7fbbac100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1888868634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac1005c0 0x7fbbac100a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009930 tx=0x7fbba002bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 -- 172.21.15.42:0/1888868634 shutdown_connections 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1888868634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac100f80 0x7fbbac10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1888868634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac1005c0 0x7fbbac100a40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1888868634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 0x7fbbac106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 -- 172.21.15.42:0/1888868634 >> 172.21.15.42:0/1888868634 conn(0x7fbbac077750 msgr2=0x7fbbac077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 -- 172.21.15.42:0/1888868634 shutdown_connections 2024-03-31T23:19:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.206+0000 7fbbb26af640 1 -- 172.21.15.42:0/1888868634 wait complete. 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 Processor -- start 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 -- start start 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 0x7fbbac195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac100f80 0x7fbbac196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 0x7fbbac19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 0x7fbbac195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac10f9a0 con 0x7fbbac1005c0 2024-03-31T23:19:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac10f820 con 0x7fbbac106660 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb26af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac10fb20 con 0x7fbbac100f80 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 0x7fbbac195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54588/0 (socket says 172.21.15.42:54588) 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbabfff640 1 -- 172.21.15.42:0/1380843587 learned_addr learned my addr 172.21.15.42:0/1380843587 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac100f80 0x7fbbac196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.207+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 0x7fbbac19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbabfff640 1 -- 172.21.15.42:0/1380843587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac100f80 msgr2=0x7fbbac196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbabfff640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac100f80 0x7fbbac196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbabfff640 1 -- 172.21.15.42:0/1380843587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 msgr2=0x7fbbac19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbabfff640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 0x7fbbac19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbabfff640 1 -- 172.21.15.42:0/1380843587 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac19ad10 con 0x7fbbac1005c0 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 0x7fbbac19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac100f80 0x7fbbac196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbabfff640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 0x7fbbac195d20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00e7f0 tx=0x7fbb9c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbba97fa640 1 -- 172.21.15.42:0/1380843587 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c019070 con 0x7fbbac1005c0 2024-03-31T23:19:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbba97fa640 1 -- 172.21.15.42:0/1380843587 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb9c00dd20 con 0x7fbbac1005c0 2024-03-31T23:19:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbba97fa640 1 -- 172.21.15.42:0/1380843587 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c003e20 con 0x7fbbac1005c0 2024-03-31T23:19:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac19b000 con 0x7fbbac1005c0 2024-03-31T23:19:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.208+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac1a2890 con 0x7fbbac1005c0 2024-03-31T23:19:06.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 Processor -- start 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbba97fa640 1 -- 172.21.15.42:0/1380843587 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7fbb9c01c070 con 0x7fbbac1005c0 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 -- start start 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dcf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9d5d331b0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b9d5cdbc00 con 0x55b9d5dcf470 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.212+0000 7fbbb536a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b9d5d2f250 con 0x55b9d5dd8970 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dcf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dcf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33382/0 (socket says 172.21.15.42:33382) 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 -- 172.21.15.42:0/604789853 learned_addr learned my addr 172.21.15.42:0/604789853 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbabfff640 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 -- 172.21.15.42:0/604789853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 msgr2=0x55b9d5ddad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbba97fa640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbb940a2800 0x7fbb940a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 -- 172.21.15.42:0/604789853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 msgr2=0x55b9d5dd8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 -- 172.21.15.42:0/604789853 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d5cfb3d0 con 0x55b9d5dcf470 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbba97fa640 1 -- 172.21.15.42:0/1380843587 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fbb9c0ce7c0 con 0x7fbbac1005c0 2024-03-31T23:19:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbb940a2800 0x7fbb940a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.213+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dcf850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbba40107e0 tx=0x7fbba4010ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93ffc046a7540b3b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbb927fc640 1 -- 172.21.15.42:0/604789853 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4011e60 con 0x55b9d5dcf470 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbb927fc640 1 -- 172.21.15.42:0/604789853 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba401b8f0 con 0x55b9d5dcf470 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbb927fc640 1 -- 172.21.15.42:0/604789853 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400d6f0 con 0x55b9d5dcf470 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 -- 172.21.15.42:0/604789853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 msgr2=0x55b9d5dcf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbb940a2800 0x7fbb940a4cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbba4021000 tx=0x7fbba4022000 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dcf850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbba40107e0 tx=0x7fbba4010ca0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 -- 172.21.15.42:0/604789853 shutdown_connections 2024-03-31T23:19:06.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 --2- 172.21.15.42:0/604789853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dcf850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.214+0000 7fbbb536a740 1 -- 172.21.15.42:0/604789853 >> 172.21.15.42:0/604789853 conn(0x55b9d5dc9ba0 msgr2=0x55b9d5dc9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.215+0000 7fbbb536a740 1 -- 172.21.15.42:0/604789853 shutdown_connections 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.215+0000 7fbbb536a740 1 -- 172.21.15.42:0/604789853 wait complete. 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.215+0000 7fbbb536a740 1 -- start start 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.215+0000 7fbbb536a740 1 Processor -- start 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5dd6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9d5ddb760 con 0x55b9d5dcfd90 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54606/0 (socket says 172.21.15.42:54606) 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 -- 172.21.15.42:0/863872447 learned_addr learned my addr 172.21.15.42:0/863872447 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b9d5cd1470 con 0x55b9d5dcf470 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b9d5ddb8e0 con 0x55b9d5dd8970 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbabfff640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5dd6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbb536a740 10 client.0 _ll_register_callbacks cb 0x55b9d5ceecb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 -- 172.21.15.42:0/863872447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 msgr2=0x55b9d5dd6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5dd6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 -- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 msgr2=0x55b9d5dd5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 -- 172.21.15.42:0/863872447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d5a473f0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbabfff640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd5f40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009930 tx=0x7fbba002cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6251fbc0df87f43d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.216+0000 7fbb8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:06.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/863872447 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0004040 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/863872447 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fbba00041e0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba401b8f0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/863872447 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbba0057050 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 10 client.16119 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b9d5b117d0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/863872447 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba00043e0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/863872447 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbba0004cc0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 10 client.16119 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 20 client.16119 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5de89a0 0x55b9d5deae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 4 client.16119 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:06.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.217+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbba401b8f0 con 0x55b9d5de89a0 2024-03-31T23:19:06.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.218+0000 7fbbabfff640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5de89a0 0x55b9d5deae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.218+0000 7fbb8b7fe640 10 client.16119 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:06.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.218+0000 7fbbabfff640 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5de89a0 0x55b9d5deae20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea33ef33c66e41c1 server_cookie=4f24a70da2158a2e in_seq=0 out_seq=0 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/863872447 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fbba401b8f0 con 0x55b9d5de89a0 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbb8b7fe640 10 client.16119 handle_command_reply: tid=0 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 client.16119 shutdown 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 msgr2=0x55b9d5dd5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd5f40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009930 tx=0x7fbba002cf70 comp rx=0 tx=0).stop 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 shutdown_connections 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5de89a0 0x55b9d5deae20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dd8970 0x55b9d5dd6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5dd5f40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 --2- 172.21.15.42:0/863872447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 >> 172.21.15.42:0/863872447 conn(0x55b9d5dc9ba0 msgr2=0x55b9d5dcb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.219+0000 7fbb8b7fe640 0 client.16119 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:06.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.220+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 shutdown_connections 2024-03-31T23:19:06.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.220+0000 7fbbb536a740 1 -- 172.21.15.42:0/863872447 wait complete. 2024-03-31T23:19:06.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.220+0000 7fbbb536a740 20 client.16119 trim_cache size 0 max 16384 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.233+0000 7fbbb536a740 1 Processor -- start 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.233+0000 7fbbb536a740 1 -- start start 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.233+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 0x55b9d5de4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dd8970 0x55b9d5df06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb536a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1ac8a0 con 0x55b9d5dd8970 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb536a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1ae3e0 con 0x55b9d5dcf470 2024-03-31T23:19:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb536a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1acf70 con 0x55b9d5dcfd90 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 0x55b9d5de4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbabfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 0x55b9d5de4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58618/0 (socket says 172.21.15.42:58618) 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 -- 172.21.15.42:0/2445353560 learned_addr learned my addr 172.21.15.42:0/2445353560 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dd8970 0x55b9d5df06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 -- 172.21.15.42:0/2445353560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 msgr2=0x55b9d5dd8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 -- 172.21.15.42:0/2445353560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dd8970 msgr2=0x55b9d5df06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dd8970 0x55b9d5df06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 -- 172.21.15.42:0/2445353560 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d5dce7f0 con 0x55b9d5dcfd90 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dd8970 0x55b9d5df06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.234+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 0x55b9d5de4500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbba002bc70 tx=0x7fbba0041dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95fa9f369a27c68 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.235+0000 7fbb91ffb640 1 -- 172.21.15.42:0/2445353560 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0003880 con 0x55b9d5dcfd90 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.235+0000 7fbb91ffb640 1 -- 172.21.15.42:0/2445353560 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba0003a20 con 0x55b9d5dcfd90 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.235+0000 7fbb91ffb640 1 -- 172.21.15.42:0/2445353560 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0004e40 con 0x55b9d5dcfd90 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.235+0000 7fbbb536a740 1 -- 172.21.15.42:0/2445353560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 msgr2=0x55b9d5de4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.235+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 0x55b9d5de4500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbba002bc70 tx=0x7fbba0041dc0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 -- 172.21.15.42:0/2445353560 shutdown_connections 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dd8970 0x55b9d5df06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcfd90 0x55b9d5de4500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2445353560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dcf470 0x55b9d5dd8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 -- 172.21.15.42:0/2445353560 >> 172.21.15.42:0/2445353560 conn(0x55b9d5dc9ba0 msgr2=0x55b9d5dd0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 -- 172.21.15.42:0/2445353560 shutdown_connections 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 -- 172.21.15.42:0/2445353560 wait complete. 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.236+0000 7fbbb536a740 1 -- start start 2024-03-31T23:19:06.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 Processor -- start 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 0x55b9d5de0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5ddc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1add10 con 0x55b9d5dcfd90 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1ad640 con 0x55b9d5dd8970 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbabfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 0x55b9d5de0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5ddc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1aa8b0 con 0x55b9d5dcf470 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbabfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 0x55b9d5de0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58626/0 (socket says 172.21.15.42:58626) 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbabfff640 1 -- 172.21.15.42:0/2273995087 learned_addr learned my addr 172.21.15.42:0/2273995087 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.237+0000 7fbbb536a740 10 client.0 _ll_register_callbacks cb 0x7fbba002cc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbabfff640 1 -- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dd8970 msgr2=0x55b9d5ddc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbabfff640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbabfff640 1 -- 172.21.15.42:0/2273995087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 msgr2=0x55b9d5ddc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbabfff640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5ddc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbabfff640 1 -- 172.21.15.42:0/2273995087 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d5ddcf60 con 0x55b9d5dcf470 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbb0c4c640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5ddc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbabfff640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 0x55b9d5de0e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c096e90 tx=0x7fbb9c00e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbc83aeffe0d4b4e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:06.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbb8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/2273995087 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c09a570 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba0003a20 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/2273995087 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fbb9c098d30 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.238+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/2273995087 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb9c09a390 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 10 client.25903 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b9d5e4ee20 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/2273995087 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba0003a20 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/2273995087 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbb9c0cd040 con 0x55b9d5dcf470 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 10 client.25903 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 20 client.25903 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5e4f540 0x55b9d5e51960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 4 client.25903 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:06.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9d5d406f0 con 0x55b9d5e4f540 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.239+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5e4f540 0x55b9d5e51960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbab7fe640 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5e4f540 0x55b9d5e51960 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746a411306054826 server_cookie=efbd0e940b1fbad4 in_seq=0 out_seq=0 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbb8b7fe640 10 client.25903 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbb8b7fe640 1 -- 172.21.15.42:0/2273995087 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9d5d406f0 con 0x55b9d5e4f540 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbb8b7fe640 10 client.25903 handle_command_reply: tid=0 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbb536a740 1 client.25903 shutdown 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 msgr2=0x55b9d5de0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 0x55b9d5de0e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c096e90 tx=0x7fbb9c00e040 comp rx=0 tx=0).stop 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 shutdown_connections 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b9d5e4f540 0x55b9d5e51960 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbb8b7fe640 0 client.25903 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.240+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9d5dd8970 0x55b9d5ddc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9d5dcfd90 0x55b9d5ddc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb536a740 1 --2- 172.21.15.42:0/2273995087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9d5dcf470 0x55b9d5de0e90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 >> 172.21.15.42:0/2273995087 conn(0x55b9d5dc9ba0 msgr2=0x55b9d5dc84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 shutdown_connections 2024-03-31T23:19:06.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb536a740 1 -- 172.21.15.42:0/2273995087 wait complete. 2024-03-31T23:19:06.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb536a740 20 client.25903 trim_cache size 0 max 16384 2024-03-31T23:19:06.248 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbb940a2800 msgr2=0x7fbb940a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.241+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbb940a2800 0x7fbb940a4cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbba4021000 tx=0x7fbba4022000 comp rx=0 tx=0).stop 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 msgr2=0x7fbbac195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 0x7fbbac195d20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00e7f0 tx=0x7fbb9c00ecb0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 shutdown_connections 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac106660 0x7fbbac19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbac100f80 0x7fbbac196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fbb940a2800 0x7fbb940a4cc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 --2- 172.21.15.42:0/1380843587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbac1005c0 0x7fbbac195d20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 >> 172.21.15.42:0/1380843587 conn(0x7fbbac077750 msgr2=0x7fbbac0feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 shutdown_connections 2024-03-31T23:19:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:06.242+0000 7fbbb26af640 1 -- 172.21.15.42:0/1380843587 wait complete. 2024-03-31T23:19:07.254 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-31T23:19:07.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:19:07.577 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 -- 172.21.15.42:0/1185705270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 msgr2=0x7f84b810d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 --2- 172.21.15.42:0/1185705270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 0x7f84b810d350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009c10 tx=0x7f84b002bee0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 -- 172.21.15.42:0/1185705270 shutdown_connections 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 --2- 172.21.15.42:0/1185705270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 0x7f84b810d350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 --2- 172.21.15.42:0/1185705270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b81004d0 0x7f84b8100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 --2- 172.21.15.42:0/1185705270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b8106590 0x7f84b8106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 -- 172.21.15.42:0/1185705270 >> 172.21.15.42:0/1185705270 conn(0x7f84b80fbfa0 msgr2=0x7f84b80fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 -- 172.21.15.42:0/1185705270 shutdown_connections 2024-03-31T23:19:07.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.696+0000 7f84bcdde640 1 -- 172.21.15.42:0/1185705270 wait complete. 2024-03-31T23:19:07.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.697+0000 7f84bcdde640 1 Processor -- start 2024-03-31T23:19:07.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.697+0000 7f84bcdde640 1 -- start start 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84bcdde640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 0x7f84b8197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 0x7f84b8197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 0x7f84b8197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54628/0 (socket says 172.21.15.42:54628) 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 -- 172.21.15.42:0/759306292 learned_addr learned my addr 172.21.15.42:0/759306292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 0x7f84b8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b8106590 0x7f84b819c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8111ae0 con 0x7f84b81004d0 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8111960 con 0x7f84b8100e90 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8111c60 con 0x7f84b8106590 2024-03-31T23:19:07.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b7fff640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b8106590 0x7f84b819c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 0x7f84b8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 -- 172.21.15.42:0/759306292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b8106590 msgr2=0x7f84b819c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b8106590 0x7f84b819c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 -- 172.21.15.42:0/759306292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 msgr2=0x7f84b8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 0x7f84b8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b77fe640 1 -- 172.21.15.42:0/759306292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b819ceb0 con 0x7f84b81004d0 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.698+0000 7f84b7fff640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b8106590 0x7f84b819c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.699+0000 7f84b77fe640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 0x7f84b8197ec0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e9c0 tx=0x7f84a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.699+0000 7f84b4ff9640 1 -- 172.21.15.42:0/759306292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a800cde0 con 0x7f84b81004d0 2024-03-31T23:19:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.699+0000 7f84b4ff9640 1 -- 172.21.15.42:0/759306292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84a80035f0 con 0x7f84b81004d0 2024-03-31T23:19:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.699+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b819d1a0 con 0x7f84b81004d0 2024-03-31T23:19:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.699+0000 7f84b4ff9640 1 -- 172.21.15.42:0/759306292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8010670 con 0x7f84b81004d0 2024-03-31T23:19:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.699+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b81a4a30 con 0x7f84b81004d0 2024-03-31T23:19:07.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 Processor -- start 2024-03-31T23:19:07.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 -- start start 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a91f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9a9ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f5d99920b0 con 0x55f5d9a91ba0 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f5d99f4ea0 con 0x55f5d9a924c0 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84c0c24740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f5d999dc00 con 0x55f5d9a9b0a0 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a91f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a91f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54632/0 (socket says 172.21.15.42:54632) 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 -- 172.21.15.42:0/2142150309 learned_addr learned my addr 172.21.15.42:0/2142150309 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 -- 172.21.15.42:0/2142150309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 msgr2=0x55f5d9a9d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a9d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 -- 172.21.15.42:0/2142150309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 msgr2=0x55f5d9a9ab60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9a9ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b7fff640 1 -- 172.21.15.42:0/2142150309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d97d17e0 con 0x55f5d9a91ba0 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.702+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a9d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.703+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a91f80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009be0 tx=0x7f84b0005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e051e99ac5eb01 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.703+0000 7f849dffb640 1 -- 172.21.15.42:0/2142150309 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0033520 con 0x55f5d9a91ba0 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.703+0000 7f849dffb640 1 -- 172.21.15.42:0/2142150309 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84b00336c0 con 0x55f5d9a91ba0 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.703+0000 7f849dffb640 1 -- 172.21.15.42:0/2142150309 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00419a0 con 0x55f5d9a91ba0 2024-03-31T23:19:07.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.703+0000 7f84b4ff9640 1 -- 172.21.15.42:0/759306292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f84a80037a0 con 0x7f84b81004d0 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 -- 172.21.15.42:0/2142150309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 msgr2=0x55f5d9a91f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a91f80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009be0 tx=0x7f84b0005ec0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 -- 172.21.15.42:0/2142150309 shutdown_connections 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a9d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9a9ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2142150309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a91f80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 -- 172.21.15.42:0/2142150309 >> 172.21.15.42:0/2142150309 conn(0x55f5d9a8c2d0 msgr2=0x55f5d9a8c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 -- 172.21.15.42:0/2142150309 shutdown_connections 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 -- 172.21.15.42:0/2142150309 wait complete. 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84b4ff9640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f84a00a26c0 0x7f84a00a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84b4ff9640 1 -- 172.21.15.42:0/759306292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f84a80cf340 con 0x7f84b81004d0 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.704+0000 7f84c0c24740 1 -- start start 2024-03-31T23:19:07.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.705+0000 7f84c0c24740 1 Processor -- start 2024-03-31T23:19:07.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.705+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f84a00a26c0 0x7f84a00a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.705+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f84a00a26c0 0x7f84a00a4b80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f5d9a8d460 tx=0x7f84ac005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.705+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a98110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 0x55f5d9a98650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a98b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 0x55f5d9a98650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a98110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 0x55f5d9a98650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54640/0 (socket says 172.21.15.42:54640) 2024-03-31T23:19:07.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a98110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33428/0 (socket says 172.21.15.42:33428) 2024-03-31T23:19:07.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84b6ffd640 1 -- 172.21.15.42:0/333545055 learned_addr learned my addr 172.21.15.42:0/333545055 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f5d99933d0 con 0x55f5d9a924c0 2024-03-31T23:19:07.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84b7fff640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a98b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f5d99f0f40 con 0x55f5d9a91ba0 2024-03-31T23:19:07.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.706+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f5d9a9de30 con 0x55f5d9a9b0a0 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b6ffd640 1 -- 172.21.15.42:0/333545055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 msgr2=0x55f5d9a98b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a98b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b6ffd640 1 -- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 msgr2=0x55f5d9a98110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a98110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b6ffd640 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d9831f70 con 0x55f5d9a924c0 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b77fe640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a98110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b7fff640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a98b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 0x55f5d9a98650 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f84ac011940 tx=0x7f84ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a0ea2b9a5b4b34 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f8496ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84c0c24740 10 client.0 _ll_register_callbacks cb 0x55f5d99b0b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b00336c0 con 0x55f5d9a924c0 2024-03-31T23:19:07.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f8496ffd640 1 -- 172.21.15.42:0/333545055 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac01ed90 con 0x55f5d9a924c0 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f8496ffd640 1 -- 172.21.15.42:0/333545055 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f84ac01c460 con 0x55f5d9a924c0 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f8496ffd640 1 -- 172.21.15.42:0/333545055 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84ac01c660 con 0x55f5d9a924c0 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84c0c24740 10 client.16137 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.707+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f5d96c9170 con 0x55f5d9a924c0 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f8496ffd640 1 -- 172.21.15.42:0/333545055 <== mon.0 v2:172.21.15.42:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f84ac025070 con 0x55f5d9a924c0 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84c0c24740 10 client.16137 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84c0c24740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84c0c24740 20 client.16137 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84c0c24740 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9aaac50 0x55f5d9aad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84c0c24740 4 client.16137 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5d9a023e0 con 0x55f5d9aaac50 2024-03-31T23:19:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84b77fe640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9aaac50 0x55f5d9aad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f8496ffd640 10 client.16137 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.708+0000 7f84b77fe640 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9aaac50 0x55f5d9aad060 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47da528dfd5bd759 server_cookie=f1f0d1122a9c6f82 in_seq=0 out_seq=0 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.709+0000 7f8496ffd640 1 -- 172.21.15.42:0/333545055 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f5d9a023e0 con 0x55f5d9aaac50 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.709+0000 7f8496ffd640 10 client.16137 handle_command_reply: tid=0 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.709+0000 7f84c0c24740 1 client.16137 shutdown 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.709+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 msgr2=0x55f5d9a98650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.709+0000 7f84c0c24740 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 0x55f5d9a98650 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f84ac011940 tx=0x7f84ac0046c0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 shutdown_connections 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9aaac50 0x55f5d9aad060 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a9b0a0 0x55f5d9a98b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a924c0 0x55f5d9a98650 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f8496ffd640 0 client.16137 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 --2- 172.21.15.42:0/333545055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a98110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 >> 172.21.15.42:0/333545055 conn(0x55f5d9a8c2d0 msgr2=0x55f5d9a8e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 shutdown_connections 2024-03-31T23:19:07.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 1 -- 172.21.15.42:0/333545055 wait complete. 2024-03-31T23:19:07.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.710+0000 7f84c0c24740 20 client.16137 trim_cache size 0 max 16384 2024-03-31T23:19:07.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.727+0000 7f84c0c24740 1 Processor -- start 2024-03-31T23:19:07.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.727+0000 7f84c0c24740 1 -- start start 2024-03-31T23:19:07.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a97050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 0x55f5d9aa6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9ab2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84c0c24740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81b50c0 con 0x55f5d9a8c2d0 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84c0c24740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81b6c00 con 0x55f5d9a924c0 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84c0c24740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81b5790 con 0x55f5d9a91ba0 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 0x55f5d9aa6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 0x55f5d9aa6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58682/0 (socket says 172.21.15.42:58682) 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a97050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b6ffd640 1 -- 172.21.15.42:0/2087510462 learned_addr learned my addr 172.21.15.42:0/2087510462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9ab2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 -- 172.21.15.42:0/2087510462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 msgr2=0x55f5d9aa6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 0x55f5d9aa6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 -- 172.21.15.42:0/2087510462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a8c2d0 msgr2=0x55f5d9a97050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a97050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 -- 172.21.15.42:0/2087510462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d9a9ab10 con 0x55f5d9a924c0 2024-03-31T23:19:07.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 0x55f5d9aa6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.728+0000 7f84b7fff640 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9ab2930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009b30 tx=0x7f84b002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379d1330f43a5b82 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.729+0000 7f849d7fa640 1 -- 172.21.15.42:0/2087510462 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0003970 con 0x55f5d9a924c0 2024-03-31T23:19:07.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.729+0000 7f849d7fa640 1 -- 172.21.15.42:0/2087510462 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84b002cd80 con 0x55f5d9a924c0 2024-03-31T23:19:07.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.729+0000 7f849d7fa640 1 -- 172.21.15.42:0/2087510462 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0004690 con 0x55f5d9a924c0 2024-03-31T23:19:07.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 -- 172.21.15.42:0/2087510462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 msgr2=0x55f5d9ab2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9ab2930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009b30 tx=0x7f84b002bee0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 -- 172.21.15.42:0/2087510462 shutdown_connections 2024-03-31T23:19:07.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9ab2930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a91ba0 0x55f5d9aa6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 --2- 172.21.15.42:0/2087510462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a97050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 -- 172.21.15.42:0/2087510462 >> 172.21.15.42:0/2087510462 conn(0x55f5d9a97d10 msgr2=0x55f5d9a8df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 -- 172.21.15.42:0/2087510462 shutdown_connections 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 -- 172.21.15.42:0/2087510462 wait complete. 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 -- start start 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.730+0000 7f84c0c24740 1 Processor -- start 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a9f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a9f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9b0ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a9f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58690/0 (socket says 172.21.15.42:58690) 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b77fe640 1 -- 172.21.15.42:0/1388430127 learned_addr learned my addr 172.21.15.42:0/1388430127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81b6530 con 0x55f5d9a91ba0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81b5e60 con 0x55f5d9a924c0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81b3080 con 0x55f5d9a8c2d0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84c0c24740 10 client.0 _ll_register_callbacks cb 0x7f84ac0115f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b7fff640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9b0ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b6ffd640 1 -- 172.21.15.42:0/1388430127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 msgr2=0x55f5d9a9f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a9f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b6ffd640 1 -- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 msgr2=0x55f5d9b0ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9b0ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b6ffd640 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d9b104a0 con 0x55f5d9a91ba0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b7fff640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9b0ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.731+0000 7f84b77fe640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a9f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f84b6ffd640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a9f600 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f84ac01e7d0 tx=0x7f84ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad0c28e73ea8938 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f8496ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:07.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f8496ffd640 1 -- 172.21.15.42:0/1388430127 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac03a070 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f8496ffd640 1 -- 172.21.15.42:0/1388430127 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f84ac004250 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b002cd80 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f8496ffd640 1 -- 172.21.15.42:0/1388430127 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84ac046050 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f84c0c24740 10 client.16143 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.732+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5d9b11790 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f8496ffd640 1 -- 172.21.15.42:0/1388430127 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84b00336c0 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f8496ffd640 1 -- 172.21.15.42:0/1388430127 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f84ac025050 con 0x55f5d9a91ba0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84c0c24740 10 client.16143 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84c0c24740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84c0c24740 20 client.16143 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84c0c24740 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9a9b0a0 0x55f5d9b13e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84c0c24740 4 client.16143 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f84b002cd80 con 0x55f5d9a9b0a0 2024-03-31T23:19:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f84b77fe640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9a9b0a0 0x55f5d9b13e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.733+0000 7f8496ffd640 10 client.16143 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.734+0000 7f84b77fe640 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9a9b0a0 0x55f5d9b13e60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92cb3e24ef8f47d0 server_cookie=4627628deed2759b in_seq=0 out_seq=0 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.735+0000 7f8496ffd640 1 -- 172.21.15.42:0/1388430127 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f84b002cd80 con 0x55f5d9a9b0a0 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.735+0000 7f8496ffd640 10 client.16143 handle_command_reply: tid=0 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.735+0000 7f84c0c24740 1 client.16143 shutdown 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.735+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 msgr2=0x55f5d9a9f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.735+0000 7f84c0c24740 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a9f600 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f84ac01e7d0 tx=0x7f84ac019000 comp rx=0 tx=0).stop 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 shutdown_connections 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f5d9a9b0a0 0x55f5d9b13e60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f5d9a924c0 0x55f5d9b0ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f8496ffd640 0 client.16143 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f5d9a91ba0 0x55f5d9a9f600 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 --2- 172.21.15.42:0/1388430127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5d9a8c2d0 0x55f5d9a9f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 >> 172.21.15.42:0/1388430127 conn(0x55f5d9a97d10 msgr2=0x55f5d9a8a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 shutdown_connections 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 1 -- 172.21.15.42:0/1388430127 wait complete. 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.736+0000 7f84c0c24740 20 client.16143 trim_cache size 0 max 16384 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "81dfe7c8-dcb3-4d3d-89ce-05793d6264ac", 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-03-31T23:19:07.741 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f84a00a26c0 msgr2=0x7f84a00a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f84a00a26c0 0x7f84a00a4b80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f5d9a8d460 tx=0x7f84ac005f90 comp rx=0 tx=0).stop 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 msgr2=0x7f84b8197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 0x7f84b8197ec0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e9c0 tx=0x7f84a800ee80 comp rx=0 tx=0).stop 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 shutdown_connections 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84b8106590 0x7f84b819c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b8100e90 0x7f84b8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f84a00a26c0 0x7f84a00a4b80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 --2- 172.21.15.42:0/759306292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84b81004d0 0x7f84b8197ec0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.737+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 >> 172.21.15.42:0/759306292 conn(0x7f84b80fbfa0 msgr2=0x7f84b80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.738+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 shutdown_connections 2024-03-31T23:19:07.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.738+0000 7f84bcdde640 1 -- 172.21.15.42:0/759306292 wait complete. 2024-03-31T23:19:07.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:19:07.750 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 -- 172.21.15.42:0/1551143193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 msgr2=0x7f39d8100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/1551143193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8100070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009860 tx=0x7f39cc02bb70 comp rx=0 tx=0).stop 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 -- 172.21.15.42:0/1551143193 shutdown_connections 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/1551143193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81005b0 0x7f39d810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/1551143193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8100070 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/1551143193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81076f0 0x7f39d8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 -- 172.21.15.42:0/1551143193 >> 172.21.15.42:0/1551143193 conn(0x7f39d8076b70 msgr2=0x7f39d80fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 -- 172.21.15.42:0/1551143193 shutdown_connections 2024-03-31T23:19:07.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.856+0000 7f39dd5c7640 1 -- 172.21.15.42:0/1551143193 wait complete. 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 Processor -- start 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 -- start start 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81005b0 0x7f39d8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81076f0 0x7f39d819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39d8111c00 con 0x7f39d81076f0 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39d8111a80 con 0x7f39d80ffbf0 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39dd5c7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39d8111d80 con 0x7f39d81005b0 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33476/0 (socket says 172.21.15.42:33476) 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2805816018 learned_addr learned my addr 172.21.15.42:0/2805816018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81005b0 0x7f39d8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.857+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81076f0 0x7f39d819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2805816018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81005b0 msgr2=0x7f39d8198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81005b0 0x7f39d8198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81076f0 msgr2=0x7f39d819c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81076f0 0x7f39d819c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2805816018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d819d0f0 con 0x7f39d80ffbf0 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81005b0 0x7f39d8198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81076f0 0x7f39d819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8198100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e9f0 tx=0x7f39c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39bffff640 1 -- 172.21.15.42:0/2805816018 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c800ccc0 con 0x7f39d80ffbf0 2024-03-31T23:19:07.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39bffff640 1 -- 172.21.15.42:0/2805816018 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39c8005520 con 0x7f39d80ffbf0 2024-03-31T23:19:07.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d819d3e0 con 0x7f39d80ffbf0 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39bffff640 1 -- 172.21.15.42:0/2805816018 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8010690 con 0x7f39d80ffbf0 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.858+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d81a4c70 con 0x7f39d80ffbf0 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 Processor -- start 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 -- start start 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d05e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05ebb0 0x55575d067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 0x55575d069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55575cfc2180 con 0x55575d067790 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55575cf6ab70 con 0x55575d05ebb0 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39e01a3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55575cfbe220 con 0x55575d05e290 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39bffff640 1 -- 172.21.15.42:0/2805816018 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f39c8010830 con 0x7f39d80ffbf0 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39d67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 0x55575d069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39d67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 0x55575d069b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54686/0 (socket says 172.21.15.42:54686) 2024-03-31T23:19:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39d67fc640 1 -- 172.21.15.42:0/2405077107 learned_addr learned my addr 172.21.15.42:0/2405077107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d05e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.861+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05ebb0 0x55575d067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d67fc640 1 -- 172.21.15.42:0/2405077107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 msgr2=0x55575d05e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d05e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d67fc640 1 -- 172.21.15.42:0/2405077107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05ebb0 msgr2=0x55575d067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05ebb0 0x55575d067250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d67fc640 1 -- 172.21.15.42:0/2405077107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cf7e7c0 con 0x55575d067790 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05ebb0 0x55575d067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d05e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39bffff640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f39c00a27b0 0x7f39c00a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 0x55575d069b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009860 tx=0x7f39cc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965f18c6a12d22aa server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39bffff640 1 -- 172.21.15.42:0/2805816018 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f39c80cf3a0 con 0x7f39d80ffbf0 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f39c00a27b0 0x7f39c00a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39bd7fa640 1 -- 172.21.15.42:0/2405077107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc044020 con 0x55575d067790 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39bd7fa640 1 -- 172.21.15.42:0/2405077107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39cc034940 con 0x55575d067790 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.862+0000 7f39bd7fa640 1 -- 172.21.15.42:0/2405077107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc039040 con 0x55575d067790 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 -- 172.21.15.42:0/2405077107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 msgr2=0x55575d069b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f39c00a27b0 0x7f39c00a4c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d0005fd0 tx=0x7f39d0009500 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 0x55575d069b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009860 tx=0x7f39cc0056d0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 -- 172.21.15.42:0/2405077107 shutdown_connections 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d067790 0x55575d069b80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05ebb0 0x55575d067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2405077107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d05e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 -- 172.21.15.42:0/2405077107 >> 172.21.15.42:0/2405077107 conn(0x55575d0589c0 msgr2=0x55575d058da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 -- 172.21.15.42:0/2405077107 shutdown_connections 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.863+0000 7f39e01a3740 1 -- 172.21.15.42:0/2405077107 wait complete. 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 -- start start 2024-03-31T23:19:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 Processor -- start 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d0647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d065250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55575d06a520 con 0x55575d05ebb0 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55575cf604a0 con 0x55575d067790 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55575d06a6a0 con 0x55575d05e290 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.864+0000 7f39e01a3740 10 client.0 _ll_register_callbacks cb 0x55575cf63d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d0647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d0647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58728/0 (socket says 172.21.15.42:58728) 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 -- 172.21.15.42:0/1776876851 learned_addr learned my addr 172.21.15.42:0/1776876851 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d77fe640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d67fc640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 -- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 msgr2=0x55575d065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d065250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 -- 172.21.15.42:0/1776876851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 msgr2=0x55575d064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 -- 172.21.15.42:0/1776876851 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575cda07d0 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d67fc640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d0647d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e9c0 tx=0x7f39c80d2ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eceb1aaccab9656 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39baff5640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39baff5640 1 -- 172.21.15.42:0/1776876851 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c809b330 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39cc034940 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.865+0000 7f39baff5640 1 -- 172.21.15.42:0/1776876851 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f39c80a3ce0 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39baff5640 1 -- 172.21.15.42:0/1776876851 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39c800ce60 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 10 client.25927 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55575ccd63f0 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39baff5640 1 -- 172.21.15.42:0/1776876851 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39cc034940 con 0x55575d05e290 2024-03-31T23:19:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39baff5640 1 -- 172.21.15.42:0/1776876851 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39c80cc8e0 con 0x55575d05e290 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 10 client.25927 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 10 client.25927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 20 client.25927 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d07bec0 0x55575d07e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 4 client.25927 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55575cfcf6c0 con 0x55575d07bec0 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.866+0000 7f39d67fc640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d07bec0 0x55575d07e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.867+0000 7f39baff5640 10 client.25927 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.867+0000 7f39d67fc640 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d07bec0 0x55575d07e380 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43103cb431c2f36b server_cookie=978d810237edf939 in_seq=0 out_seq=0 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39baff5640 1 -- 172.21.15.42:0/1776876851 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55575cfcf6c0 con 0x55575d07bec0 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39baff5640 10 client.25927 handle_command_reply: tid=0 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 client.25927 shutdown 2024-03-31T23:19:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 msgr2=0x55575d0647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d0647d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e9c0 tx=0x7f39c80d2ba0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 shutdown_connections 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d07bec0 0x55575d07e380 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39baff5640 0 client.25927 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 --2- 172.21.15.42:0/1776876851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05e290 0x55575d0647d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 >> 172.21.15.42:0/1776876851 conn(0x55575d0589c0 msgr2=0x55575d05a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 shutdown_connections 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 1 -- 172.21.15.42:0/1776876851 wait complete. 2024-03-31T23:19:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.868+0000 7f39e01a3740 20 client.25927 trim_cache size 0 max 16384 2024-03-31T23:19:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 Processor -- start 2024-03-31T23:19:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 -- start start 2024-03-31T23:19:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 0x55575d066f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d077780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 0x55575d083c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39d81aca20 con 0x55575d05ebb0 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39d81ae560 con 0x55575d05e290 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39e01a3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39d81ad0f0 con 0x55575d067790 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39d77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 0x55575d083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39d67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d077780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 0x55575d066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.903+0000 7f39d77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 0x55575d083c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:58736/0 (socket says 172.21.15.42:58736) 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d077780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54704/0 (socket says 172.21.15.42:54704) 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 0x55575d066f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:33508/0 (socket says 172.21.15.42:33508) 2024-03-31T23:19:07.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d77fe640 1 -- 172.21.15.42:0/2076872499 learned_addr learned my addr 172.21.15.42:0/2076872499 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2076872499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 msgr2=0x55575d083c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 0x55575d083c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2076872499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 msgr2=0x55575d077780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d077780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2076872499 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cc960f0 con 0x55575d05e290 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 0x55575d083c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 0x55575d066f00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39c80979c0 tx=0x7f39c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511cb47d22a97cee server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39bcff9640 1 -- 172.21.15.42:0/2076872499 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c80d6020 con 0x55575d05e290 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39bcff9640 1 -- 172.21.15.42:0/2076872499 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39c80cc540 con 0x55575d05e290 2024-03-31T23:19:07.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.904+0000 7f39bcff9640 1 -- 172.21.15.42:0/2076872499 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c809aec0 con 0x55575d05e290 2024-03-31T23:19:07.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 -- 172.21.15.42:0/2076872499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 msgr2=0x55575d066f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 0x55575d066f00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39c80979c0 tx=0x7f39c8004a40 comp rx=0 tx=0).stop 2024-03-31T23:19:07.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 -- 172.21.15.42:0/2076872499 shutdown_connections 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d067790 0x55575d083c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05ebb0 0x55575d077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2076872499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d05e290 0x55575d066f00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.905+0000 7f39e01a3740 1 -- 172.21.15.42:0/2076872499 >> 172.21.15.42:0/2076872499 conn(0x55575d0589c0 msgr2=0x55575d057c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.906+0000 7f39e01a3740 1 -- 172.21.15.42:0/2076872499 shutdown_connections 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.906+0000 7f39e01a3740 1 -- 172.21.15.42:0/2076872499 wait complete. 2024-03-31T23:19:07.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.906+0000 7f39e01a3740 1 -- start start 2024-03-31T23:19:07.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.906+0000 7f39e01a3740 1 Processor -- start 2024-03-31T23:19:07.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 0x55575d074020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05ebb0 0x55575d0614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d061a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39d81ade90 con 0x55575d05e290 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 0x55575d074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 0x55575d074020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54718/0 (socket says 172.21.15.42:54718) 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2547826813 learned_addr learned my addr 172.21.15.42:0/2547826813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05ebb0 0x55575d0614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39d81ad7c0 con 0x55575d067790 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39d81aa9e0 con 0x55575d05ebb0 2024-03-31T23:19:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d061a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39e01a3740 10 client.0 _ll_register_callbacks cb 0x7f39c8097140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2547826813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05ebb0 msgr2=0x55575d0614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05ebb0 0x55575d0614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 msgr2=0x55575d061a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d061a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 -- 172.21.15.42:0/2547826813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575d062250 con 0x55575d05e290 2024-03-31T23:19:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d77fe640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d061a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39d6ffd640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 0x55575d074020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f39c809f220 tx=0x7f39c809f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937ef9f31c9dfc14 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.907+0000 7f39baff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39baff5640 1 -- 172.21.15.42:0/2547826813 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c80d6070 con 0x55575d05e290 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39c80cc540 con 0x55575d05e290 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39baff5640 1 -- 172.21.15.42:0/2547826813 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f39c80bb0d0 con 0x55575d05e290 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39baff5640 1 -- 172.21.15.42:0/2547826813 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39c809b0a0 con 0x55575d05e290 2024-03-31T23:19:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 10 client.16161 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55575d0de210 con 0x55575d05e290 2024-03-31T23:19:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39baff5640 1 -- 172.21.15.42:0/2547826813 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39c80cc540 con 0x55575d05e290 2024-03-31T23:19:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39baff5640 1 -- 172.21.15.42:0/2547826813 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39c8089080 con 0x55575d05e290 2024-03-31T23:19:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 10 client.16161 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 20 client.16161 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d0de540 0x55575d0e09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 4 client.16161 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:19:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.908+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55575cfc9a10 con 0x55575d0de540 2024-03-31T23:19:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d0de540 0x55575d0e09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39baff5640 10 client.16161 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39d67fc640 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d0de540 0x55575d0e09a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd0c2a041f07e608 server_cookie=376fffcf5647dca5 in_seq=0 out_seq=0 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39baff5640 1 -- 172.21.15.42:0/2547826813 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55575cfc9a10 con 0x55575d0de540 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39baff5640 10 client.16161 handle_command_reply: tid=0 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 client.16161 shutdown 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 msgr2=0x55575d074020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 0x55575d074020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f39c809f220 tx=0x7f39c809f4b0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 shutdown_connections 2024-03-31T23:19:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55575d0de540 0x55575d0e09a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39baff5640 0 client.16161 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55575d067790 0x55575d061a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55575d05ebb0 0x55575d0614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 --2- 172.21.15.42:0/2547826813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55575d05e290 0x55575d074020 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.909+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 >> 172.21.15.42:0/2547826813 conn(0x55575d0589c0 msgr2=0x55575d059b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 shutdown_connections 2024-03-31T23:19:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39e01a3740 1 -- 172.21.15.42:0/2547826813 wait complete. 2024-03-31T23:19:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39e01a3740 20 client.16161 trim_cache size 0 max 16384 2024-03-31T23:19:07.922 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:19:07.922 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-31T23:19:07.922 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-03-31T23:19:07.923 INFO:teuthology.orchestra.run.smithi042.stdout: "81dfe7c8-dcb3-4d3d-89ce-05793d6264ac": { 2024-03-31T23:19:07.923 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-03-31T23:19:07.923 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "81dfe7c8-dcb3-4d3d-89ce-05793d6264ac", 2024-03-31T23:19:07.923 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-03-31T23:19:07.923 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:19:07.923 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:19:07.924 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:19:07.925 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:07 smithi094 ceph-mon[36167]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-03-31T23:19:07.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f39c00a27b0 msgr2=0x7f39c00a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f39c00a27b0 0x7f39c00a4c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d0005fd0 tx=0x7f39d0009500 comp rx=0 tx=0).stop 2024-03-31T23:19:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 msgr2=0x7f39d8198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8198100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e9f0 tx=0x7f39c800eeb0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 shutdown_connections 2024-03-31T23:19:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f39c00a27b0 0x7f39c00a4c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39d81076f0 0x7f39d819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d81005b0 0x7f39d8198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 --2- 172.21.15.42:0/2805816018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39d80ffbf0 0x7f39d8198100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 >> 172.21.15.42:0/2805816018 conn(0x7f39d8076b70 msgr2=0x7f39d80fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 shutdown_connections 2024-03-31T23:19:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:07.910+0000 7f39dd5c7640 1 -- 172.21.15.42:0/2805816018 wait complete. 2024-03-31T23:19:07.928 INFO:tasks.cephfs.filesystem:scrub status for tag:81dfe7c8-dcb3-4d3d-89ce-05793d6264ac - {'path': '/', 'tag': '81dfe7c8-dcb3-4d3d-89ce-05793d6264ac', 'options': 'recursive,force'} 2024-03-31T23:19:07.928 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:07 smithi042 ceph-mon[32380]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-03-31T23:19:07.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:07 smithi188 ceph-mon[36068]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-03-31T23:19:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:09 smithi094 ceph-mon[36167]: scrub queued for path: / 2024-03-31T23:19:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:09 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:09 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:19:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:09 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:09 smithi094 ceph-mon[36167]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-03-31T23:19:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:09 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:19:09.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:09 smithi188 ceph-mon[36068]: scrub queued for path: / 2024-03-31T23:19:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:09 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:09 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:19:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:09 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:09 smithi188 ceph-mon[36068]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-03-31T23:19:09.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:09 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:19:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:09 smithi042 ceph-mon[32380]: scrub queued for path: / 2024-03-31T23:19:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:09 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:10.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:09 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:19:10.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:09 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:10.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:09 smithi042 ceph-mon[32380]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-03-31T23:19:10.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:09 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:19:11.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:11 smithi094 ceph-mon[36167]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-03-31T23:19:11.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:11 smithi188 ceph-mon[36068]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-03-31T23:19:12.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:11 smithi042 ceph-mon[32380]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-03-31T23:19:13.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:13 smithi094 ceph-mon[36167]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 30 op/s 2024-03-31T23:19:13.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:13 smithi188 ceph-mon[36068]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 30 op/s 2024-03-31T23:19:14.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:13 smithi042 ceph-mon[32380]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 30 op/s 2024-03-31T23:19:15.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:15 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-31T23:19:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:19:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:15 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:15.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:15 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:16.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:16 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:19:16.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:16 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:19:16.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:16 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:16 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:19:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:16 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:19:16.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:16 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:16 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:19:16.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:16 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:19:16.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:16 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:19:17.907 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 -- 172.21.15.42:0/3461706476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000101260 msgr2=0x7f900010d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.907 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 --2- 172.21.15.42:0/3461706476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000101260 0x7f900010d480 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009ca0 tx=0x7f8ff802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 -- 172.21.15.42:0/3461706476 shutdown_connections 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 --2- 172.21.15.42:0/3461706476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000101260 0x7f900010d480 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 --2- 172.21.15.42:0/3461706476 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90001008a0 0x7f9000100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 --2- 172.21.15.42:0/3461706476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90001055f0 0x7f90001059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 -- 172.21.15.42:0/3461706476 >> 172.21.15.42:0/3461706476 conn(0x7f90000774a0 msgr2=0x7f90000778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 -- 172.21.15.42:0/3461706476 shutdown_connections 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.903+0000 7f9007c07640 1 -- 172.21.15.42:0/3461706476 wait complete. 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 Processor -- start 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 -- start start 2024-03-31T23:19:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90001008a0 0x7f9000198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9000101260 0x7f9000198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 0x7f900019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9000110c30 con 0x7f90001055f0 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9000110ab0 con 0x7f9000101260 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f9007c07640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9000110db0 con 0x7f90001008a0 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 0x7f900019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 0x7f900019c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53212/0 (socket says 172.21.15.42:53212) 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 -- 172.21.15.42:0/1196425042 learned_addr learned my addr 172.21.15.42:0/1196425042 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90059a3640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90001008a0 0x7f9000198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90051a2640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9000101260 0x7f9000198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 -- 172.21.15.42:0/1196425042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90001008a0 msgr2=0x7f9000198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90001008a0 0x7f9000198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 -- 172.21.15.42:0/1196425042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9000101260 msgr2=0x7f9000198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9000101260 0x7f9000198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.904+0000 7f90061a4640 1 -- 172.21.15.42:0/1196425042 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900019d030 con 0x7f90001055f0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.905+0000 7f90061a4640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 0x7f900019c900 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8005e30 tx=0x7f8ff8034440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.905+0000 7f8ff6ffd640 1 -- 172.21.15.42:0/1196425042 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8039050 con 0x7f90001055f0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.905+0000 7f8ff6ffd640 1 -- 172.21.15.42:0/1196425042 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ff8045070 con 0x7f90001055f0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.905+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900019d2c0 con 0x7f90001055f0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.905+0000 7f8ff6ffd640 1 -- 172.21.15.42:0/1196425042 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8004630 con 0x7f90001055f0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.905+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001a4bb0 con 0x7f90001055f0 2024-03-31T23:19:17.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.907+0000 7f8ff6ffd640 1 -- 172.21.15.42:0/1196425042 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f8ff8003970 con 0x7f90001055f0 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.907+0000 7f8ff6ffd640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8fec0a2850 0x7f8fec0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.907+0000 7f90059a3640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8fec0a2850 0x7f8fec0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.907+0000 7f8ff6ffd640 1 -- 172.21.15.42:0/1196425042 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8ff80f1600 con 0x7f90001055f0 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.908+0000 7f90059a3640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8fec0a2850 0x7f8fec0a4d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009bd0 tx=0x7f8ff0005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.908+0000 7f900a7ef740 1 Processor -- start 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 -- start start 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba61daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba626870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba6291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5565ba5808f0 con 0x5565ba626db0 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5565ba5298d0 con 0x5565ba61dfe0 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f900a7ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5565ba57c990 con 0x5565ba61d6c0 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba6291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90059a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba61daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90051a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba626870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba6291a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53220/0 (socket says 172.21.15.42:53220) 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 -- 172.21.15.42:0/1923657543 learned_addr learned my addr 172.21.15.42:0/1923657543 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 -- 172.21.15.42:0/1923657543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 msgr2=0x5565ba61daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba61daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 -- 172.21.15.42:0/1923657543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 msgr2=0x5565ba626870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba626870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90061a4640 1 -- 172.21.15.42:0/1923657543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ba295210 con 0x5565ba626db0 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.909+0000 7f90051a2640 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba626870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.910+0000 7f90061a4640 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba6291a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80ba350 tx=0x7f8ff80bd580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef189468b126b83 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.910+0000 7f8febfff640 1 -- 172.21.15.42:0/1923657543 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80c62e0 con 0x5565ba626db0 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.910+0000 7f8febfff640 1 -- 172.21.15.42:0/1923657543 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ff803a040 con 0x5565ba626db0 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.910+0000 7f8febfff640 1 -- 172.21.15.42:0/1923657543 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8003c60 con 0x5565ba626db0 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.910+0000 7f900a7ef740 1 -- 172.21.15.42:0/1923657543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 msgr2=0x5565ba6291a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.910+0000 7f900a7ef740 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba6291a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80ba350 tx=0x7f8ff80bd580 comp rx=0 tx=0).stop 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 -- 172.21.15.42:0/1923657543 shutdown_connections 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba6291a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba626870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 --2- 172.21.15.42:0/1923657543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba61daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 -- 172.21.15.42:0/1923657543 >> 172.21.15.42:0/1923657543 conn(0x5565ba617fe0 msgr2=0x5565ba6183c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 -- 172.21.15.42:0/1923657543 shutdown_connections 2024-03-31T23:19:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 -- 172.21.15.42:0/1923657543 wait complete. 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 -- start start 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 Processor -- start 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba623e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 0x5565ba624360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba626db0 0x5565ba6248a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.911+0000 7f900a7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5565ba6297a0 con 0x5565ba61dfe0 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f900a7ef740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5565ba51ef80 con 0x5565ba626db0 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f900a7ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5565ba629920 con 0x5565ba61d6c0 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f900a7ef740 10 client.0 _ll_register_callbacks cb 0x5565ba577290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 0x5565ba624360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 0x5565ba624360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53236/0 (socket says 172.21.15.42:53236) 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 -- 172.21.15.42:0/2276784375 learned_addr learned my addr 172.21.15.42:0/2276784375 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90059a3640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba623e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90061a4640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba626db0 0x5565ba6248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 -- 172.21.15.42:0/2276784375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 msgr2=0x5565ba623e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba623e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 -- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba626db0 msgr2=0x5565ba6248a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba626db0 0x5565ba6248a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 -- 172.21.15.42:0/2276784375 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565ba361620 con 0x5565ba61dfe0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f90051a2640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 0x5565ba624360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc012720 tx=0x7f8ffc012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11253566ff4d1dc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f8fe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f8fe97fa640 1 -- 172.21.15.42:0/2276784375 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc004030 con 0x5565ba61dfe0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f8fe97fa640 1 -- 172.21.15.42:0/2276784375 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8ffc0041d0 con 0x5565ba61dfe0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ff803a040 con 0x5565ba61dfe0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f8fe97fa640 1 -- 172.21.15.42:0/2276784375 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ffc025050 con 0x5565ba61dfe0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f900a7ef740 10 client.16173 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.912+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5565ba635690 con 0x5565ba61dfe0 2024-03-31T23:19:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f8fe97fa640 1 -- 172.21.15.42:0/2276784375 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ff803a040 con 0x5565ba61dfe0 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f8fe97fa640 1 -- 172.21.15.42:0/2276784375 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8ffc003bf0 con 0x5565ba61dfe0 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f900a7ef740 10 client.16173 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f900a7ef740 10 client.16173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f900a7ef740 20 client.16173 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f900a7ef740 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba636b50 0x5565ba638f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f900a7ef740 4 client.16173 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565ba594120 con 0x5565ba636b50 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f90059a3640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba636b50 0x5565ba638f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f8fe97fa640 10 client.16173 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.913+0000 7f90059a3640 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba636b50 0x5565ba638f60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d342d449c3f6a495 server_cookie=6d2f7b9edbfdd134 in_seq=0 out_seq=0 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f8fe97fa640 1 -- 172.21.15.42:0/2276784375 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5565ba594120 con 0x5565ba636b50 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f8fe97fa640 10 client.16173 handle_command_reply: tid=0 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 client.16173 shutdown 2024-03-31T23:19:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 msgr2=0x5565ba624360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 0x5565ba624360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc012720 tx=0x7f8ffc012be0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 shutdown_connections 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba636b50 0x5565ba638f60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba626db0 0x5565ba6248a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba61dfe0 0x5565ba624360 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f8fe97fa640 0 client.16173 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 --2- 172.21.15.42:0/2276784375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba623e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 >> 172.21.15.42:0/2276784375 conn(0x5565ba617fe0 msgr2=0x5565ba619d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 shutdown_connections 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.914+0000 7f900a7ef740 1 -- 172.21.15.42:0/2276784375 wait complete. 2024-03-31T23:19:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.915+0000 7f900a7ef740 20 client.16173 trim_cache size 0 max 16384 2024-03-31T23:19:17.924 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:17 smithi094 ceph-mon[36167]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 597 B/s wr, 14 op/s 2024-03-31T23:19:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 Processor -- start 2024-03-31T23:19:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 -- start start 2024-03-31T23:19:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba626550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba6324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba619b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90001aeb30 con 0x5565ba626db0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f90001b0670 con 0x5565ba61dfe0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f900a7ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f90001af200 con 0x5565ba61d6c0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba619b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.945+0000 7f90059a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba626550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba619b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53240/0 (socket says 172.21.15.42:53240) 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90051a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba6324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 -- 172.21.15.42:0/4190288418 learned_addr learned my addr 172.21.15.42:0/4190288418 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 -- 172.21.15.42:0/4190288418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 msgr2=0x5565ba626550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba626550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 -- 172.21.15.42:0/4190288418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 msgr2=0x5565ba6324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba6324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 -- 172.21.15.42:0/4190288418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ba6395e0 con 0x5565ba626db0 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90051a2640 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba6324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90059a3640 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba626550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f90061a4640 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba619b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80bd910 tx=0x7f8ff80bd5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902844d7c6e0cdda server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f8feb7fe640 1 -- 172.21.15.42:0/4190288418 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80da020 con 0x5565ba626db0 2024-03-31T23:19:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f8feb7fe640 1 -- 172.21.15.42:0/4190288418 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ff80c1a20 con 0x5565ba626db0 2024-03-31T23:19:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.946+0000 7f8feb7fe640 1 -- 172.21.15.42:0/4190288418 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8003c60 con 0x5565ba626db0 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 -- 172.21.15.42:0/4190288418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 msgr2=0x5565ba619b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba619b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80bd910 tx=0x7f8ff80bd5f0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 -- 172.21.15.42:0/4190288418 shutdown_connections 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba619b40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba6324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 --2- 172.21.15.42:0/4190288418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba626550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 -- 172.21.15.42:0/4190288418 >> 172.21.15.42:0/4190288418 conn(0x5565ba617fe0 msgr2=0x5565ba619430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 -- 172.21.15.42:0/4190288418 shutdown_connections 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 -- 172.21.15.42:0/4190288418 wait complete. 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 -- start start 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.947+0000 7f900a7ef740 1 Processor -- start 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba62eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba62bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba62bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90001affa0 con 0x5565ba626db0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f90001af8d0 con 0x5565ba61dfe0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f90001acaf0 con 0x5565ba61d6c0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f900a7ef740 10 client.0 _ll_register_callbacks cb 0x7f8ffc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba62eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90051a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba62bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90061a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba62bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba62eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:38738/0 (socket says 172.21.15.42:38738) 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90051a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba62bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:51178/0 (socket says 172.21.15.42:51178) 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 -- 172.21.15.42:0/3568678514 learned_addr learned my addr 172.21.15.42:0/3568678514 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 -- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 msgr2=0x5565ba62bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba62bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 -- 172.21.15.42:0/3568678514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 msgr2=0x5565ba62bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba62bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 -- 172.21.15.42:0/3568678514 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565ba6329f0 con 0x5565ba61d6c0 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f90059a3640 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba62eae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5565ba639810 tx=0x7f8ff0013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8bd7832fb5a9fb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.948+0000 7f8fe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f8fe97fa640 1 -- 172.21.15.42:0/3568678514 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff002c7c0 con 0x5565ba61d6c0 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ff80c1a20 con 0x5565ba61d6c0 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f8fe97fa640 1 -- 172.21.15.42:0/3568678514 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8ff0003800 con 0x5565ba61d6c0 2024-03-31T23:19:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f8fe97fa640 1 -- 172.21.15.42:0/3568678514 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ff0003a00 con 0x5565ba61d6c0 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 10 client.25951 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5565ba69d940 con 0x5565ba61d6c0 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f8fe97fa640 1 -- 172.21.15.42:0/3568678514 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ff80c1a20 con 0x5565ba61d6c0 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f8fe97fa640 1 -- 172.21.15.42:0/3568678514 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8ff001d410 con 0x5565ba61d6c0 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 10 client.25951 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 20 client.25951 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba69e090 0x5565ba6a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 4 client.25951 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5565ba58de30 con 0x5565ba69e090 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.949+0000 7f90051a2640 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba69e090 0x5565ba6a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.950+0000 7f8fe97fa640 10 client.25951 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:17.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.950+0000 7f90051a2640 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba69e090 0x5565ba6a0480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bad809548f3bbcc5 server_cookie=374317f14ea63c4b in_seq=0 out_seq=0 2024-03-31T23:19:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f8fe97fa640 1 -- 172.21.15.42:0/3568678514 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5565ba58de30 con 0x5565ba69e090 2024-03-31T23:19:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f8fe97fa640 10 client.25951 handle_command_reply: tid=0 2024-03-31T23:19:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 client.25951 shutdown 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 msgr2=0x5565ba62eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba62eae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5565ba639810 tx=0x7f8ff0013040 comp rx=0 tx=0).stop 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 shutdown_connections 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5565ba69e090 0x5565ba6a0480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565ba626db0 0x5565ba62bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f8fe97fa640 0 client.25951 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5565ba61dfe0 0x5565ba62bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 --2- 172.21.15.42:0/3568678514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565ba61d6c0 0x5565ba62eae0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 >> 172.21.15.42:0/3568678514 conn(0x5565ba617fe0 msgr2=0x5565ba616f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 shutdown_connections 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 1 -- 172.21.15.42:0/3568678514 wait complete. 2024-03-31T23:19:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.953+0000 7f900a7ef740 20 client.25951 trim_cache size 0 max 16384 2024-03-31T23:19:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:19:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:19:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:19:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8fec0a2850 msgr2=0x7f8fec0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8fec0a2850 0x7f8fec0a4d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009bd0 tx=0x7f8ff0005f90 comp rx=0 tx=0).stop 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 msgr2=0x7f900019c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 0x7f900019c900 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8005e30 tx=0x7f8ff8034440 comp rx=0 tx=0).stop 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 shutdown_connections 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8fec0a2850 0x7f8fec0a4d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90001055f0 0x7f900019c900 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9000101260 0x7f9000198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 --2- 172.21.15.42:0/1196425042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90001008a0 0x7f9000198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 >> 172.21.15.42:0/1196425042 conn(0x7f90000774a0 msgr2=0x7f9000068f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 shutdown_connections 2024-03-31T23:19:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:17.954+0000 7f9007c07640 1 -- 172.21.15.42:0/1196425042 wait complete. 2024-03-31T23:19:17.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:17 smithi188 ceph-mon[36068]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 597 B/s wr, 14 op/s 2024-03-31T23:19:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:17 smithi042 ceph-mon[32380]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 597 B/s wr, 14 op/s 2024-03-31T23:19:18.868 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 95% (11881/12435) Updating files: 96% (11938/12435) Updating files: 97% (12062/12435) Updating files: 98% (12187/12435) Updating files: 99% (12311/12435) Updating files: 100% (12435/12435) Updating files: 100% (12435/12435), done. 2024-03-31T23:19:19.615 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to '384f31f3d3aee7f8ba3f60846b8844c049165583'. 2024-03-31T23:19:19.615 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.615 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-31T23:19:19.615 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-31T23:19:19.615 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-03-31T23:19:19.615 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-03-31T23:19:19.616 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at 384f31f3d3a Merge pull request #56593 from zdover23/wip-doc-2024-03-31-backport-56592-to-squid 2024-03-31T23:19:19.619 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-31T23:19:19.690 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-31T23:19:19.692 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-31T23:19:19.692 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-31T23:19:19.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:19 smithi094 ceph-mon[36167]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:19:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:19 smithi188 ceph-mon[36068]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:19:20.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:19 smithi042 ceph-mon[32380]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:19:20.408 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-31T23:19:20.482 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-31T23:19:20.521 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-31T23:19:20.523 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-31T23:19:20.523 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-31T23:19:20.562 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-31T23:19:20.565 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:19:20.565 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-31T23:19:20.621 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-03-31T23:19:20.622 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-03-31T23:19:20.625 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384f31f3d3aee7f8ba3f60846b8844c049165583 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-03-31T23:19:20.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ KERNEL=linux-4.0.5 2024-03-31T23:19:20.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-03-31T23:19:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:21 smithi094 ceph-mon[36167]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:19:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:21 smithi188 ceph-mon[36068]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:19:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:21 smithi042 ceph-mon[32380]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-03-31T23:19:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:23 smithi094 ceph-mon[36167]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-03-31T23:19:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:23 smithi188 ceph-mon[36068]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-03-31T23:19:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:23 smithi042 ceph-mon[32380]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-03-31T23:19:24.990 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir untar_tar 2024-03-31T23:19:24.992 INFO:tasks.workunit.client.0.smithi042.stderr:+ cd untar_tar 2024-03-31T23:19:24.992 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-03-31T23:19:25.016 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ 2024-03-31T23:19:25.018 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/00-INDEX 2024-03-31T23:19:25.019 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/ 2024-03-31T23:19:25.020 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/README 2024-03-31T23:19:25.021 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-03-31T23:19:25.021 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-03-31T23:19:25.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-03-31T23:19:25.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-03-31T23:19:25.025 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-03-31T23:19:25.026 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-03-31T23:19:25.027 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-03-31T23:19:25.028 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-03-31T23:19:25.029 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-03-31T23:19:25.030 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-03-31T23:19:25.031 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-03-31T23:19:25.031 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-03-31T23:19:25.032 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-03-31T23:19:25.033 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-03-31T23:19:25.034 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-03-31T23:19:25.035 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-03-31T23:19:25.036 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-03-31T23:19:25.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-03-31T23:19:25.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-03-31T23:19:25.038 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-03-31T23:19:25.039 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-03-31T23:19:25.040 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-03-31T23:19:25.041 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-03-31T23:19:25.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-03-31T23:19:25.043 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-03-31T23:19:25.044 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-03-31T23:19:25.045 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-03-31T23:19:25.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-03-31T23:19:25.047 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-03-31T23:19:25.048 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-03-31T23:19:25.049 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-03-31T23:19:25.050 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-03-31T23:19:25.051 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-03-31T23:19:25.052 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-03-31T23:19:25.053 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-03-31T23:19:25.054 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-03-31T23:19:25.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-03-31T23:19:25.056 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-03-31T23:19:25.057 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-03-31T23:19:25.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-03-31T23:19:25.059 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-03-31T23:19:25.060 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-03-31T23:19:25.062 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-03-31T23:19:25.063 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-03-31T23:19:25.065 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-03-31T23:19:25.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-03-31T23:19:25.068 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-03-31T23:19:25.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-03-31T23:19:25.071 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-03-31T23:19:25.073 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-03-31T23:19:25.075 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-03-31T23:19:25.076 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-03-31T23:19:25.078 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-03-31T23:19:25.079 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-03-31T23:19:25.081 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-03-31T23:19:25.083 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-03-31T23:19:25.084 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-03-31T23:19:25.086 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-03-31T23:19:25.088 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-03-31T23:19:25.089 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-03-31T23:19:25.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-03-31T23:19:25.092 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-03-31T23:19:25.094 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-03-31T23:19:25.096 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-03-31T23:19:25.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-03-31T23:19:25.099 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-03-31T23:19:25.100 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-03-31T23:19:25.102 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-03-31T23:19:25.104 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-03-31T23:19:25.105 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-03-31T23:19:25.107 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-03-31T23:19:25.108 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-03-31T23:19:25.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-03-31T23:19:25.111 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-03-31T23:19:25.112 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-03-31T23:19:25.113 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-03-31T23:19:25.114 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-03-31T23:19:25.115 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-03-31T23:19:25.116 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-03-31T23:19:25.117 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-03-31T23:19:25.118 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-03-31T23:19:25.119 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-03-31T23:19:25.120 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-03-31T23:19:25.121 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-03-31T23:19:25.122 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-03-31T23:19:25.123 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-03-31T23:19:25.124 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-03-31T23:19:25.125 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-03-31T23:19:25.126 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-03-31T23:19:25.127 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-03-31T23:19:25.128 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-03-31T23:19:25.129 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-03-31T23:19:25.130 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-03-31T23:19:25.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-03-31T23:19:25.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-03-31T23:19:25.132 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-03-31T23:19:25.133 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-03-31T23:19:25.135 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-03-31T23:19:25.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-03-31T23:19:25.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-03-31T23:19:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-03-31T23:19:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-03-31T23:19:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-03-31T23:19:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-03-31T23:19:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-03-31T23:19:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-03-31T23:19:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-03-31T23:19:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-03-31T23:19:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-03-31T23:19:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-03-31T23:19:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-03-31T23:19:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-03-31T23:19:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-03-31T23:19:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-03-31T23:19:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-03-31T23:19:25.153 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-03-31T23:19:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-03-31T23:19:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-03-31T23:19:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-03-31T23:19:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-03-31T23:19:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-03-31T23:19:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-03-31T23:19:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-03-31T23:19:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-03-31T23:19:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-03-31T23:19:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-03-31T23:19:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-03-31T23:19:25.164 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-03-31T23:19:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-03-31T23:19:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-03-31T23:19:25.167 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-03-31T23:19:25.168 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-03-31T23:19:25.169 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-03-31T23:19:25.170 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-03-31T23:19:25.171 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-03-31T23:19:25.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-03-31T23:19:25.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-03-31T23:19:25.173 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-03-31T23:19:25.174 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-03-31T23:19:25.176 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-03-31T23:19:25.177 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-03-31T23:19:25.178 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-03-31T23:19:25.179 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-03-31T23:19:25.180 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-03-31T23:19:25.181 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-03-31T23:19:25.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-03-31T23:19:25.183 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-03-31T23:19:25.184 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-03-31T23:19:25.184 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-03-31T23:19:25.186 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-03-31T23:19:25.187 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-03-31T23:19:25.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-03-31T23:19:25.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-03-31T23:19:25.189 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-03-31T23:19:25.190 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-03-31T23:19:25.191 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-03-31T23:19:25.192 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-03-31T23:19:25.193 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-03-31T23:19:25.194 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-03-31T23:19:25.195 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-03-31T23:19:25.196 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-03-31T23:19:25.197 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-03-31T23:19:25.198 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-03-31T23:19:25.199 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-03-31T23:19:25.200 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-03-31T23:19:25.201 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-03-31T23:19:25.202 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-03-31T23:19:25.203 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-03-31T23:19:25.204 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-03-31T23:19:25.205 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-03-31T23:19:25.206 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-03-31T23:19:25.207 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-03-31T23:19:25.208 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-03-31T23:19:25.209 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-03-31T23:19:25.210 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-03-31T23:19:25.211 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-03-31T23:19:25.212 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-03-31T23:19:25.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-03-31T23:19:25.214 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-03-31T23:19:25.215 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-03-31T23:19:25.216 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-03-31T23:19:25.217 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-03-31T23:19:25.218 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-03-31T23:19:25.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-03-31T23:19:25.220 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-03-31T23:19:25.221 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-03-31T23:19:25.222 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-03-31T23:19:25.223 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-03-31T23:19:25.224 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-03-31T23:19:25.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-03-31T23:19:25.226 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-03-31T23:19:25.227 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-03-31T23:19:25.228 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-03-31T23:19:25.229 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-03-31T23:19:25.230 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-03-31T23:19:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:25 smithi094 ceph-mon[36167]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:19:25.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:25 smithi188 ceph-mon[36068]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:19:26.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:25 smithi042 ceph-mon[32380]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-31T23:19:26.692 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-03-31T23:19:26.694 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-03-31T23:19:26.696 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-03-31T23:19:26.697 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-03-31T23:19:26.698 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-03-31T23:19:26.699 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-03-31T23:19:26.700 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-03-31T23:19:26.701 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-03-31T23:19:26.702 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-03-31T23:19:26.703 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-03-31T23:19:26.704 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-03-31T23:19:26.705 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-03-31T23:19:26.706 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-03-31T23:19:26.707 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-03-31T23:19:26.708 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-03-31T23:19:26.709 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-03-31T23:19:26.710 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-03-31T23:19:26.711 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-03-31T23:19:26.712 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-03-31T23:19:26.713 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-03-31T23:19:26.714 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-03-31T23:19:26.715 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-03-31T23:19:26.716 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-03-31T23:19:26.717 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-03-31T23:19:26.718 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-03-31T23:19:26.719 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-03-31T23:19:26.720 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-03-31T23:19:26.721 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-03-31T23:19:26.722 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-03-31T23:19:26.723 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-03-31T23:19:26.724 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-03-31T23:19:26.725 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-03-31T23:19:26.726 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-03-31T23:19:26.727 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-03-31T23:19:26.728 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-03-31T23:19:26.729 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-03-31T23:19:26.730 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-03-31T23:19:26.731 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-03-31T23:19:26.732 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-03-31T23:19:26.733 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-03-31T23:19:26.734 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-03-31T23:19:26.735 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-03-31T23:19:26.736 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-03-31T23:19:26.737 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-03-31T23:19:26.738 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-03-31T23:19:26.739 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-03-31T23:19:26.740 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-03-31T23:19:26.741 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-03-31T23:19:26.742 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-03-31T23:19:26.743 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-03-31T23:19:26.744 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-03-31T23:19:26.745 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-03-31T23:19:26.746 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-03-31T23:19:26.747 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-03-31T23:19:26.748 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-03-31T23:19:26.749 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-03-31T23:19:26.750 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-03-31T23:19:26.751 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-03-31T23:19:26.752 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-03-31T23:19:26.753 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-03-31T23:19:26.754 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-03-31T23:19:26.755 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-03-31T23:19:26.756 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-03-31T23:19:26.757 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/Changes 2024-03-31T23:19:26.758 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-03-31T23:19:26.759 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/CodingStyle 2024-03-31T23:19:26.760 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-03-31T23:19:26.761 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-03-31T23:19:26.762 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-03-31T23:19:26.763 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-03-31T23:19:26.764 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/ 2024-03-31T23:19:26.765 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-03-31T23:19:26.766 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-03-31T23:19:26.767 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-03-31T23:19:26.769 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-03-31T23:19:26.769 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-03-31T23:19:26.770 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-03-31T23:19:26.771 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-03-31T23:19:26.772 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-03-31T23:19:26.773 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-03-31T23:19:26.775 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-03-31T23:19:26.776 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-03-31T23:19:26.777 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-03-31T23:19:26.778 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-03-31T23:19:26.779 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-03-31T23:19:26.780 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-03-31T23:19:26.781 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-03-31T23:19:26.782 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-03-31T23:19:26.783 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-03-31T23:19:26.784 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-03-31T23:19:26.784 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-03-31T23:19:26.785 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-03-31T23:19:26.786 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-03-31T23:19:26.787 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-03-31T23:19:26.788 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-03-31T23:19:26.789 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-03-31T23:19:26.790 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-03-31T23:19:26.791 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-03-31T23:19:26.792 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-03-31T23:19:26.793 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-03-31T23:19:26.794 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-03-31T23:19:26.795 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-03-31T23:19:26.796 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-03-31T23:19:26.797 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-03-31T23:19:26.798 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-03-31T23:19:26.799 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-03-31T23:19:26.800 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-03-31T23:19:26.801 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-03-31T23:19:26.802 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-03-31T23:19:26.803 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-03-31T23:19:26.804 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-03-31T23:19:26.806 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-03-31T23:19:26.807 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-03-31T23:19:26.808 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-03-31T23:19:26.809 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-03-31T23:19:26.810 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-03-31T23:19:26.811 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-03-31T23:19:26.812 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-03-31T23:19:26.813 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-03-31T23:19:26.814 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-03-31T23:19:26.815 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-03-31T23:19:26.816 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-03-31T23:19:26.817 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-03-31T23:19:26.820 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-03-31T23:19:26.821 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-03-31T23:19:26.822 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-03-31T23:19:26.823 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-03-31T23:19:26.824 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-03-31T23:19:26.825 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-03-31T23:19:26.826 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-03-31T23:19:26.827 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-03-31T23:19:26.828 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-03-31T23:19:26.829 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-03-31T23:19:26.830 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-03-31T23:19:26.831 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-03-31T23:19:26.832 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-03-31T23:19:26.834 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-03-31T23:19:26.834 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-03-31T23:19:26.835 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-03-31T23:19:26.836 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-03-31T23:19:26.837 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-03-31T23:19:26.838 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-03-31T23:19:26.839 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-03-31T23:19:26.840 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-03-31T23:19:26.841 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-03-31T23:19:26.842 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-03-31T23:19:26.843 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-03-31T23:19:26.844 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-03-31T23:19:26.845 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-03-31T23:19:26.846 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-03-31T23:19:26.847 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-03-31T23:19:26.848 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-03-31T23:19:26.849 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-03-31T23:19:26.850 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-03-31T23:19:26.851 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-03-31T23:19:26.852 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-03-31T23:19:26.853 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-03-31T23:19:26.854 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-03-31T23:19:26.855 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-03-31T23:19:26.856 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-03-31T23:19:26.857 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-03-31T23:19:26.858 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-03-31T23:19:26.859 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-03-31T23:19:26.860 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-03-31T23:19:26.861 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-03-31T23:19:26.862 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-03-31T23:19:26.863 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-03-31T23:19:26.864 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-03-31T23:19:26.865 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-03-31T23:19:26.866 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-03-31T23:19:26.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-03-31T23:19:26.868 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-03-31T23:19:26.869 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-03-31T23:19:26.870 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-03-31T23:19:26.871 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-03-31T23:19:26.872 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-03-31T23:19:26.873 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-03-31T23:19:26.874 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-03-31T23:19:26.875 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-03-31T23:19:26.876 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-03-31T23:19:26.877 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-03-31T23:19:26.878 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-03-31T23:19:26.879 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-03-31T23:19:26.881 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-03-31T23:19:26.882 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-03-31T23:19:26.884 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-03-31T23:19:26.886 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-03-31T23:19:26.887 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-03-31T23:19:26.889 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-03-31T23:19:26.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-03-31T23:19:26.892 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-03-31T23:19:26.893 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-03-31T23:19:26.895 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-03-31T23:19:26.896 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-03-31T23:19:26.898 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-03-31T23:19:26.900 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-03-31T23:19:26.901 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-03-31T23:19:26.903 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-03-31T23:19:26.904 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-03-31T23:19:26.906 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-03-31T23:19:26.907 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-03-31T23:19:26.909 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-03-31T23:19:26.911 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-03-31T23:19:26.912 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-03-31T23:19:26.914 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-03-31T23:19:26.915 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-03-31T23:19:26.917 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-03-31T23:19:26.918 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-03-31T23:19:26.920 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-03-31T23:19:26.922 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-03-31T23:19:26.923 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-03-31T23:19:26.925 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-03-31T23:19:26.926 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-03-31T23:19:26.928 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-03-31T23:19:26.929 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-03-31T23:19:26.931 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-03-31T23:19:26.933 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-03-31T23:19:26.934 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-03-31T23:19:26.936 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-03-31T23:19:26.937 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-03-31T23:19:26.939 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-03-31T23:19:26.940 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-03-31T23:19:26.942 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-03-31T23:19:26.943 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-03-31T23:19:26.945 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-03-31T23:19:26.946 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-03-31T23:19:26.948 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-03-31T23:19:26.949 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-03-31T23:19:26.951 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-03-31T23:19:26.952 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-03-31T23:19:26.953 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-03-31T23:19:26.954 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-03-31T23:19:26.955 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-03-31T23:19:26.956 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-03-31T23:19:26.957 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-03-31T23:19:26.958 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-03-31T23:19:26.959 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-03-31T23:19:26.960 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-03-31T23:19:26.961 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-03-31T23:19:26.962 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-03-31T23:19:26.963 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-03-31T23:19:26.964 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-03-31T23:19:26.965 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-03-31T23:19:26.966 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-03-31T23:19:26.967 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-03-31T23:19:26.968 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-03-31T23:19:26.969 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-03-31T23:19:26.970 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-03-31T23:19:26.971 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-03-31T23:19:26.972 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-03-31T23:19:26.973 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-03-31T23:19:26.974 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-03-31T23:19:26.975 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-03-31T23:19:26.976 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-03-31T23:19:26.977 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-03-31T23:19:26.978 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-03-31T23:19:26.979 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-03-31T23:19:26.980 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-03-31T23:19:26.981 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-03-31T23:19:26.981 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-03-31T23:19:26.982 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-03-31T23:19:26.984 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-03-31T23:19:26.984 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-03-31T23:19:26.985 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-03-31T23:19:26.986 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-03-31T23:19:26.987 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-03-31T23:19:26.988 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-03-31T23:19:26.989 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-03-31T23:19:26.990 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-03-31T23:19:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:27 smithi094 ceph-mon[36167]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-03-31T23:19:27.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:27 smithi188 ceph-mon[36068]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-03-31T23:19:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:27 smithi042 ceph-mon[32380]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-03-31T23:19:28.866 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-03-31T23:19:28.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-03-31T23:19:28.868 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-03-31T23:19:28.869 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-03-31T23:19:28.870 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-03-31T23:19:28.872 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-03-31T23:19:28.873 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-03-31T23:19:28.874 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-03-31T23:19:28.875 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-03-31T23:19:28.876 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-03-31T23:19:28.877 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-03-31T23:19:28.878 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-03-31T23:19:28.880 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-03-31T23:19:28.881 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-03-31T23:19:28.882 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-03-31T23:19:28.883 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-03-31T23:19:28.884 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-03-31T23:19:28.885 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-03-31T23:19:28.887 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-03-31T23:19:28.888 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-03-31T23:19:28.889 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-03-31T23:19:28.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-03-31T23:19:28.892 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-03-31T23:19:28.893 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-03-31T23:19:28.894 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-03-31T23:19:28.895 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-03-31T23:19:28.896 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-03-31T23:19:28.897 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-03-31T23:19:28.898 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-03-31T23:19:28.899 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-03-31T23:19:28.900 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-03-31T23:19:28.903 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-03-31T23:19:28.904 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-03-31T23:19:28.906 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-03-31T23:19:28.907 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/ 2024-03-31T23:19:28.908 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-03-31T23:19:28.909 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-03-31T23:19:28.910 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-03-31T23:19:28.911 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-03-31T23:19:28.912 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-03-31T23:19:28.913 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-03-31T23:19:28.914 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-03-31T23:19:28.915 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-03-31T23:19:28.916 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-03-31T23:19:28.917 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/EDID/hex 2024-03-31T23:19:28.918 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/HOWTO 2024-03-31T23:19:28.919 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-03-31T23:19:28.920 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-03-31T23:19:28.922 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-03-31T23:19:28.923 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-03-31T23:19:28.924 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-03-31T23:19:28.925 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/Makefile 2024-03-31T23:19:28.926 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-03-31T23:19:28.927 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/ 2024-03-31T23:19:28.929 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-03-31T23:19:28.930 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-03-31T23:19:28.932 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-03-31T23:19:28.933 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-03-31T23:19:28.935 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-03-31T23:19:28.937 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-03-31T23:19:28.938 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-03-31T23:19:28.940 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/ 2024-03-31T23:19:28.941 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-03-31T23:19:28.944 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-03-31T23:19:28.944 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-03-31T23:19:28.946 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-03-31T23:19:28.948 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-03-31T23:19:28.949 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-03-31T23:19:28.951 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-03-31T23:19:28.952 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-03-31T23:19:28.954 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-03-31T23:19:28.956 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-03-31T23:19:28.957 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-03-31T23:19:28.959 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-03-31T23:19:28.960 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-03-31T23:19:28.962 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-03-31T23:19:28.963 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-03-31T23:19:28.965 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-03-31T23:19:28.966 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-03-31T23:19:28.968 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-03-31T23:19:28.969 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/SAK.txt 2024-03-31T23:19:28.971 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/SM501.txt 2024-03-31T23:19:28.973 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-03-31T23:19:28.974 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-03-31T23:19:28.976 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-03-31T23:19:28.977 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-03-31T23:19:28.979 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-03-31T23:19:28.981 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/ 2024-03-31T23:19:28.982 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-03-31T23:19:28.984 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-03-31T23:19:28.986 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-03-31T23:19:28.987 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-03-31T23:19:28.989 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-03-31T23:19:28.990 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-03-31T23:19:28.992 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-03-31T23:19:28.993 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/ 2024-03-31T23:19:28.994 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-03-31T23:19:28.995 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-03-31T23:19:28.996 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-03-31T23:19:28.997 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-03-31T23:19:28.998 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-03-31T23:19:28.998 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-03-31T23:19:28.999 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-03-31T23:19:29.000 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-03-31T23:19:29.001 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-03-31T23:19:29.002 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-03-31T23:19:29.003 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-03-31T23:19:29.004 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-03-31T23:19:29.005 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-03-31T23:19:29.006 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/ 2024-03-31T23:19:29.007 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-03-31T23:19:29.008 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-03-31T23:19:29.009 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-03-31T23:19:29.010 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-03-31T23:19:29.011 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-03-31T23:19:29.012 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-03-31T23:19:29.013 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-03-31T23:19:29.014 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/ 2024-03-31T23:19:29.015 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-03-31T23:19:29.016 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-03-31T23:19:29.017 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-03-31T23:19:29.018 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Booting 2024-03-31T23:19:29.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-03-31T23:19:29.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-03-31T23:19:29.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-03-31T23:19:29.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-03-31T23:19:29.023 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-03-31T23:19:29.023 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-03-31T23:19:29.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-03-31T23:19:29.025 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-03-31T23:19:29.026 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-03-31T23:19:29.027 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-03-31T23:19:29.028 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Porting 2024-03-31T23:19:29.029 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/README 2024-03-31T23:19:29.030 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-03-31T23:19:29.031 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-03-31T23:19:29.032 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-03-31T23:19:29.033 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-03-31T23:19:29.034 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-03-31T23:19:29.035 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-03-31T23:19:29.036 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-03-31T23:19:29.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-03-31T23:19:29.038 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-03-31T23:19:29.039 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-03-31T23:19:29.040 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-03-31T23:19:29.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-03-31T23:19:29.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-03-31T23:19:29.043 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-03-31T23:19:29.044 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-03-31T23:19:29.045 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-03-31T23:19:29.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-03-31T23:19:29.047 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-03-31T23:19:29.048 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-03-31T23:19:29.049 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-03-31T23:19:29.050 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-03-31T23:19:29.051 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-03-31T23:19:29.052 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-03-31T23:19:29.053 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-03-31T23:19:29.054 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-03-31T23:19:29.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-03-31T23:19:29.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-03-31T23:19:29.056 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-03-31T23:19:29.057 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-03-31T23:19:29.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-03-31T23:19:29.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-03-31T23:19:29.059 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-03-31T23:19:29.060 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-03-31T23:19:29.061 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-03-31T23:19:29.062 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-03-31T23:19:29.063 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-03-31T23:19:29.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-03-31T23:19:29.065 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-03-31T23:19:29.066 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-03-31T23:19:29.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-03-31T23:19:29.069 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-03-31T23:19:29.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-03-31T23:19:29.072 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-03-31T23:19:29.073 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/Setup 2024-03-31T23:19:29.075 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-03-31T23:19:29.076 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-03-31T23:19:29.077 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-03-31T23:19:29.079 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-03-31T23:19:29.081 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-03-31T23:19:29.082 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-03-31T23:19:29.083 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-03-31T23:19:29.085 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-03-31T23:19:29.086 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-03-31T23:19:29.087 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-03-31T23:19:29.088 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-03-31T23:19:29.089 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-03-31T23:19:29.090 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-03-31T23:19:29.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-03-31T23:19:29.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-03-31T23:19:29.092 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-03-31T23:19:29.093 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-03-31T23:19:29.094 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-03-31T23:19:29.095 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-03-31T23:19:29.096 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-03-31T23:19:29.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-03-31T23:19:29.098 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-03-31T23:19:29.099 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-03-31T23:19:29.100 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-03-31T23:19:29.101 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-03-31T23:19:29.101 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-03-31T23:19:29.103 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-03-31T23:19:29.103 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-03-31T23:19:29.105 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-03-31T23:19:29.105 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-03-31T23:19:29.106 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm64/ 2024-03-31T23:19:29.107 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-03-31T23:19:29.108 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-03-31T23:19:29.109 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-03-31T23:19:29.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-03-31T23:19:29.111 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-03-31T23:19:29.112 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-03-31T23:19:29.113 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-03-31T23:19:29.114 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-03-31T23:19:29.115 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-03-31T23:19:29.116 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-03-31T23:19:29.117 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-03-31T23:19:29.118 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-03-31T23:19:29.119 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/backlight/ 2024-03-31T23:19:29.120 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-03-31T23:19:29.121 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-03-31T23:19:29.122 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-03-31T23:19:29.123 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/bcache.txt 2024-03-31T23:19:29.124 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-03-31T23:19:29.125 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blackfin/ 2024-03-31T23:19:29.126 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-03-31T23:19:29.127 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-03-31T23:19:29.128 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-03-31T23:19:29.129 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-03-31T23:19:29.130 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-03-31T23:19:29.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/ 2024-03-31T23:19:29.132 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-03-31T23:19:29.133 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-03-31T23:19:29.134 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-03-31T23:19:29.135 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-03-31T23:19:29.136 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-03-31T23:19:29.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-03-31T23:19:29.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-03-31T23:19:29.139 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-03-31T23:19:29.140 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-03-31T23:19:29.141 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-03-31T23:19:29.142 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-03-31T23:19:29.143 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/request.txt 2024-03-31T23:19:29.144 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-03-31T23:19:29.145 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-03-31T23:19:29.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-03-31T23:19:29.147 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/ 2024-03-31T23:19:29.148 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-03-31T23:19:29.149 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-03-31T23:19:29.150 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-03-31T23:19:29.151 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-03-31T23:19:29.152 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-03-31T23:19:29.153 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-03-31T23:19:29.154 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-03-31T23:19:29.155 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-03-31T23:19:29.156 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-03-31T23:19:29.157 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-03-31T23:19:29.158 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-03-31T23:19:29.159 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-03-31T23:19:29.161 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-03-31T23:19:29.162 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-03-31T23:19:29.163 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-03-31T23:19:29.164 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-03-31T23:19:29.165 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-03-31T23:19:29.165 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-03-31T23:19:29.166 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-03-31T23:19:29.167 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-03-31T23:19:29.168 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-03-31T23:19:29.169 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-03-31T23:19:29.170 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-03-31T23:19:29.171 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-03-31T23:19:29.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-03-31T23:19:29.173 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-03-31T23:19:29.174 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cdrom/ 2024-03-31T23:19:29.175 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-03-31T23:19:29.176 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-03-31T23:19:29.177 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-03-31T23:19:29.178 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-03-31T23:19:29.179 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-03-31T23:19:29.180 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/ 2024-03-31T23:19:29.181 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-03-31T23:19:29.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-03-31T23:19:29.183 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-03-31T23:19:29.184 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-03-31T23:19:29.185 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-03-31T23:19:29.186 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-03-31T23:19:29.187 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-03-31T23:19:29.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-03-31T23:19:29.189 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-03-31T23:19:29.190 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-03-31T23:19:29.191 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-03-31T23:19:29.192 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-03-31T23:19:29.193 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-03-31T23:19:29.194 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-03-31T23:19:29.195 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/clk.txt 2024-03-31T23:19:29.196 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-03-31T23:19:29.197 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/connector/ 2024-03-31T23:19:29.198 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-03-31T23:19:29.199 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-03-31T23:19:29.200 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-03-31T23:19:29.201 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-03-31T23:19:29.202 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-03-31T23:19:29.203 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/console/ 2024-03-31T23:19:29.204 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/console/console.txt 2024-03-31T23:19:29.205 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-03-31T23:19:29.206 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-03-31T23:19:29.207 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-03-31T23:19:29.208 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-03-31T23:19:29.209 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-03-31T23:19:29.210 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-03-31T23:19:29.211 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-03-31T23:19:29.212 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-03-31T23:19:29.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-03-31T23:19:29.214 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-03-31T23:19:29.215 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-03-31T23:19:29.216 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-03-31T23:19:29.217 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-03-31T23:19:29.218 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-03-31T23:19:29.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-03-31T23:19:29.220 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-03-31T23:19:29.221 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-03-31T23:19:29.222 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-03-31T23:19:29.223 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-03-31T23:19:29.224 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-03-31T23:19:29.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crc32.txt 2024-03-31T23:19:29.226 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cris/ 2024-03-31T23:19:29.227 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/cris/README 2024-03-31T23:19:29.228 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crypto/ 2024-03-31T23:19:29.229 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-03-31T23:19:29.230 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-03-31T23:19:29.231 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-03-31T23:19:29.232 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-03-31T23:19:29.233 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-03-31T23:19:29.234 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-03-31T23:19:29.235 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-03-31T23:19:29.236 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-03-31T23:19:29.237 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-03-31T23:19:29.238 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/ 2024-03-31T23:19:29.239 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-03-31T23:19:29.240 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-03-31T23:19:29.241 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-03-31T23:19:29.242 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-03-31T23:19:29.243 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-03-31T23:19:29.244 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-03-31T23:19:29.245 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-03-31T23:19:29.246 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-03-31T23:19:29.247 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-03-31T23:19:29.248 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-03-31T23:19:29.249 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-03-31T23:19:29.250 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-03-31T23:19:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-03-31T23:19:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-03-31T23:19:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-03-31T23:19:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-03-31T23:19:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-03-31T23:19:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-03-31T23:19:29.257 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-03-31T23:19:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-03-31T23:19:29.259 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-03-31T23:19:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-03-31T23:19:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-03-31T23:19:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-03-31T23:19:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-03-31T23:19:29.264 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-03-31T23:19:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-03-31T23:19:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-03-31T23:19:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-03-31T23:19:29.268 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-03-31T23:19:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-03-31T23:19:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devices.txt 2024-03-31T23:19:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/ 2024-03-31T23:19:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-03-31T23:19:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-03-31T23:19:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-03-31T23:19:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-03-31T23:19:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-03-31T23:19:29.278 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-03-31T23:19:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-03-31T23:19:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-03-31T23:19:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-03-31T23:19:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-03-31T23:19:29.282 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-03-31T23:19:29.283 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-03-31T23:19:29.284 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-03-31T23:19:29.285 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-03-31T23:19:29.286 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-03-31T23:19:29.287 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-03-31T23:19:29.288 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-03-31T23:19:29.289 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-03-31T23:19:29.290 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-03-31T23:19:29.291 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-03-31T23:19:29.292 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-03-31T23:19:29.293 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-03-31T23:19:29.294 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-03-31T23:19:29.295 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-03-31T23:19:29.296 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-03-31T23:19:29.297 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-03-31T23:19:29.298 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-03-31T23:19:29.299 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-03-31T23:19:29.300 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-03-31T23:19:29.301 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-03-31T23:19:29.302 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-03-31T23:19:29.303 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-03-31T23:19:29.304 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-03-31T23:19:29.305 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-03-31T23:19:29.306 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-03-31T23:19:29.307 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-03-31T23:19:29.308 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-03-31T23:19:29.309 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-03-31T23:19:29.310 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-03-31T23:19:29.311 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-03-31T23:19:29.312 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-03-31T23:19:29.313 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-03-31T23:19:29.314 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-03-31T23:19:29.315 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-03-31T23:19:29.316 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-03-31T23:19:29.317 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-03-31T23:19:29.318 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-03-31T23:19:29.319 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-03-31T23:19:29.320 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-03-31T23:19:29.321 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-03-31T23:19:29.322 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-03-31T23:19:29.323 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-03-31T23:19:29.324 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-03-31T23:19:29.325 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-03-31T23:19:29.326 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-03-31T23:19:29.326 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-03-31T23:19:29.327 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-03-31T23:19:29.328 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-03-31T23:19:29.329 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-03-31T23:19:29.330 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-03-31T23:19:29.331 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-03-31T23:19:29.332 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-03-31T23:19:29.333 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-03-31T23:19:29.334 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-03-31T23:19:29.335 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-03-31T23:19:29.336 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-03-31T23:19:29.337 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-03-31T23:19:29.338 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-03-31T23:19:29.339 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-03-31T23:19:29.340 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-03-31T23:19:29.341 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-03-31T23:19:29.342 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-03-31T23:19:29.343 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-03-31T23:19:29.344 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-03-31T23:19:29.345 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-03-31T23:19:29.346 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-03-31T23:19:29.347 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-03-31T23:19:29.348 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-03-31T23:19:29.349 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-03-31T23:19:29.350 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-03-31T23:19:29.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-03-31T23:19:29.352 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-03-31T23:19:29.353 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-03-31T23:19:29.354 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-03-31T23:19:29.355 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-03-31T23:19:29.356 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-03-31T23:19:29.357 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-03-31T23:19:29.358 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-03-31T23:19:29.359 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-03-31T23:19:29.360 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-03-31T23:19:29.361 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-03-31T23:19:29.362 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-03-31T23:19:29.363 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-03-31T23:19:29.364 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-03-31T23:19:29.365 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-03-31T23:19:29.366 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-03-31T23:19:29.367 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-03-31T23:19:29.368 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-03-31T23:19:29.369 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-03-31T23:19:29.370 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-03-31T23:19:29.371 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-03-31T23:19:29.372 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-03-31T23:19:29.373 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-03-31T23:19:29.374 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-03-31T23:19:29.375 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-03-31T23:19:29.377 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-03-31T23:19:29.378 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-03-31T23:19:29.379 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-03-31T23:19:29.380 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-03-31T23:19:29.381 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-03-31T23:19:29.382 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-03-31T23:19:29.383 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-03-31T23:19:29.384 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-03-31T23:19:29.385 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-03-31T23:19:29.386 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-03-31T23:19:29.387 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-03-31T23:19:29.388 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-03-31T23:19:29.389 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-03-31T23:19:29.390 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-03-31T23:19:29.391 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-03-31T23:19:29.392 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-03-31T23:19:29.393 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-03-31T23:19:29.394 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-03-31T23:19:29.395 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-03-31T23:19:29.396 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-03-31T23:19:29.397 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-03-31T23:19:29.398 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-03-31T23:19:29.399 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-03-31T23:19:29.400 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-03-31T23:19:29.401 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-03-31T23:19:29.402 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-03-31T23:19:29.403 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-03-31T23:19:29.404 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-03-31T23:19:29.405 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-03-31T23:19:29.406 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-03-31T23:19:29.407 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-03-31T23:19:29.408 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-03-31T23:19:29.409 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-03-31T23:19:29.410 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-03-31T23:19:29.411 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-03-31T23:19:29.412 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-03-31T23:19:29.413 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-03-31T23:19:29.414 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-03-31T23:19:29.415 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-03-31T23:19:29.416 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-03-31T23:19:29.417 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-03-31T23:19:29.418 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-03-31T23:19:29.419 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-03-31T23:19:29.420 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-03-31T23:19:29.421 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-03-31T23:19:29.422 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-03-31T23:19:29.423 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-03-31T23:19:29.424 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-03-31T23:19:29.425 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-03-31T23:19:29.426 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-03-31T23:19:29.427 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-03-31T23:19:29.430 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-03-31T23:19:29.430 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-03-31T23:19:29.695 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-03-31T23:19:29.696 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-03-31T23:19:29.697 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-03-31T23:19:29.698 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-03-31T23:19:29.699 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-03-31T23:19:29.700 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-03-31T23:19:29.701 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-03-31T23:19:29.702 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-03-31T23:19:29.703 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-03-31T23:19:29.704 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-03-31T23:19:29.705 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-03-31T23:19:29.706 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-03-31T23:19:29.707 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-03-31T23:19:29.708 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-03-31T23:19:29.709 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-03-31T23:19:29.711 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-03-31T23:19:29.712 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-03-31T23:19:29.714 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-03-31T23:19:29.716 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-03-31T23:19:29.717 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-03-31T23:19:29.719 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-03-31T23:19:29.721 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-03-31T23:19:29.722 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-03-31T23:19:29.723 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-03-31T23:19:29.724 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-03-31T23:19:29.726 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-03-31T23:19:29.727 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-03-31T23:19:29.728 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-03-31T23:19:29.729 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-03-31T23:19:29.730 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-03-31T23:19:29.731 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-03-31T23:19:29.732 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-03-31T23:19:29.734 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-03-31T23:19:29.735 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-03-31T23:19:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-03-31T23:19:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-03-31T23:19:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-03-31T23:19:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-03-31T23:19:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-03-31T23:19:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-03-31T23:19:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-03-31T23:19:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-03-31T23:19:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-03-31T23:19:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-03-31T23:19:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-03-31T23:19:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-03-31T23:19:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-03-31T23:19:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-03-31T23:19:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-03-31T23:19:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-03-31T23:19:29.763 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-03-31T23:19:29.764 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-03-31T23:19:29.766 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-03-31T23:19:29.768 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-03-31T23:19:29.769 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-03-31T23:19:29.771 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-03-31T23:19:29.773 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-03-31T23:19:29.774 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-03-31T23:19:29.776 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-03-31T23:19:29.777 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-03-31T23:19:29.779 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-03-31T23:19:29.781 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-03-31T23:19:29.782 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-03-31T23:19:29.784 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-03-31T23:19:29.785 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-03-31T23:19:29.787 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-03-31T23:19:29.789 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-03-31T23:19:29.790 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-03-31T23:19:29.792 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-03-31T23:19:29.793 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-03-31T23:19:29.794 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-03-31T23:19:29.795 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-03-31T23:19:29.796 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-03-31T23:19:29.797 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-03-31T23:19:29.798 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-03-31T23:19:29.799 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-03-31T23:19:29.800 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-03-31T23:19:29.801 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-03-31T23:19:29.802 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-03-31T23:19:29.803 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-03-31T23:19:29.804 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-03-31T23:19:29.805 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-03-31T23:19:29.806 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-03-31T23:19:29.807 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-03-31T23:19:29.808 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-03-31T23:19:29.809 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-03-31T23:19:29.810 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-03-31T23:19:29.811 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-03-31T23:19:29.812 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-03-31T23:19:29.813 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-03-31T23:19:29.814 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-03-31T23:19:29.815 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-03-31T23:19:29.816 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-03-31T23:19:29.817 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-03-31T23:19:29.818 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-03-31T23:19:29.819 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-03-31T23:19:29.820 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-03-31T23:19:29.821 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-03-31T23:19:29.822 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-03-31T23:19:29.823 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-03-31T23:19:29.824 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-03-31T23:19:29.825 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-03-31T23:19:29.826 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-03-31T23:19:29.827 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-03-31T23:19:29.828 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-03-31T23:19:29.829 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-03-31T23:19:29.830 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-03-31T23:19:29.831 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-03-31T23:19:29.832 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-03-31T23:19:29.833 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-03-31T23:19:29.834 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-03-31T23:19:29.835 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-03-31T23:19:29.836 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-03-31T23:19:29.837 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-03-31T23:19:29.838 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-03-31T23:19:29.839 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-03-31T23:19:29.840 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-03-31T23:19:29.841 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-03-31T23:19:29.841 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-03-31T23:19:29.842 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-03-31T23:19:29.843 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-03-31T23:19:29.845 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-03-31T23:19:29.846 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-03-31T23:19:29.848 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-03-31T23:19:29.849 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-03-31T23:19:29.851 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-03-31T23:19:29.853 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-03-31T23:19:29.854 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-03-31T23:19:29.856 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-03-31T23:19:29.857 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-03-31T23:19:29.859 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-03-31T23:19:29.861 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-03-31T23:19:29.862 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-03-31T23:19:29.864 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-03-31T23:19:29.865 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-03-31T23:19:29.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-03-31T23:19:29.869 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-03-31T23:19:29.870 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-03-31T23:19:29.872 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-03-31T23:19:29.873 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-03-31T23:19:29.875 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-03-31T23:19:29.877 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-03-31T23:19:29.878 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-03-31T23:19:29.879 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-03-31T23:19:29.880 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-03-31T23:19:29.881 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-03-31T23:19:29.882 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-03-31T23:19:29.883 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-03-31T23:19:29.884 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-03-31T23:19:29.885 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-03-31T23:19:29.886 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-03-31T23:19:29.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-03-31T23:19:29.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-03-31T23:19:29.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-03-31T23:19:29.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-03-31T23:19:29.891 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-03-31T23:19:29.892 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-03-31T23:19:29.894 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-03-31T23:19:29.895 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-03-31T23:19:29.897 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-03-31T23:19:29.898 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-03-31T23:19:29.900 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-03-31T23:19:29.901 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-03-31T23:19:29.902 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-03-31T23:19:29.903 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-03-31T23:19:29.904 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-03-31T23:19:29.905 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-03-31T23:19:29.906 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-03-31T23:19:29.907 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-03-31T23:19:29.908 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-03-31T23:19:29.909 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-03-31T23:19:29.910 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-03-31T23:19:29.911 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-03-31T23:19:29.912 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-03-31T23:19:29.913 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-03-31T23:19:29.914 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-03-31T23:19:29.915 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-03-31T23:19:29.916 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-03-31T23:19:29.916 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-03-31T23:19:29.917 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-03-31T23:19:29.918 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-03-31T23:19:29.919 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-03-31T23:19:29.920 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-03-31T23:19:29.921 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-03-31T23:19:29.921 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:29 smithi094 ceph-mon[36167]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-03-31T23:19:29.922 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-03-31T23:19:29.924 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-03-31T23:19:29.925 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-03-31T23:19:29.927 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-03-31T23:19:29.929 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-03-31T23:19:29.931 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-03-31T23:19:29.932 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-03-31T23:19:29.934 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-03-31T23:19:29.936 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-03-31T23:19:29.937 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-03-31T23:19:29.939 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-03-31T23:19:29.940 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-03-31T23:19:29.942 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-03-31T23:19:29.944 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-03-31T23:19:29.945 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-03-31T23:19:29.947 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-03-31T23:19:29.948 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-03-31T23:19:29.950 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-03-31T23:19:29.951 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-03-31T23:19:29.953 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-03-31T23:19:29.955 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-03-31T23:19:29.956 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-03-31T23:19:29.957 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-03-31T23:19:29.959 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-03-31T23:19:29.961 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-03-31T23:19:29.962 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-03-31T23:19:29.963 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-03-31T23:19:29.966 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-03-31T23:19:29.967 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-03-31T23:19:29.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:29 smithi188 ceph-mon[36068]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-03-31T23:19:29.968 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-03-31T23:19:29.970 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-03-31T23:19:29.971 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-03-31T23:19:29.973 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-03-31T23:19:29.974 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-03-31T23:19:29.976 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-03-31T23:19:29.977 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-03-31T23:19:29.979 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-03-31T23:19:29.980 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-03-31T23:19:29.982 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-03-31T23:19:29.984 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-03-31T23:19:29.985 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-03-31T23:19:29.987 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-03-31T23:19:29.988 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-03-31T23:19:29.989 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-03-31T23:19:29.990 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-03-31T23:19:29.991 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-03-31T23:19:29.992 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-03-31T23:19:29.993 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-03-31T23:19:29.994 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-03-31T23:19:29.995 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-03-31T23:19:29.996 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-03-31T23:19:29.997 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-03-31T23:19:29.998 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-03-31T23:19:29.999 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-03-31T23:19:30.000 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-03-31T23:19:30.001 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-03-31T23:19:30.002 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-03-31T23:19:30.003 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-03-31T23:19:30.004 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-03-31T23:19:30.005 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-03-31T23:19:30.006 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-03-31T23:19:30.007 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-03-31T23:19:30.008 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-03-31T23:19:30.008 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-03-31T23:19:30.010 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-03-31T23:19:30.010 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-03-31T23:19:30.011 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-03-31T23:19:30.012 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-03-31T23:19:30.013 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-03-31T23:19:30.014 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-03-31T23:19:30.015 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-03-31T23:19:30.016 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-03-31T23:19:30.017 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-03-31T23:19:30.018 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-03-31T23:19:30.019 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-03-31T23:19:30.020 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-03-31T23:19:30.021 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-03-31T23:19:30.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-03-31T23:19:30.023 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-03-31T23:19:30.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-03-31T23:19:30.025 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-03-31T23:19:30.026 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-03-31T23:19:30.027 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-03-31T23:19:30.028 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-03-31T23:19:30.029 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-03-31T23:19:30.030 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-03-31T23:19:30.031 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-03-31T23:19:30.032 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-03-31T23:19:30.033 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-03-31T23:19:30.034 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-03-31T23:19:30.035 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-03-31T23:19:30.036 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-03-31T23:19:30.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-03-31T23:19:30.038 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-03-31T23:19:30.039 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-03-31T23:19:30.040 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-03-31T23:19:30.041 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-03-31T23:19:30.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-03-31T23:19:30.043 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-03-31T23:19:30.044 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-03-31T23:19:30.045 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-03-31T23:19:30.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-03-31T23:19:30.047 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-03-31T23:19:30.048 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-03-31T23:19:30.049 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-03-31T23:19:30.050 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-03-31T23:19:30.051 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-03-31T23:19:30.052 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-03-31T23:19:30.053 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-03-31T23:19:30.054 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-03-31T23:19:30.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-03-31T23:19:30.056 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-03-31T23:19:30.057 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-03-31T23:19:30.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-03-31T23:19:30.059 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-03-31T23:19:30.060 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-03-31T23:19:30.061 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-03-31T23:19:30.062 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-03-31T23:19:30.063 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-03-31T23:19:30.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-03-31T23:19:30.065 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-03-31T23:19:30.066 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-03-31T23:19:30.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-03-31T23:19:30.068 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-03-31T23:19:30.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-03-31T23:19:30.071 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-03-31T23:19:30.073 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-03-31T23:19:30.074 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-03-31T23:19:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:29 smithi042 ceph-mon[32380]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-03-31T23:19:30.076 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-03-31T23:19:30.077 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-03-31T23:19:30.079 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-03-31T23:19:30.081 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-03-31T23:19:30.082 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-03-31T23:19:30.083 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-03-31T23:19:30.085 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-03-31T23:19:30.086 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-03-31T23:19:30.088 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-03-31T23:19:30.089 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-03-31T23:19:30.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-03-31T23:19:30.092 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-03-31T23:19:30.094 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-03-31T23:19:30.095 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-03-31T23:19:30.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-03-31T23:19:30.098 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-03-31T23:19:30.100 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-03-31T23:19:30.102 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-03-31T23:19:30.103 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-03-31T23:19:30.105 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-03-31T23:19:30.106 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-03-31T23:19:30.108 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-03-31T23:19:30.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-03-31T23:19:30.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-03-31T23:19:30.111 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-03-31T23:19:30.112 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-03-31T23:19:30.113 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-03-31T23:19:30.115 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-03-31T23:19:30.116 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-03-31T23:19:30.117 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-03-31T23:19:30.118 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-03-31T23:19:30.119 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-03-31T23:19:30.120 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-03-31T23:19:30.121 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-03-31T23:19:30.122 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-03-31T23:19:30.123 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-03-31T23:19:30.124 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-03-31T23:19:30.125 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-03-31T23:19:30.126 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-03-31T23:19:30.128 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-03-31T23:19:30.129 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-03-31T23:19:30.130 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-03-31T23:19:30.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-03-31T23:19:30.132 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-03-31T23:19:30.133 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-03-31T23:19:30.134 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-03-31T23:19:30.135 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-03-31T23:19:30.136 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-03-31T23:19:30.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-03-31T23:19:30.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-03-31T23:19:30.139 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-03-31T23:19:30.140 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-03-31T23:19:30.141 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-03-31T23:19:30.142 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-03-31T23:19:30.143 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-03-31T23:19:30.144 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-03-31T23:19:30.145 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-03-31T23:19:30.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-03-31T23:19:30.147 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-03-31T23:19:30.148 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-03-31T23:19:30.149 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-03-31T23:19:30.150 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-03-31T23:19:30.151 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-03-31T23:19:30.153 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-03-31T23:19:30.154 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-03-31T23:19:30.156 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-03-31T23:19:30.157 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-03-31T23:19:30.158 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-03-31T23:19:30.160 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-03-31T23:19:30.161 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-03-31T23:19:30.164 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-03-31T23:19:30.166 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-03-31T23:19:30.167 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-03-31T23:19:30.169 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-03-31T23:19:30.170 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-03-31T23:19:30.171 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-03-31T23:19:30.173 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-03-31T23:19:30.174 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-03-31T23:19:30.175 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-03-31T23:19:30.176 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-03-31T23:19:30.176 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-03-31T23:19:30.178 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-03-31T23:19:30.179 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-03-31T23:19:30.181 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-03-31T23:19:30.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-03-31T23:19:30.183 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-03-31T23:19:30.185 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-03-31T23:19:30.186 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-03-31T23:19:30.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-03-31T23:19:30.189 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-03-31T23:19:30.191 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-03-31T23:19:30.192 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-03-31T23:19:30.193 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-03-31T23:19:30.194 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-03-31T23:19:30.196 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-03-31T23:19:30.198 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-03-31T23:19:30.199 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-03-31T23:19:30.201 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-03-31T23:19:30.202 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-03-31T23:19:30.203 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-03-31T23:19:30.204 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-03-31T23:19:30.205 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-03-31T23:19:30.206 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-03-31T23:19:30.208 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-03-31T23:19:30.209 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-03-31T23:19:30.211 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-03-31T23:19:30.214 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-03-31T23:19:30.214 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-03-31T23:19:30.216 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-03-31T23:19:30.217 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-03-31T23:19:30.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-03-31T23:19:30.220 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-03-31T23:19:30.222 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-03-31T23:19:30.223 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-03-31T23:19:30.224 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-03-31T23:19:30.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-03-31T23:19:30.226 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-03-31T23:19:30.227 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-03-31T23:19:30.228 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-03-31T23:19:30.229 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-03-31T23:19:30.230 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-03-31T23:19:30.231 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-03-31T23:19:30.232 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-03-31T23:19:30.233 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-03-31T23:19:30.234 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-03-31T23:19:30.235 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-03-31T23:19:30.236 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-03-31T23:19:30.237 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-03-31T23:19:30.238 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-03-31T23:19:30.239 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-03-31T23:19:30.240 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-03-31T23:19:30.241 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-03-31T23:19:30.242 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-03-31T23:19:30.243 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-03-31T23:19:30.244 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-03-31T23:19:30.245 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-03-31T23:19:30.247 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-03-31T23:19:30.248 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-03-31T23:19:30.250 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-03-31T23:19:30.252 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-03-31T23:19:30.253 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-03-31T23:19:30.255 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-03-31T23:19:30.256 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-03-31T23:19:30.257 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-03-31T23:19:30.258 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-03-31T23:19:30.259 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-03-31T23:19:30.260 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-03-31T23:19:30.261 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-03-31T23:19:30.262 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-03-31T23:19:30.263 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-03-31T23:19:30.264 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-03-31T23:19:30.265 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-03-31T23:19:30.266 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-03-31T23:19:30.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-03-31T23:19:30.268 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-03-31T23:19:30.269 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-03-31T23:19:30.271 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-03-31T23:19:30.272 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-03-31T23:19:30.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-03-31T23:19:30.276 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-03-31T23:19:30.277 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-03-31T23:19:30.278 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-03-31T23:19:30.279 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-03-31T23:19:30.280 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-03-31T23:19:30.281 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-03-31T23:19:30.282 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-03-31T23:19:30.283 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-03-31T23:19:30.284 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-03-31T23:19:30.285 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-03-31T23:19:30.286 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-03-31T23:19:30.287 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-03-31T23:19:30.288 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-03-31T23:19:30.289 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-03-31T23:19:30.290 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-03-31T23:19:30.291 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-03-31T23:19:30.292 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-03-31T23:19:30.294 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-03-31T23:19:30.295 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-03-31T23:19:30.296 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-03-31T23:19:30.297 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-03-31T23:19:30.298 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-03-31T23:19:30.299 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-03-31T23:19:30.300 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-03-31T23:19:30.301 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-03-31T23:19:30.302 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-03-31T23:19:30.303 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-03-31T23:19:30.304 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-03-31T23:19:30.305 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-03-31T23:19:30.306 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-03-31T23:19:30.307 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-03-31T23:19:30.603 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-03-31T23:19:30.605 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-03-31T23:19:30.606 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-03-31T23:19:30.608 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-03-31T23:19:30.609 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-03-31T23:19:30.610 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-03-31T23:19:30.612 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-03-31T23:19:30.614 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-03-31T23:19:30.615 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-03-31T23:19:30.616 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-03-31T23:19:30.617 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-03-31T23:19:30.618 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-03-31T23:19:30.619 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-03-31T23:19:30.620 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-03-31T23:19:30.621 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-03-31T23:19:30.622 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-03-31T23:19:30.623 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-03-31T23:19:30.624 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-03-31T23:19:30.624 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-03-31T23:19:30.626 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-03-31T23:19:30.628 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-03-31T23:19:30.629 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-03-31T23:19:30.630 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-03-31T23:19:30.630 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-03-31T23:19:30.631 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-03-31T23:19:30.632 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-03-31T23:19:30.633 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-03-31T23:19:30.634 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-03-31T23:19:30.635 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-03-31T23:19:30.636 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-03-31T23:19:30.637 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-03-31T23:19:30.638 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-03-31T23:19:30.639 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-03-31T23:19:30.640 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-03-31T23:19:30.641 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-03-31T23:19:30.642 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-03-31T23:19:30.644 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-03-31T23:19:30.645 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-03-31T23:19:30.647 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-03-31T23:19:30.649 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-03-31T23:19:30.650 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-03-31T23:19:30.652 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-03-31T23:19:30.653 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-03-31T23:19:30.655 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-03-31T23:19:30.655 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-03-31T23:19:30.657 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-03-31T23:19:30.658 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-03-31T23:19:30.659 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-03-31T23:19:30.661 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-03-31T23:19:30.662 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-03-31T23:19:30.664 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-03-31T23:19:30.665 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-03-31T23:19:30.667 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-03-31T23:19:30.668 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-03-31T23:19:30.669 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-03-31T23:19:30.671 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-03-31T23:19:30.673 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-03-31T23:19:30.674 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-03-31T23:19:30.676 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-03-31T23:19:30.676 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-03-31T23:19:30.677 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-03-31T23:19:30.678 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-03-31T23:19:30.679 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-03-31T23:19:30.680 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-03-31T23:19:30.681 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-03-31T23:19:30.682 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-03-31T23:19:30.683 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-03-31T23:19:30.684 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-03-31T23:19:30.685 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-03-31T23:19:30.686 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-03-31T23:19:30.688 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-03-31T23:19:30.689 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-03-31T23:19:30.691 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-03-31T23:19:30.692 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-03-31T23:19:30.694 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-03-31T23:19:30.695 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-03-31T23:19:30.697 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-03-31T23:19:30.699 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-03-31T23:19:30.700 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-03-31T23:19:30.702 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-03-31T23:19:30.703 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-03-31T23:19:30.705 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-03-31T23:19:30.706 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-03-31T23:19:30.708 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-03-31T23:19:30.709 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-03-31T23:19:30.711 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-03-31T23:19:30.712 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-03-31T23:19:30.714 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-03-31T23:19:30.715 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-03-31T23:19:30.717 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-03-31T23:19:30.719 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-03-31T23:19:30.720 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-03-31T23:19:30.722 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-03-31T23:19:30.723 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-03-31T23:19:30.725 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-03-31T23:19:30.726 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-03-31T23:19:30.728 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-03-31T23:19:30.729 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-03-31T23:19:30.731 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-03-31T23:19:30.733 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-03-31T23:19:30.734 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-03-31T23:19:30.736 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-03-31T23:19:30.737 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-03-31T23:19:30.739 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-03-31T23:19:30.740 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-03-31T23:19:30.742 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-03-31T23:19:30.743 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-03-31T23:19:30.745 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-03-31T23:19:30.746 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-03-31T23:19:30.748 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-03-31T23:19:30.749 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-03-31T23:19:30.750 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-03-31T23:19:30.752 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-03-31T23:19:30.753 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-03-31T23:19:30.754 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-03-31T23:19:30.756 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-03-31T23:19:30.757 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-03-31T23:19:30.759 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-03-31T23:19:30.760 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-03-31T23:19:30.762 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-03-31T23:19:30.763 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-03-31T23:19:30.764 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-03-31T23:19:30.766 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-03-31T23:19:30.767 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-03-31T23:19:30.769 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-03-31T23:19:30.770 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-03-31T23:19:30.772 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-03-31T23:19:30.773 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-03-31T23:19:30.774 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-03-31T23:19:30.776 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-03-31T23:19:30.778 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-03-31T23:19:30.779 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-03-31T23:19:30.781 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-03-31T23:19:30.782 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-03-31T23:19:30.784 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-03-31T23:19:30.785 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-03-31T23:19:30.787 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-03-31T23:19:30.788 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-03-31T23:19:30.789 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-03-31T23:19:30.791 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-03-31T23:19:30.792 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-03-31T23:19:30.794 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-03-31T23:19:30.796 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-03-31T23:19:30.797 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-03-31T23:19:30.798 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-03-31T23:19:30.800 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-03-31T23:19:30.802 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-03-31T23:19:30.803 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-03-31T23:19:30.805 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-03-31T23:19:30.806 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-03-31T23:19:30.808 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-03-31T23:19:30.809 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-03-31T23:19:30.811 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-03-31T23:19:30.812 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-03-31T23:19:30.814 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-03-31T23:19:30.815 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-03-31T23:19:30.815 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-03-31T23:19:30.817 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-03-31T23:19:30.818 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-03-31T23:19:30.819 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-03-31T23:19:30.820 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-03-31T23:19:30.822 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-03-31T23:19:30.823 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-03-31T23:19:30.825 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-03-31T23:19:30.826 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-03-31T23:19:30.828 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-03-31T23:19:30.829 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-03-31T23:19:30.831 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-03-31T23:19:30.832 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-03-31T23:19:30.834 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-03-31T23:19:30.835 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-03-31T23:19:30.837 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-03-31T23:19:30.838 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-03-31T23:19:30.840 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-03-31T23:19:30.841 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-03-31T23:19:30.843 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-03-31T23:19:30.844 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-03-31T23:19:30.846 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-03-31T23:19:30.847 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-03-31T23:19:30.849 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-03-31T23:19:30.850 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-03-31T23:19:30.852 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-03-31T23:19:30.853 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-03-31T23:19:30.854 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-03-31T23:19:30.856 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-03-31T23:19:30.858 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-03-31T23:19:30.859 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-03-31T23:19:30.861 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-03-31T23:19:30.862 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-03-31T23:19:30.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-03-31T23:19:30.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-03-31T23:19:30.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-03-31T23:19:30.868 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-03-31T23:19:30.869 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-03-31T23:19:30.870 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-03-31T23:19:30.871 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-03-31T23:19:30.873 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-03-31T23:19:30.874 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-03-31T23:19:30.875 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-03-31T23:19:30.876 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-03-31T23:19:30.877 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-03-31T23:19:30.878 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-03-31T23:19:30.880 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-03-31T23:19:30.881 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-03-31T23:19:30.882 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-03-31T23:19:30.883 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-03-31T23:19:30.884 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-03-31T23:19:30.885 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-03-31T23:19:30.886 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-03-31T23:19:30.887 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-03-31T23:19:30.889 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-03-31T23:19:30.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-03-31T23:19:30.891 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-03-31T23:19:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-03-31T23:19:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-03-31T23:19:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-03-31T23:19:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-03-31T23:19:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-03-31T23:19:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-03-31T23:19:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-03-31T23:19:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-03-31T23:19:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-03-31T23:19:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-03-31T23:19:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-03-31T23:19:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-03-31T23:19:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-03-31T23:19:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-03-31T23:19:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-03-31T23:19:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-03-31T23:19:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-03-31T23:19:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-03-31T23:19:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-03-31T23:19:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-03-31T23:19:30.920 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-03-31T23:19:30.920 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-03-31T23:19:30.922 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-03-31T23:19:30.924 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-03-31T23:19:30.925 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-03-31T23:19:30.927 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-03-31T23:19:30.929 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-03-31T23:19:30.930 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-03-31T23:19:30.932 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-03-31T23:19:30.933 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-03-31T23:19:30.934 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-03-31T23:19:30.935 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-03-31T23:19:30.936 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-03-31T23:19:30.938 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-03-31T23:19:30.939 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-03-31T23:19:30.940 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-03-31T23:19:30.941 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-03-31T23:19:30.942 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-03-31T23:19:30.943 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-03-31T23:19:30.945 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-03-31T23:19:30.946 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-03-31T23:19:30.947 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-03-31T23:19:30.948 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-03-31T23:19:30.949 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-03-31T23:19:30.950 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-03-31T23:19:30.951 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-03-31T23:19:30.953 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-03-31T23:19:30.954 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-03-31T23:19:30.955 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-03-31T23:19:30.956 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-03-31T23:19:30.958 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-03-31T23:19:30.959 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-03-31T23:19:30.960 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-03-31T23:19:30.961 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-03-31T23:19:30.962 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-03-31T23:19:30.964 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-03-31T23:19:30.965 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-03-31T23:19:30.966 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-03-31T23:19:30.967 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-03-31T23:19:30.969 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-03-31T23:19:30.970 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-03-31T23:19:30.971 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-03-31T23:19:30.973 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-03-31T23:19:30.974 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-03-31T23:19:30.975 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-03-31T23:19:30.976 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-03-31T23:19:30.977 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-03-31T23:19:30.979 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-03-31T23:19:30.980 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-03-31T23:19:30.981 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-03-31T23:19:30.983 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-03-31T23:19:30.984 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-03-31T23:19:30.985 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-03-31T23:19:30.986 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-03-31T23:19:30.987 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-03-31T23:19:30.989 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-03-31T23:19:30.990 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-03-31T23:19:30.991 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-03-31T23:19:30.992 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-03-31T23:19:30.994 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-03-31T23:19:30.995 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-03-31T23:19:30.996 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-03-31T23:19:30.997 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-03-31T23:19:30.998 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-03-31T23:19:30.999 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-03-31T23:19:31.001 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-03-31T23:19:31.002 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-03-31T23:19:31.003 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-03-31T23:19:31.004 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-03-31T23:19:31.006 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-03-31T23:19:31.007 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-03-31T23:19:31.008 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-03-31T23:19:31.009 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-03-31T23:19:31.010 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-03-31T23:19:31.012 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-03-31T23:19:31.013 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-03-31T23:19:31.014 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-03-31T23:19:31.015 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-03-31T23:19:31.016 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-03-31T23:19:31.018 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-03-31T23:19:31.019 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-03-31T23:19:31.020 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-03-31T23:19:31.021 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-03-31T23:19:31.023 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-03-31T23:19:31.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-03-31T23:19:31.025 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-03-31T23:19:31.026 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-03-31T23:19:31.027 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-03-31T23:19:31.028 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-03-31T23:19:31.030 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-03-31T23:19:31.031 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-03-31T23:19:31.033 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-03-31T23:19:31.035 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-03-31T23:19:31.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-03-31T23:19:31.039 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-03-31T23:19:31.041 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-03-31T23:19:31.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 -- 172.21.15.42:0/3590365649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58101760 msgr2=0x7f1b5810d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/3590365649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58101760 0x7f1b5810d4e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009cd0 tx=0x7f1b5002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 -- 172.21.15.42:0/3590365649 shutdown_connections 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/3590365649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58101760 0x7f1b5810d4e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/3590365649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b58100da0 0x7f1b58101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/3590365649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58106620 0x7f1b58106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 -- 172.21.15.42:0/3590365649 >> 172.21.15.42:0/3590365649 conn(0x7f1b58076b70 msgr2=0x7f1b580fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 -- 172.21.15.42:0/3590365649 shutdown_connections 2024-03-31T23:19:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.043+0000 7f1b5da8f640 1 -- 172.21.15.42:0/3590365649 wait complete. 2024-03-31T23:19:31.045 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-03-31T23:19:31.047 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 Processor -- start 2024-03-31T23:19:31.047 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 -- start start 2024-03-31T23:19:31.047 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 0x7f1b58196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b58101760 0x7f1b58197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58106620 0x7f1b5819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b58110b50 con 0x7f1b58106620 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581109d0 con 0x7f1b58100da0 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b5da8f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b58110cd0 con 0x7f1b58101760 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 0x7f1b58196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58106620 0x7f1b5819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 0x7f1b58196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:45336/0 (socket says 172.21.15.42:45336) 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b577fe640 1 -- 172.21.15.42:0/2417575813 learned_addr learned my addr 172.21.15.42:0/2417575813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.044+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b58101760 0x7f1b58197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b577fe640 1 -- 172.21.15.42:0/2417575813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b58101760 msgr2=0x7f1b58197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b577fe640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b58101760 0x7f1b58197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b577fe640 1 -- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58106620 msgr2=0x7f1b5819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b577fe640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58106620 0x7f1b5819b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b577fe640 1 -- 172.21.15.42:0/2417575813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5819bf40 con 0x7f1b58100da0 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b57fff640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58106620 0x7f1b5819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b577fe640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 0x7f1b58196f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800eb00 tx=0x7f1b48009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b54ff9640 1 -- 172.21.15.42:0/2417575813 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4801c070 con 0x7f1b58100da0 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5819c230 con 0x7f1b58100da0 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b54ff9640 1 -- 172.21.15.42:0/2417575813 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b4800bc30 con 0x7f1b58100da0 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b54ff9640 1 -- 172.21.15.42:0/2417575813 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48016730 con 0x7f1b58100da0 2024-03-31T23:19:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.045+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b580ffc90 con 0x7f1b58100da0 2024-03-31T23:19:31.049 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-03-31T23:19:31.050 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.047+0000 7f1b54ff9640 1 -- 172.21.15.42:0/2417575813 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f1b4801f070 con 0x7f1b58100da0 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.047+0000 7f1b6067a740 1 Processor -- start 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.047+0000 7f1b6067a740 1 -- start start 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591c6c0 0x561b4591caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b45925870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b45925db0 0x561b459281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b6067a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b4587f8f0 con 0x561b4591c6c0 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b6067a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x561b458288d0 con 0x561b4591cfe0 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b6067a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561b4587b990 con 0x561b45925db0 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591c6c0 0x561b4591caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591c6c0 0x561b4591caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36784/0 (socket says 172.21.15.42:36784) 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b45925db0 0x561b459281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b45925870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b57fff640 1 -- 172.21.15.42:0/3825835698 learned_addr learned my addr 172.21.15.42:0/3825835698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b54ff9640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1b400a27d0 0x7f1b400a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 -- 172.21.15.42:0/3825835698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 msgr2=0x561b45925870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b45925870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 -- 172.21.15.42:0/3825835698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591c6c0 msgr2=0x561b4591caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591c6c0 0x561b4591caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 -- 172.21.15.42:0/3825835698 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b45594210 con 0x561b45925db0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b54ff9640 1 -- 172.21.15.42:0/2417575813 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f1b480d0730 con 0x7f1b58100da0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b57fff640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1b400a27d0 0x7f1b400a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.048+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b45925db0 0x561b459281a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009bd0 tx=0x7f1b4c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5f7bb48deae759 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b3dffb640 1 -- 172.21.15.42:0/3825835698 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c004230 con 0x561b45925db0 2024-03-31T23:19:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b3dffb640 1 -- 172.21.15.42:0/3825835698 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b4c009e40 con 0x561b45925db0 2024-03-31T23:19:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b3dffb640 1 -- 172.21.15.42:0/3825835698 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c004e10 con 0x561b45925db0 2024-03-31T23:19:31.054 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-03-31T23:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 -- 172.21.15.42:0/3825835698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b45925db0 msgr2=0x561b459281a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b57fff640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1b400a27d0 0x7f1b400a4c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b50035fd0 tx=0x7f1b5002e040 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b45925db0 0x561b459281a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009bd0 tx=0x7f1b4c011810 comp rx=0 tx=0).stop 2024-03-31T23:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 -- 172.21.15.42:0/3825835698 shutdown_connections 2024-03-31T23:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b45925db0 0x561b459281a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b45925870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 --2- 172.21.15.42:0/3825835698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591c6c0 0x561b4591caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 -- 172.21.15.42:0/3825835698 >> 172.21.15.42:0/3825835698 conn(0x561b45916fe0 msgr2=0x561b459173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 -- 172.21.15.42:0/3825835698 shutdown_connections 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.049+0000 7f1b6067a740 1 -- 172.21.15.42:0/3825835698 wait complete. 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 -- start start 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 Processor -- start 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45922df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591cfe0 0x561b45923330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b45925db0 0x561b45923870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b459289e0 con 0x561b4591cfe0 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x561b4581df80 con 0x561b45925db0 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561b45928b60 con 0x561b4591c6c0 2024-03-31T23:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b6067a740 10 client.0 _ll_register_callbacks cb 0x561b45876290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b56ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591cfe0 0x561b45923330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45922df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45922df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33150/0 (socket says 172.21.15.42:33150) 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b577fe640 1 -- 172.21.15.42:0/4119882969 learned_addr learned my addr 172.21.15.42:0/4119882969 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b57fff640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b45925db0 0x561b45923870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b56ffd640 1 -- 172.21.15.42:0/4119882969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 msgr2=0x561b45922df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45922df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b56ffd640 1 -- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b45925db0 msgr2=0x561b45923870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b45925db0 0x561b45923870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b56ffd640 1 -- 172.21.15.42:0/4119882969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b45660620 con 0x561b4591cfe0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.050+0000 7f1b577fe640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45922df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591cfe0 0x561b45923330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x561b45918400 tx=0x7f1b4c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bac1faef41d73f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b36ffd640 1 -- 172.21.15.42:0/4119882969 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c027020 con 0x561b4591cfe0 2024-03-31T23:19:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b36ffd640 1 -- 172.21.15.42:0/4119882969 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f1b4c0037f0 con 0x561b4591cfe0 2024-03-31T23:19:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b45893120 con 0x561b4591cfe0 2024-03-31T23:19:31.059 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b36ffd640 1 -- 172.21.15.42:0/4119882969 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1b4c032050 con 0x561b4591cfe0 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 10 client.16191 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561b459348d0 con 0x561b4591cfe0 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b36ffd640 1 -- 172.21.15.42:0/4119882969 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x561b45893120 con 0x561b4591cfe0 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b36ffd640 1 -- 172.21.15.42:0/4119882969 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1b4c018070 con 0x561b4591cfe0 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 10 client.16191 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 20 client.16191 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45935c80 0x561b45938070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 4 client.16191 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.051+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b4588ce30 con 0x561b45935c80 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.052+0000 7f1b577fe640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45935c80 0x561b45938070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.052+0000 7f1b577fe640 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45935c80 0x561b45938070 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6499acd237dd1a23 server_cookie=e4115909cd975552 in_seq=0 out_seq=0 2024-03-31T23:19:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.052+0000 7f1b36ffd640 10 client.16191 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:31.061 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-03-31T23:19:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b36ffd640 1 -- 172.21.15.42:0/4119882969 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561b4588ce30 con 0x561b45935c80 2024-03-31T23:19:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b36ffd640 10 client.16191 handle_command_reply: tid=0 2024-03-31T23:19:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 client.16191 shutdown 2024-03-31T23:19:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591cfe0 msgr2=0x561b45923330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591cfe0 0x561b45923330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x561b45918400 tx=0x7f1b4c009890 comp rx=0 tx=0).stop 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 shutdown_connections 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45935c80 0x561b45938070 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b45925db0 0x561b45923870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b4591cfe0 0x561b45923330 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b36ffd640 0 client.16191 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 --2- 172.21.15.42:0/4119882969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45922df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 >> 172.21.15.42:0/4119882969 conn(0x561b45916fe0 msgr2=0x561b45918d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 shutdown_connections 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 1 -- 172.21.15.42:0/4119882969 wait complete. 2024-03-31T23:19:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.055+0000 7f1b6067a740 20 client.16191 trim_cache size 0 max 16384 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-03-31T23:19:31.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-03-31T23:19:31.065 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-03-31T23:19:31.066 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-03-31T23:19:31.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-03-31T23:19:31.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-03-31T23:19:31.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-03-31T23:19:31.071 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-03-31T23:19:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.071+0000 7f1b6067a740 1 Processor -- start 2024-03-31T23:19:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.071+0000 7f1b6067a740 1 -- start start 2024-03-31T23:19:31.072 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-03-31T23:19:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b45925520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45931780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4593d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b6067a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581ac990 con 0x561b45916fe0 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b6067a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581ae4d0 con 0x561b4591cfe0 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b6067a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581ad060 con 0x561b4591c6c0 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b45925520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b56ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45931780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b45925520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36798/0 (socket says 172.21.15.42:36798) 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 -- 172.21.15.42:0/2522549833 learned_addr learned my addr 172.21.15.42:0/2522549833 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b57fff640 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4593d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 -- 172.21.15.42:0/2522549833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 msgr2=0x561b45931780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45931780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 -- 172.21.15.42:0/2522549833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 msgr2=0x561b4593d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4593d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 -- 172.21.15.42:0/2522549833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b459281a0 con 0x561b45916fe0 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45931780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b577fe640 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b45925520 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b750 tx=0x7f1b480d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63dfbf325db997d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b3d7fa640 1 -- 172.21.15.42:0/2522549833 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480b4070 con 0x561b45916fe0 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b3d7fa640 1 -- 172.21.15.42:0/2522549833 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b48017a10 con 0x561b45916fe0 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.072+0000 7f1b3d7fa640 1 -- 172.21.15.42:0/2522549833 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480a5070 con 0x561b45916fe0 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 -- 172.21.15.42:0/2522549833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 msgr2=0x561b45925520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b45925520 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b750 tx=0x7f1b480d2040 comp rx=0 tx=0).stop 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 -- 172.21.15.42:0/2522549833 shutdown_connections 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4593d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45931780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 --2- 172.21.15.42:0/2522549833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b45925520 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 -- 172.21.15.42:0/2522549833 >> 172.21.15.42:0/2522549833 conn(0x561b459383e0 msgr2=0x561b459173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:31.077 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 -- 172.21.15.42:0/2522549833 shutdown_connections 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 -- 172.21.15.42:0/2522549833 wait complete. 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 -- start start 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.073+0000 7f1b6067a740 1 Processor -- start 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b459298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45929de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4592a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581ade00 con 0x561b45916fe0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581ad730 con 0x561b4591cfe0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581aa950 con 0x561b4591c6c0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 10 client.0 _ll_register_callbacks cb 0x7f1b48005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b459298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b459298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36806/0 (socket says 172.21.15.42:36806) 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 -- 172.21.15.42:0/1682253499 learned_addr learned my addr 172.21.15.42:0/1682253499 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b57fff640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4592a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45929de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 -- 172.21.15.42:0/1682253499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 msgr2=0x561b45929de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45929de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 -- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 msgr2=0x561b4592a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4592a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 -- 172.21.15.42:0/1682253499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4599b050 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b577fe640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b459298a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1b48017cb0 tx=0x7f1b48005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a4b8f36c456c1c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b36ffd640 1 -- 172.21.15.42:0/1682253499 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480b9020 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b36ffd640 1 -- 172.21.15.42:0/1682253499 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f1b480a5070 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.074+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b45887180 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b36ffd640 1 -- 172.21.15.42:0/1682253499 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1b480b4030 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 10 client.16197 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561b4599c340 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b36ffd640 1 -- 172.21.15.42:0/1682253499 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x561b45887180 con 0x561b45916fe0 2024-03-31T23:19:31.081 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-03-31T23:19:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b36ffd640 1 -- 172.21.15.42:0/1682253499 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1b480870f0 con 0x561b45916fe0 2024-03-31T23:19:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 10 client.16197 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 20 client.16197 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45925db0 0x561b4599ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 4 client.16197 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:19:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b45805770 con 0x561b45925db0 2024-03-31T23:19:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45925db0 0x561b4599ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b36ffd640 10 client.16197 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:31.075+0000 7f1b56ffd640 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45925db0 0x561b4599ea60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=843ba4fd3ead7b50 server_cookie=b097d945401620ec in_seq=0 out_seq=0 2024-03-31T23:19:31.083 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-03-31T23:19:31.084 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-03-31T23:19:31.084 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-03-31T23:19:31.084 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-03-31T23:19:31.084 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-03-31T23:19:31.086 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-03-31T23:19:31.087 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-03-31T23:19:31.089 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-03-31T23:19:31.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-03-31T23:19:31.093 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-03-31T23:19:31.095 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-03-31T23:19:31.096 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-03-31T23:19:31.098 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-03-31T23:19:31.099 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-03-31T23:19:31.101 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-03-31T23:19:31.102 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-03-31T23:19:31.103 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-03-31T23:19:31.104 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-03-31T23:19:31.106 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-03-31T23:19:31.107 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-03-31T23:19:31.108 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-03-31T23:19:31.109 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-03-31T23:19:31.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-03-31T23:19:31.111 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-03-31T23:19:31.112 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-03-31T23:19:31.114 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-03-31T23:19:31.115 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-03-31T23:19:31.116 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-03-31T23:19:31.117 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-03-31T23:19:31.118 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-03-31T23:19:31.119 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-03-31T23:19:31.120 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-03-31T23:19:31.121 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-03-31T23:19:31.123 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-03-31T23:19:31.124 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-03-31T23:19:31.125 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-03-31T23:19:31.126 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-03-31T23:19:31.127 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-03-31T23:19:31.128 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-03-31T23:19:31.129 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-03-31T23:19:31.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-03-31T23:19:31.132 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-03-31T23:19:31.133 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-03-31T23:19:31.134 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-03-31T23:19:31.135 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-03-31T23:19:31.136 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-03-31T23:19:31.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-03-31T23:19:31.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-03-31T23:19:31.140 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-03-31T23:19:31.141 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-03-31T23:19:31.142 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-03-31T23:19:31.143 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-03-31T23:19:31.144 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-03-31T23:19:31.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-03-31T23:19:31.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-03-31T23:19:31.148 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-03-31T23:19:31.149 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-03-31T23:19:31.150 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-03-31T23:19:31.151 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-03-31T23:19:31.152 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-03-31T23:19:31.153 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-03-31T23:19:31.154 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-03-31T23:19:31.156 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-03-31T23:19:31.157 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-03-31T23:19:31.158 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-03-31T23:19:31.159 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-03-31T23:19:31.160 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-03-31T23:19:31.161 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-03-31T23:19:31.163 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-03-31T23:19:31.164 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-03-31T23:19:31.166 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-03-31T23:19:31.167 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-03-31T23:19:31.168 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-03-31T23:19:31.170 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-03-31T23:19:31.171 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-03-31T23:19:31.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-03-31T23:19:31.173 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-03-31T23:19:31.174 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-03-31T23:19:31.175 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-03-31T23:19:31.177 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-03-31T23:19:31.178 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-03-31T23:19:31.179 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-03-31T23:19:31.180 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-03-31T23:19:31.181 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-03-31T23:19:31.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-03-31T23:19:31.183 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-03-31T23:19:31.185 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-03-31T23:19:31.186 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-03-31T23:19:31.187 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-03-31T23:19:31.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-03-31T23:19:31.190 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-03-31T23:19:31.191 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-03-31T23:19:31.192 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-03-31T23:19:31.193 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-03-31T23:19:31.194 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-03-31T23:19:31.195 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-03-31T23:19:31.197 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-03-31T23:19:31.198 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-03-31T23:19:31.199 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-03-31T23:19:31.200 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-03-31T23:19:31.201 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-03-31T23:19:31.202 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-03-31T23:19:31.204 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-03-31T23:19:31.205 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-03-31T23:19:31.206 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-03-31T23:19:31.207 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-03-31T23:19:31.209 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-03-31T23:19:31.210 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-03-31T23:19:31.211 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-03-31T23:19:31.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-03-31T23:19:31.214 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-03-31T23:19:31.215 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-03-31T23:19:31.216 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-03-31T23:19:31.218 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-03-31T23:19:31.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-03-31T23:19:31.220 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-03-31T23:19:31.221 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-03-31T23:19:31.223 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-03-31T23:19:31.224 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-03-31T23:19:31.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-03-31T23:19:31.226 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-03-31T23:19:31.228 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-03-31T23:19:31.229 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-03-31T23:19:31.230 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-03-31T23:19:31.231 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-03-31T23:19:31.232 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-03-31T23:19:31.233 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-03-31T23:19:31.235 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-03-31T23:19:31.236 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-03-31T23:19:31.237 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-03-31T23:19:31.238 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-03-31T23:19:31.239 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-03-31T23:19:31.240 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-03-31T23:19:31.242 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-03-31T23:19:31.243 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-03-31T23:19:31.245 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-03-31T23:19:31.246 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-03-31T23:19:31.247 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-03-31T23:19:31.249 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-03-31T23:19:31.251 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-03-31T23:19:31.252 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-03-31T23:19:31.253 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-03-31T23:19:31.255 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-03-31T23:19:31.256 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-03-31T23:19:31.257 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-03-31T23:19:31.258 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-03-31T23:19:31.260 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-03-31T23:19:31.261 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-03-31T23:19:31.263 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-03-31T23:19:31.265 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-03-31T23:19:31.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-03-31T23:19:31.268 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-03-31T23:19:31.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-03-31T23:19:31.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-03-31T23:19:31.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-03-31T23:19:31.276 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-03-31T23:19:31.278 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-03-31T23:19:31.279 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-03-31T23:19:31.281 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-03-31T23:19:31.283 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-03-31T23:19:31.285 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-03-31T23:19:31.287 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-03-31T23:19:31.289 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-03-31T23:19:31.290 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-03-31T23:19:31.292 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-03-31T23:19:31.293 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-03-31T23:19:31.295 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-03-31T23:19:31.297 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-03-31T23:19:31.298 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-03-31T23:19:31.299 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-03-31T23:19:31.300 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-03-31T23:19:31.302 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-03-31T23:19:31.303 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-03-31T23:19:31.304 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-03-31T23:19:31.305 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-03-31T23:19:31.306 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-03-31T23:19:31.309 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-03-31T23:19:31.310 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-03-31T23:19:31.311 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-03-31T23:19:31.313 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-03-31T23:19:31.314 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-03-31T23:19:31.315 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-03-31T23:19:31.316 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-03-31T23:19:31.318 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-03-31T23:19:31.320 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-03-31T23:19:31.322 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-03-31T23:19:31.324 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-03-31T23:19:31.326 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-03-31T23:19:31.328 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-03-31T23:19:31.329 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-03-31T23:19:31.331 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-03-31T23:19:31.333 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-03-31T23:19:31.335 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-03-31T23:19:31.336 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-03-31T23:19:31.337 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-03-31T23:19:31.338 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-03-31T23:19:31.339 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-03-31T23:19:31.340 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-03-31T23:19:31.341 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-03-31T23:19:31.343 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-03-31T23:19:31.345 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-03-31T23:19:31.346 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-03-31T23:19:31.348 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-03-31T23:19:31.349 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-03-31T23:19:31.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-03-31T23:19:31.352 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-03-31T23:19:31.353 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-03-31T23:19:31.354 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-03-31T23:19:31.355 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-03-31T23:19:31.356 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-03-31T23:19:31.357 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-03-31T23:19:31.358 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-03-31T23:19:31.359 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-03-31T23:19:31.360 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-03-31T23:19:31.361 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-03-31T23:19:31.362 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-03-31T23:19:31.363 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-03-31T23:19:31.364 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-03-31T23:19:31.365 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-03-31T23:19:31.366 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-03-31T23:19:31.367 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-03-31T23:19:31.368 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-03-31T23:19:31.369 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-03-31T23:19:31.370 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-03-31T23:19:31.371 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-03-31T23:19:31.372 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-03-31T23:19:31.373 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-03-31T23:19:31.374 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-03-31T23:19:31.375 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-03-31T23:19:31.376 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-03-31T23:19:31.377 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-03-31T23:19:31.378 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-03-31T23:19:31.379 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-03-31T23:19:31.380 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-03-31T23:19:31.381 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-03-31T23:19:31.382 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-03-31T23:19:31.384 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-03-31T23:19:31.385 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-03-31T23:19:31.386 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-03-31T23:19:31.387 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-03-31T23:19:31.388 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-03-31T23:19:31.389 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-03-31T23:19:31.390 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-03-31T23:19:31.391 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-03-31T23:19:31.392 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-03-31T23:19:31.393 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-03-31T23:19:31.394 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-03-31T23:19:31.395 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-03-31T23:19:31.396 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-03-31T23:19:31.397 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-03-31T23:19:31.398 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-03-31T23:19:31.399 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-03-31T23:19:31.400 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-03-31T23:19:31.401 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-03-31T23:19:31.402 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-03-31T23:19:31.403 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-03-31T23:19:31.404 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-03-31T23:19:31.405 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-03-31T23:19:31.406 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-03-31T23:19:31.407 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-03-31T23:19:31.408 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-03-31T23:19:31.409 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-03-31T23:19:31.410 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-03-31T23:19:31.411 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-03-31T23:19:31.412 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-03-31T23:19:31.413 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-03-31T23:19:31.414 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-03-31T23:19:31.415 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-03-31T23:19:31.416 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-03-31T23:19:31.417 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-03-31T23:19:31.418 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-03-31T23:19:31.419 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-03-31T23:19:31.420 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-03-31T23:19:31.421 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-03-31T23:19:31.422 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-03-31T23:19:31.423 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-03-31T23:19:31.424 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-03-31T23:19:31.425 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-03-31T23:19:31.426 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-03-31T23:19:31.427 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-03-31T23:19:31.428 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-03-31T23:19:31.429 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-03-31T23:19:31.430 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-03-31T23:19:31.431 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-03-31T23:19:31.432 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-03-31T23:19:31.433 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-03-31T23:19:31.434 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-03-31T23:19:31.435 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-03-31T23:19:31.436 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-03-31T23:19:31.437 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-03-31T23:19:31.438 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-03-31T23:19:31.439 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-03-31T23:19:31.440 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-03-31T23:19:31.441 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-03-31T23:19:31.442 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-03-31T23:19:31.443 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-03-31T23:19:31.444 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-03-31T23:19:31.445 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-03-31T23:19:31.446 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-03-31T23:19:31.447 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-03-31T23:19:31.448 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-03-31T23:19:31.449 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-03-31T23:19:31.450 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-03-31T23:19:31.451 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-03-31T23:19:31.452 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-03-31T23:19:31.453 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-03-31T23:19:31.454 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-03-31T23:19:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-03-31T23:19:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-03-31T23:19:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-03-31T23:19:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-03-31T23:19:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-03-31T23:19:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-03-31T23:19:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-03-31T23:19:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-03-31T23:19:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-03-31T23:19:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-03-31T23:19:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-03-31T23:19:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-03-31T23:19:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-03-31T23:19:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-03-31T23:19:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-03-31T23:19:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-03-31T23:19:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-03-31T23:19:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-03-31T23:19:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-03-31T23:19:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-03-31T23:19:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-03-31T23:19:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-03-31T23:19:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-03-31T23:19:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-03-31T23:19:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-03-31T23:19:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-03-31T23:19:31.482 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-03-31T23:19:31.483 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-03-31T23:19:31.484 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-03-31T23:19:31.485 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-03-31T23:19:31.486 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-03-31T23:19:31.487 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-03-31T23:19:31.488 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-03-31T23:19:31.489 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-03-31T23:19:31.490 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-03-31T23:19:31.491 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-03-31T23:19:31.492 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-03-31T23:19:31.493 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-03-31T23:19:31.494 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-03-31T23:19:31.495 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-03-31T23:19:31.496 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-03-31T23:19:31.497 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-03-31T23:19:31.497 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-03-31T23:19:31.498 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-03-31T23:19:31.500 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-03-31T23:19:31.501 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-03-31T23:19:31.502 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-03-31T23:19:31.503 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-03-31T23:19:31.504 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-03-31T23:19:31.505 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-03-31T23:19:31.506 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-03-31T23:19:31.507 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-03-31T23:19:31.508 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-03-31T23:19:31.509 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-03-31T23:19:31.510 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-03-31T23:19:31.511 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-03-31T23:19:31.512 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-03-31T23:19:31.513 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-03-31T23:19:31.514 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-03-31T23:19:31.515 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-03-31T23:19:31.516 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-03-31T23:19:31.517 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-03-31T23:19:31.518 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-03-31T23:19:31.519 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-03-31T23:19:31.520 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-03-31T23:19:31.521 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-03-31T23:19:31.522 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-03-31T23:19:31.523 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-03-31T23:19:31.524 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-03-31T23:19:31.525 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-03-31T23:19:31.526 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-03-31T23:19:31.527 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-03-31T23:19:31.528 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-03-31T23:19:31.529 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-03-31T23:19:31.530 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-03-31T23:19:31.531 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-03-31T23:19:31.532 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-03-31T23:19:31.533 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-03-31T23:19:31.534 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-03-31T23:19:31.535 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-03-31T23:19:31.536 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-03-31T23:19:31.537 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-03-31T23:19:31.538 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-03-31T23:19:31.539 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-03-31T23:19:31.540 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-03-31T23:19:31.541 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-03-31T23:19:31.542 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-03-31T23:19:31.543 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-03-31T23:19:31.544 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-03-31T23:19:31.545 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-03-31T23:19:31.546 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-03-31T23:19:31.547 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-03-31T23:19:31.548 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-03-31T23:19:31.549 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-03-31T23:19:31.550 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-03-31T23:19:31.551 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-03-31T23:19:31.552 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-03-31T23:19:31.553 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-03-31T23:19:31.554 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-03-31T23:19:31.555 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-03-31T23:19:31.556 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-03-31T23:19:31.558 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-03-31T23:19:31.559 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-03-31T23:19:31.560 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-03-31T23:19:31.561 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-03-31T23:19:31.562 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-03-31T23:19:31.563 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-03-31T23:19:31.564 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-03-31T23:19:31.565 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-03-31T23:19:31.566 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-03-31T23:19:31.567 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-03-31T23:19:31.568 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-03-31T23:19:31.569 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-03-31T23:19:31.570 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-03-31T23:19:31.571 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-03-31T23:19:31.572 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-03-31T23:19:31.573 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-03-31T23:19:31.574 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-03-31T23:19:31.575 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-03-31T23:19:31.576 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-03-31T23:19:31.577 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-03-31T23:19:31.578 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-03-31T23:19:31.579 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-03-31T23:19:31.580 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-03-31T23:19:31.581 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-03-31T23:19:31.582 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-03-31T23:19:31.583 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-03-31T23:19:31.584 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-03-31T23:19:31.585 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-03-31T23:19:31.586 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-03-31T23:19:31.587 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-03-31T23:19:31.588 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-03-31T23:19:31.589 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-03-31T23:19:31.590 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-03-31T23:19:31.591 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-03-31T23:19:31.592 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-03-31T23:19:31.593 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-03-31T23:19:31.594 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-03-31T23:19:31.595 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-03-31T23:19:31.596 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-03-31T23:19:31.597 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-03-31T23:19:31.598 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-03-31T23:19:31.599 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-03-31T23:19:31.600 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-03-31T23:19:31.601 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-03-31T23:19:31.602 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-03-31T23:19:31.603 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-03-31T23:19:31.604 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-03-31T23:19:31.605 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-03-31T23:19:31.606 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-03-31T23:19:31.607 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-03-31T23:19:31.608 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-03-31T23:19:31.609 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-03-31T23:19:31.610 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-03-31T23:19:31.611 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-03-31T23:19:31.612 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-03-31T23:19:31.613 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-03-31T23:19:31.614 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-03-31T23:19:31.615 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-03-31T23:19:31.616 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-03-31T23:19:31.617 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-03-31T23:19:31.618 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-03-31T23:19:31.619 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-03-31T23:19:31.620 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-03-31T23:19:31.621 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-03-31T23:19:31.622 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-03-31T23:19:31.623 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-03-31T23:19:31.624 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-03-31T23:19:31.625 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-03-31T23:19:31.626 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-03-31T23:19:31.627 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-03-31T23:19:31.628 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-03-31T23:19:31.629 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-03-31T23:19:31.630 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-03-31T23:19:31.631 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-03-31T23:19:31.632 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-03-31T23:19:31.633 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-03-31T23:19:31.634 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-03-31T23:19:31.635 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-03-31T23:19:31.636 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-03-31T23:19:31.637 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-03-31T23:19:31.638 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-03-31T23:19:31.639 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-03-31T23:19:31.640 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-03-31T23:19:31.641 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-03-31T23:19:31.642 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-03-31T23:19:31.643 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-03-31T23:19:31.644 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-03-31T23:19:31.645 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-03-31T23:19:31.646 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-03-31T23:19:31.647 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-03-31T23:19:31.648 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-03-31T23:19:31.649 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-03-31T23:19:31.650 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-03-31T23:19:31.651 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-03-31T23:19:31.652 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-03-31T23:19:31.653 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-03-31T23:19:31.654 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-03-31T23:19:31.655 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-03-31T23:19:31.657 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-03-31T23:19:31.658 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-03-31T23:19:31.659 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-03-31T23:19:31.660 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-03-31T23:19:31.661 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-03-31T23:19:31.662 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-03-31T23:19:31.663 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-03-31T23:19:31.664 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-03-31T23:19:31.665 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-03-31T23:19:31.666 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-03-31T23:19:31.667 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-03-31T23:19:31.668 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-03-31T23:19:31.669 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-03-31T23:19:31.670 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-03-31T23:19:31.671 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-03-31T23:19:31.672 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-03-31T23:19:31.673 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-03-31T23:19:31.674 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-03-31T23:19:31.675 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-03-31T23:19:31.676 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-03-31T23:19:31.677 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-03-31T23:19:31.678 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-03-31T23:19:31.681 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-03-31T23:19:31.682 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-03-31T23:19:31.682 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-03-31T23:19:31.682 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-03-31T23:19:31.683 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-03-31T23:19:31.684 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-03-31T23:19:31.685 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-03-31T23:19:31.686 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-03-31T23:19:31.687 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-03-31T23:19:31.688 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-03-31T23:19:31.689 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-03-31T23:19:31.690 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-03-31T23:19:31.691 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-03-31T23:19:31.692 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-03-31T23:19:31.693 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-03-31T23:19:31.694 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-03-31T23:19:31.695 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-03-31T23:19:31.696 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-03-31T23:19:31.697 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-03-31T23:19:31.698 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-03-31T23:19:31.699 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-03-31T23:19:31.700 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-03-31T23:19:31.701 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-03-31T23:19:31.702 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-03-31T23:19:31.703 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-03-31T23:19:31.704 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-03-31T23:19:31.705 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-03-31T23:19:31.706 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-03-31T23:19:31.707 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-03-31T23:19:31.708 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-03-31T23:19:31.709 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-03-31T23:19:31.710 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-03-31T23:19:31.711 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-03-31T23:19:31.712 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-03-31T23:19:31.713 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-03-31T23:19:31.714 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-03-31T23:19:31.716 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-03-31T23:19:31.717 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-03-31T23:19:31.718 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-03-31T23:19:31.719 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-03-31T23:19:31.721 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-03-31T23:19:31.722 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-03-31T23:19:31.723 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-03-31T23:19:31.725 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-03-31T23:19:31.726 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-03-31T23:19:31.728 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-03-31T23:19:31.729 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-03-31T23:19:31.731 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-03-31T23:19:31.733 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-03-31T23:19:31.734 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-03-31T23:19:31.736 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-03-31T23:19:31.738 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-03-31T23:19:31.739 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-03-31T23:19:31.741 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-03-31T23:19:31.743 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-03-31T23:19:31.744 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-03-31T23:19:31.746 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-03-31T23:19:31.748 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-03-31T23:19:31.749 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-03-31T23:19:31.751 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-03-31T23:19:31.752 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-03-31T23:19:31.754 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-03-31T23:19:31.756 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-03-31T23:19:31.758 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-03-31T23:19:31.759 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-03-31T23:19:31.761 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-03-31T23:19:31.763 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-03-31T23:19:31.764 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-03-31T23:19:31.766 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-03-31T23:19:31.767 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-03-31T23:19:31.769 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-03-31T23:19:31.771 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-03-31T23:19:31.772 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-03-31T23:19:31.774 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-03-31T23:19:31.775 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-03-31T23:19:31.777 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-03-31T23:19:31.778 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-03-31T23:19:31.780 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-03-31T23:19:31.781 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-03-31T23:19:31.783 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-03-31T23:19:31.785 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-03-31T23:19:31.786 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-03-31T23:19:31.788 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-03-31T23:19:31.789 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-03-31T23:19:31.791 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-03-31T23:19:31.792 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-03-31T23:19:31.793 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-03-31T23:19:31.794 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-03-31T23:19:31.795 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-03-31T23:19:31.796 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-03-31T23:19:31.797 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-03-31T23:19:31.798 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-03-31T23:19:31.799 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-03-31T23:19:31.800 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-03-31T23:19:31.801 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-03-31T23:19:31.802 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-03-31T23:19:31.803 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-03-31T23:19:31.804 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-03-31T23:19:31.806 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-03-31T23:19:31.807 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-03-31T23:19:31.809 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-03-31T23:19:31.810 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-03-31T23:19:31.811 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-03-31T23:19:31.812 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-03-31T23:19:31.813 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-03-31T23:19:31.814 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-03-31T23:19:31.815 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-03-31T23:19:31.816 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-03-31T23:19:31.817 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-03-31T23:19:31.818 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-03-31T23:19:31.819 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-03-31T23:19:31.820 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-03-31T23:19:31.821 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-03-31T23:19:31.822 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-03-31T23:19:31.823 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-03-31T23:19:31.824 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-03-31T23:19:31.825 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-03-31T23:19:31.826 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-03-31T23:19:31.827 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-03-31T23:19:31.828 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-03-31T23:19:31.829 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-03-31T23:19:31.830 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-03-31T23:19:31.831 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-03-31T23:19:31.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:31 smithi094 ceph-mon[36167]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-03-31T23:19:31.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:31 smithi188 ceph-mon[36068]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-03-31T23:19:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:31 smithi042 ceph-mon[32380]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-03-31T23:19:32.272 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-03-31T23:19:32.273 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-03-31T23:19:32.357 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-03-31T23:19:32.360 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-03-31T23:19:32.362 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-03-31T23:19:32.365 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-03-31T23:19:32.366 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-03-31T23:19:32.368 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-03-31T23:19:32.373 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-03-31T23:19:32.396 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-03-31T23:19:32.415 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-03-31T23:19:32.422 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-03-31T23:19:32.424 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-03-31T23:19:32.427 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-03-31T23:19:32.434 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-03-31T23:19:32.439 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-03-31T23:19:32.444 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-03-31T23:19:32.450 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-03-31T23:19:32.458 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-03-31T23:19:32.462 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-03-31T23:19:32.472 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-03-31T23:19:32.476 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-03-31T23:19:32.479 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-03-31T23:19:32.488 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-03-31T23:19:32.491 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-03-31T23:19:32.492 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-03-31T23:19:32.499 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-03-31T23:19:32.513 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-03-31T23:19:32.526 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-03-31T23:19:32.536 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-03-31T23:19:32.539 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-03-31T23:19:32.543 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-03-31T23:19:32.545 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-03-31T23:19:32.547 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-03-31T23:19:32.550 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-03-31T23:19:32.556 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-03-31T23:19:32.558 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-03-31T23:19:32.560 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-03-31T23:19:32.565 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-03-31T23:19:32.568 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-03-31T23:19:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-03-31T23:19:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-03-31T23:19:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-03-31T23:19:32.591 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-03-31T23:19:32.598 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-03-31T23:19:32.601 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-03-31T23:19:32.603 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-03-31T23:19:32.604 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-03-31T23:19:32.609 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-03-31T23:19:32.612 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-03-31T23:19:32.623 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-03-31T23:19:32.636 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-03-31T23:19:32.639 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-03-31T23:19:32.644 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-03-31T23:19:32.655 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-03-31T23:19:32.658 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-03-31T23:19:32.663 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-03-31T23:19:32.672 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-03-31T23:19:32.674 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-03-31T23:19:32.676 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-03-31T23:19:32.678 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-03-31T23:19:32.680 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-03-31T23:19:32.685 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-03-31T23:19:32.692 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-03-31T23:19:32.698 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-03-31T23:19:32.703 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-03-31T23:19:32.711 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-03-31T23:19:32.719 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-03-31T23:19:32.723 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-03-31T23:19:32.728 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-03-31T23:19:32.730 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/digsig.txt 2024-03-31T23:19:32.735 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-03-31T23:19:32.736 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-03-31T23:19:32.743 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-03-31T23:19:32.746 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-03-31T23:19:32.747 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-03-31T23:19:32.749 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-03-31T23:19:32.751 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dontdiff 2024-03-31T23:19:32.754 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/ 2024-03-31T23:19:32.757 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-03-31T23:19:32.765 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-03-31T23:19:32.775 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-03-31T23:19:32.778 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-03-31T23:19:32.781 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-03-31T23:19:32.787 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-03-31T23:19:32.808 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-03-31T23:19:32.817 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-03-31T23:19:32.819 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-03-31T23:19:32.821 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-03-31T23:19:32.823 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/ 2024-03-31T23:19:32.825 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-03-31T23:19:32.827 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-03-31T23:19:32.828 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-03-31T23:19:32.832 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-03-31T23:19:32.835 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-03-31T23:19:32.841 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-03-31T23:19:32.842 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-03-31T23:19:32.845 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-03-31T23:19:32.848 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-03-31T23:19:32.849 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-03-31T23:19:32.853 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-03-31T23:19:32.854 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-03-31T23:19:32.856 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-03-31T23:19:32.858 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-03-31T23:19:32.861 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-03-31T23:19:32.863 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-03-31T23:19:32.865 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-03-31T23:19:32.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-03-31T23:19:32.869 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/edac.txt 2024-03-31T23:19:32.872 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-03-31T23:19:32.874 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/eisa.txt 2024-03-31T23:19:32.877 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-03-31T23:19:32.879 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/extcon/ 2024-03-31T23:19:32.881 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-03-31T23:19:32.882 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-03-31T23:19:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-03-31T23:19:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-03-31T23:19:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-03-31T23:19:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/ 2024-03-31T23:19:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-03-31T23:19:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-03-31T23:19:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-03-31T23:19:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-03-31T23:19:32.900 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-03-31T23:19:32.902 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-03-31T23:19:32.903 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-03-31T23:19:32.905 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-03-31T23:19:32.907 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-03-31T23:19:32.908 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-03-31T23:19:32.910 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-03-31T23:19:32.914 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-03-31T23:19:32.914 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-03-31T23:19:32.916 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-03-31T23:19:32.917 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-03-31T23:19:32.921 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-03-31T23:19:32.924 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-03-31T23:19:32.929 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-03-31T23:19:32.930 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-03-31T23:19:32.933 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-03-31T23:19:32.935 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-03-31T23:19:32.942 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-03-31T23:19:32.943 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-03-31T23:19:32.945 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-03-31T23:19:32.947 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-03-31T23:19:32.949 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-03-31T23:19:32.952 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-03-31T23:19:32.954 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-03-31T23:19:32.956 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-03-31T23:19:32.958 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-03-31T23:19:32.961 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-03-31T23:19:32.962 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-03-31T23:19:32.964 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-03-31T23:19:32.968 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-03-31T23:19:32.969 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-03-31T23:19:32.971 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ 2024-03-31T23:19:32.973 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-03-31T23:19:32.974 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-03-31T23:19:32.979 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-03-31T23:19:32.983 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-03-31T23:19:32.986 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-03-31T23:19:32.990 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-03-31T23:19:32.998 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-03-31T23:19:33.003 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-03-31T23:19:33.006 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-03-31T23:19:33.011 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-03-31T23:19:33.013 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-03-31T23:19:33.016 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-03-31T23:19:33.036 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-03-31T23:19:33.038 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-03-31T23:19:33.040 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-03-31T23:19:33.041 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-03-31T23:19:33.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-03-31T23:19:33.044 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-03-31T23:19:33.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-03-31T23:19:33.048 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-03-31T23:19:33.050 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-03-31T23:19:33.051 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-03-31T23:19:33.053 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-03-31T23:19:33.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-03-31T23:19:33.056 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-03-31T23:19:33.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-03-31T23:19:33.060 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-03-31T23:19:33.062 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-03-31T23:19:33.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-03-31T23:19:33.065 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-03-31T23:19:33.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-03-31T23:19:33.068 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-03-31T23:19:33.086 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-03-31T23:19:33.088 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-03-31T23:19:33.090 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-03-31T23:19:33.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b36ffd640 1 -- 172.21.15.42:0/1682253499 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b45805770 con 0x561b45925db0 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b36ffd640 10 client.16197 handle_command_reply: tid=0 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 client.16197 shutdown 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 msgr2=0x561b459298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b459298a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1b48017cb0 tx=0x7f1b48005c70 comp rx=0 tx=0).stop 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 shutdown_connections 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x561b45925db0 0x561b4599ea60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561b4591cfe0 0x561b4592a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561b4591c6c0 0x561b45929de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 --2- 172.21.15.42:0/1682253499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b45916fe0 0x561b459298a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b36ffd640 0 client.16197 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 >> 172.21.15.42:0/1682253499 conn(0x561b459383e0 msgr2=0x561b459156f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 shutdown_connections 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.091+0000 7f1b6067a740 1 -- 172.21.15.42:0/1682253499 wait complete. 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b6067a740 20 client.16197 trim_cache size 0 max 16384 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:19:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1b400a27d0 msgr2=0x7f1b400a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1b400a27d0 0x7f1b400a4c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b50035fd0 tx=0x7f1b5002e040 comp rx=0 tx=0).stop 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 msgr2=0x7f1b58196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 0x7f1b58196f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800eb00 tx=0x7f1b48009f20 comp rx=0 tx=0).stop 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 shutdown_connections 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1b400a27d0 0x7f1b400a4c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b58106620 0x7f1b5819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.096 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-03-31T23:19:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b58101760 0x7f1b58197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 --2- 172.21.15.42:0/2417575813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b58100da0 0x7f1b58196f50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 >> 172.21.15.42:0/2417575813 conn(0x7f1b58076b70 msgr2=0x7f1b58103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 shutdown_connections 2024-03-31T23:19:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:33.092+0000 7f1b5da8f640 1 -- 172.21.15.42:0/2417575813 wait complete. 2024-03-31T23:19:33.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-03-31T23:19:33.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-03-31T23:19:33.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-03-31T23:19:33.098 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-03-31T23:19:33.099 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-03-31T23:19:33.101 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-03-31T23:19:33.102 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-03-31T23:19:33.103 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-03-31T23:19:33.105 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-03-31T23:19:33.106 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-03-31T23:19:33.107 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-03-31T23:19:33.109 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-03-31T23:19:33.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-03-31T23:19:33.112 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-03-31T23:19:33.113 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-03-31T23:19:33.115 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-03-31T23:19:33.116 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-03-31T23:19:33.117 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-03-31T23:19:33.119 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-03-31T23:19:33.120 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-03-31T23:19:33.121 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-03-31T23:19:33.123 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-03-31T23:19:33.125 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-03-31T23:19:33.126 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-03-31T23:19:33.127 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-03-31T23:19:33.128 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-03-31T23:19:33.129 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-03-31T23:19:33.130 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-03-31T23:19:33.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-03-31T23:19:33.132 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-03-31T23:19:33.133 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-03-31T23:19:33.134 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-03-31T23:19:33.135 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-03-31T23:19:33.136 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-03-31T23:19:33.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-03-31T23:19:33.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-03-31T23:19:33.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-03-31T23:19:33.139 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-03-31T23:19:33.140 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-03-31T23:19:33.141 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-03-31T23:19:33.142 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-03-31T23:19:33.143 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-03-31T23:19:33.144 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-03-31T23:19:33.145 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-03-31T23:19:33.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-03-31T23:19:33.147 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-03-31T23:19:33.148 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-03-31T23:19:33.149 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-03-31T23:19:33.150 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-03-31T23:19:33.151 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-03-31T23:19:33.152 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-03-31T23:19:33.153 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-03-31T23:19:33.155 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-03-31T23:19:33.156 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-03-31T23:19:33.158 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-03-31T23:19:33.159 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-03-31T23:19:33.160 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-03-31T23:19:33.161 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-03-31T23:19:33.163 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-03-31T23:19:33.163 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-03-31T23:19:33.164 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-03-31T23:19:33.165 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-03-31T23:19:33.166 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-03-31T23:19:33.167 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-03-31T23:19:33.168 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-03-31T23:19:33.169 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-03-31T23:19:33.170 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-03-31T23:19:33.171 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-03-31T23:19:33.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-03-31T23:19:33.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-03-31T23:19:33.173 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-03-31T23:19:33.174 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-03-31T23:19:33.175 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-03-31T23:19:33.176 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-03-31T23:19:33.177 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-03-31T23:19:33.178 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-03-31T23:19:33.179 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-03-31T23:19:33.180 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-03-31T23:19:33.181 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-03-31T23:19:33.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-03-31T23:19:33.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-03-31T23:19:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-03-31T23:19:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/ 2024-03-31T23:19:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-03-31T23:19:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-03-31T23:19:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-03-31T23:19:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-03-31T23:19:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-03-31T23:19:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-03-31T23:19:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-03-31T23:19:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-03-31T23:19:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-03-31T23:19:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-03-31T23:19:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-03-31T23:19:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/ 2024-03-31T23:19:33.197 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-03-31T23:19:33.198 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-03-31T23:19:33.199 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-03-31T23:19:33.200 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-03-31T23:19:33.201 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-03-31T23:19:33.202 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-03-31T23:19:33.203 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-03-31T23:19:33.204 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-03-31T23:19:33.205 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-03-31T23:19:33.206 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-03-31T23:19:33.207 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-03-31T23:19:33.208 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gcov.txt 2024-03-31T23:19:33.209 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-03-31T23:19:33.210 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/ 2024-03-31T23:19:33.211 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-03-31T23:19:33.212 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-03-31T23:19:33.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-03-31T23:19:33.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-03-31T23:19:33.214 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-03-31T23:19:33.215 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-03-31T23:19:33.216 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-03-31T23:19:33.217 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hid/ 2024-03-31T23:19:33.218 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-03-31T23:19:33.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-03-31T23:19:33.220 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-03-31T23:19:33.221 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-03-31T23:19:33.222 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-03-31T23:19:33.223 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/highuid.txt 2024-03-31T23:19:33.224 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hsi.txt 2024-03-31T23:19:33.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-03-31T23:19:33.226 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ 2024-03-31T23:19:33.227 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-03-31T23:19:33.228 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-03-31T23:19:33.229 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-03-31T23:19:33.230 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-03-31T23:19:33.231 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-03-31T23:19:33.232 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-03-31T23:19:33.233 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-03-31T23:19:33.234 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-03-31T23:19:33.235 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-03-31T23:19:33.236 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-03-31T23:19:33.237 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-03-31T23:19:33.238 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-03-31T23:19:33.239 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-03-31T23:19:33.240 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-03-31T23:19:33.241 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-03-31T23:19:33.242 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-03-31T23:19:33.243 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-03-31T23:19:33.244 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-03-31T23:19:33.245 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-03-31T23:19:33.246 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-03-31T23:19:33.247 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-03-31T23:19:33.248 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-03-31T23:19:33.249 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-03-31T23:19:33.250 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-03-31T23:19:33.251 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-03-31T23:19:33.252 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-03-31T23:19:33.253 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-03-31T23:19:33.253 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-03-31T23:19:33.255 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-03-31T23:19:33.256 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-03-31T23:19:33.256 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-03-31T23:19:33.257 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-03-31T23:19:33.258 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-03-31T23:19:33.259 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-03-31T23:19:33.260 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-03-31T23:19:33.261 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-03-31T23:19:33.262 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-03-31T23:19:33.263 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-03-31T23:19:33.264 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-03-31T23:19:33.265 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-03-31T23:19:33.265 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-03-31T23:19:33.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-03-31T23:19:33.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-03-31T23:19:33.268 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-03-31T23:19:33.269 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-03-31T23:19:33.270 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-03-31T23:19:33.271 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-03-31T23:19:33.272 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-03-31T23:19:33.273 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-03-31T23:19:33.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-03-31T23:19:33.275 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-03-31T23:19:33.276 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-03-31T23:19:33.277 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-03-31T23:19:33.278 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-03-31T23:19:33.279 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-03-31T23:19:33.280 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-03-31T23:19:33.281 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-03-31T23:19:33.282 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-03-31T23:19:33.283 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-03-31T23:19:33.283 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-03-31T23:19:33.285 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-03-31T23:19:33.286 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-03-31T23:19:33.287 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-03-31T23:19:33.288 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-03-31T23:19:33.289 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-03-31T23:19:33.289 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-03-31T23:19:33.290 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-03-31T23:19:33.291 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-03-31T23:19:33.292 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-03-31T23:19:33.293 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-03-31T23:19:33.294 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-03-31T23:19:33.295 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-03-31T23:19:33.296 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-03-31T23:19:33.297 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-03-31T23:19:33.298 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-03-31T23:19:33.299 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-03-31T23:19:33.299 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-03-31T23:19:33.300 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-03-31T23:19:33.302 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-03-31T23:19:33.303 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-03-31T23:19:33.303 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-03-31T23:19:33.304 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-03-31T23:19:33.306 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-03-31T23:19:33.307 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-03-31T23:19:33.307 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-03-31T23:19:33.308 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-03-31T23:19:33.309 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-03-31T23:19:33.310 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-03-31T23:19:33.311 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-03-31T23:19:33.312 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-03-31T23:19:33.313 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-03-31T23:19:33.314 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-03-31T23:19:33.315 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-03-31T23:19:33.316 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-03-31T23:19:33.317 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-03-31T23:19:33.318 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-03-31T23:19:33.319 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-03-31T23:19:33.320 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-03-31T23:19:33.321 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-03-31T23:19:33.322 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-03-31T23:19:33.323 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-03-31T23:19:33.324 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-03-31T23:19:33.325 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-03-31T23:19:33.326 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-03-31T23:19:33.327 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-03-31T23:19:33.328 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-03-31T23:19:33.329 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-03-31T23:19:33.330 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-03-31T23:19:33.331 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-03-31T23:19:33.332 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-03-31T23:19:33.333 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-03-31T23:19:33.334 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-03-31T23:19:33.335 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-03-31T23:19:33.336 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-03-31T23:19:33.337 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-03-31T23:19:33.338 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-03-31T23:19:33.339 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-03-31T23:19:33.340 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-03-31T23:19:33.341 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-03-31T23:19:33.342 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-03-31T23:19:33.342 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-03-31T23:19:33.343 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-03-31T23:19:33.344 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-03-31T23:19:33.345 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-03-31T23:19:33.346 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-03-31T23:19:33.347 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-03-31T23:19:33.348 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-03-31T23:19:33.349 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-03-31T23:19:33.350 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-03-31T23:19:33.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-03-31T23:19:33.352 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-03-31T23:19:33.353 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-03-31T23:19:33.354 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-03-31T23:19:33.355 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-03-31T23:19:33.356 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-03-31T23:19:33.357 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-03-31T23:19:33.358 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-03-31T23:19:33.359 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/ 2024-03-31T23:19:33.360 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-03-31T23:19:33.361 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-03-31T23:19:33.362 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-03-31T23:19:33.363 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-03-31T23:19:33.364 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-03-31T23:19:33.365 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-03-31T23:19:33.366 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-03-31T23:19:33.367 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-03-31T23:19:33.368 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-03-31T23:19:33.369 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-03-31T23:19:33.370 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-03-31T23:19:33.371 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-03-31T23:19:33.372 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-03-31T23:19:33.373 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-03-31T23:19:33.374 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-03-31T23:19:33.375 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-03-31T23:19:33.376 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-03-31T23:19:33.377 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-03-31T23:19:33.378 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-03-31T23:19:33.379 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-03-31T23:19:33.380 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-03-31T23:19:33.381 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-03-31T23:19:33.382 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-03-31T23:19:33.383 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-03-31T23:19:33.384 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-03-31T23:19:33.385 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-03-31T23:19:33.386 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-03-31T23:19:33.387 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-03-31T23:19:33.388 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-03-31T23:19:33.389 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-03-31T23:19:33.389 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-03-31T23:19:33.390 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-03-31T23:19:33.392 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/summary 2024-03-31T23:19:33.393 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-03-31T23:19:33.394 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-03-31T23:19:33.395 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-03-31T23:19:33.396 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2o/ 2024-03-31T23:19:33.397 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2o/README 2024-03-31T23:19:33.398 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-03-31T23:19:33.399 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/ 2024-03-31T23:19:33.400 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-03-31T23:19:33.401 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-03-31T23:19:33.401 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-03-31T23:19:33.402 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/README 2024-03-31T23:19:33.403 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-03-31T23:19:33.404 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-03-31T23:19:33.405 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-03-31T23:19:33.406 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-03-31T23:19:33.407 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-03-31T23:19:33.408 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-03-31T23:19:33.409 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-03-31T23:19:33.410 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-03-31T23:19:33.411 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/ 2024-03-31T23:19:33.412 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-03-31T23:19:33.413 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-03-31T23:19:33.414 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-03-31T23:19:33.415 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-03-31T23:19:33.416 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-03-31T23:19:33.417 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-03-31T23:19:33.418 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-03-31T23:19:33.419 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/infiniband/ 2024-03-31T23:19:33.420 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-03-31T23:19:33.421 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-03-31T23:19:33.422 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-03-31T23:19:33.423 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-03-31T23:19:33.424 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-03-31T23:19:33.425 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/init.txt 2024-03-31T23:19:33.426 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/initrd.txt 2024-03-31T23:19:33.427 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/ 2024-03-31T23:19:33.428 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-03-31T23:19:33.429 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-03-31T23:19:33.430 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-03-31T23:19:33.430 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-03-31T23:19:33.431 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-03-31T23:19:33.432 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-03-31T23:19:33.433 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-03-31T23:19:33.434 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-03-31T23:19:33.435 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-03-31T23:19:33.436 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-03-31T23:19:33.437 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-03-31T23:19:33.438 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-03-31T23:19:33.439 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-03-31T23:19:33.440 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-03-31T23:19:33.441 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-03-31T23:19:33.442 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-03-31T23:19:33.443 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-03-31T23:19:33.444 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/input.txt 2024-03-31T23:19:33.445 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-03-31T23:19:33.446 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-03-31T23:19:33.447 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-03-31T23:19:33.448 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-03-31T23:19:33.449 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-03-31T23:19:33.450 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-03-31T23:19:33.451 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-03-31T23:19:33.452 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-03-31T23:19:33.453 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-03-31T23:19:33.454 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-03-31T23:19:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-03-31T23:19:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-03-31T23:19:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-03-31T23:19:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-03-31T23:19:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-03-31T23:19:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-03-31T23:19:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/ 2024-03-31T23:19:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-03-31T23:19:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-03-31T23:19:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-03-31T23:19:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-03-31T23:19:33.466 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-03-31T23:19:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-03-31T23:19:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/iostats.txt 2024-03-31T23:19:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-03-31T23:19:33.469 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-03-31T23:19:33.470 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/ 2024-03-31T23:19:33.471 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-03-31T23:19:33.472 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-03-31T23:19:33.473 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-03-31T23:19:33.475 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-03-31T23:19:33.476 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-03-31T23:19:33.478 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-03-31T23:19:33.479 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README 2024-03-31T23:19:33.481 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-03-31T23:19:33.482 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-03-31T23:19:33.484 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-03-31T23:19:33.485 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-03-31T23:19:33.487 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-03-31T23:19:33.489 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-03-31T23:19:33.490 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-03-31T23:19:33.492 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-03-31T23:19:33.493 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-03-31T23:19:33.494 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-03-31T23:19:33.496 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-03-31T23:19:33.497 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-03-31T23:19:33.499 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-03-31T23:19:33.500 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-03-31T23:19:33.502 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-03-31T23:19:33.503 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-03-31T23:19:33.504 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-03-31T23:19:33.506 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-03-31T23:19:33.507 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-03-31T23:19:33.509 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-03-31T23:19:33.510 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-03-31T23:19:33.512 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-03-31T23:19:33.513 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-03-31T23:19:33.515 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-03-31T23:19:33.516 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/java.txt 2024-03-31T23:19:33.518 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kasan.txt 2024-03-31T23:19:33.519 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/ 2024-03-31T23:19:33.521 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-03-31T23:19:33.522 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-03-31T23:19:33.523 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-03-31T23:19:33.525 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-03-31T23:19:33.526 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-03-31T23:19:33.530 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-03-31T23:19:33.530 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-03-31T23:19:33.531 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kdump/ 2024-03-31T23:19:33.532 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-03-31T23:19:33.533 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-03-31T23:19:33.535 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-03-31T23:19:33.538 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-03-31T23:19:33.540 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-03-31T23:19:33.543 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-03-31T23:19:33.544 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-03-31T23:19:33.546 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-03-31T23:19:33.548 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-03-31T23:19:33.549 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-03-31T23:19:33.551 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-03-31T23:19:33.552 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kobject.txt 2024-03-31T23:19:33.554 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-03-31T23:19:33.556 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kref.txt 2024-03-31T23:19:33.558 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-03-31T23:19:33.559 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/ 2024-03-31T23:19:33.560 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-03-31T23:19:33.562 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-03-31T23:19:33.563 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-03-31T23:19:33.565 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-03-31T23:19:33.566 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-03-31T23:19:33.568 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-03-31T23:19:33.569 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-03-31T23:19:33.571 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-03-31T23:19:33.572 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-03-31T23:19:33.574 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-03-31T23:19:33.576 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-03-31T23:19:33.577 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-03-31T23:19:33.578 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ldm.txt 2024-03-31T23:19:33.580 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/ 2024-03-31T23:19:33.581 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-03-31T23:19:33.583 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-03-31T23:19:33.585 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-03-31T23:19:33.586 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-03-31T23:19:33.588 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-03-31T23:19:33.589 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-03-31T23:19:33.591 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-03-31T23:19:33.592 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-03-31T23:19:33.594 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-03-31T23:19:33.595 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-03-31T23:19:33.597 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-03-31T23:19:33.599 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-03-31T23:19:33.601 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/ 2024-03-31T23:19:33.602 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-03-31T23:19:33.604 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-03-31T23:19:33.605 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-03-31T23:19:33.607 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-03-31T23:19:33.609 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-03-31T23:19:33.610 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-03-31T23:19:33.612 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-03-31T23:19:33.614 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-03-31T23:19:33.615 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-03-31T23:19:33.617 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-03-31T23:19:33.618 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-03-31T23:19:33.620 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/logo.gif 2024-03-31T23:19:33.622 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/logo.txt 2024-03-31T23:19:33.623 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/lzo.txt 2024-03-31T23:19:33.625 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/m68k/ 2024-03-31T23:19:33.627 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-03-31T23:19:33.629 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-03-31T23:19:33.630 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-03-31T23:19:33.632 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-03-31T23:19:33.633 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-03-31T23:19:33.635 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/md.txt 2024-03-31T23:19:33.637 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-03-31T23:19:33.638 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-03-31T23:19:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:33 smithi094 ceph-mon[36167]: pgmap v44: 129 pgs: 129 active+clean; 84 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 6.9 MiB/s wr, 36 op/s 2024-03-31T23:19:33.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:33 smithi188 ceph-mon[36068]: pgmap v44: 129 pgs: 129 active+clean; 84 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 6.9 MiB/s wr, 36 op/s 2024-03-31T23:19:34.023 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-03-31T23:19:34.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-03-31T23:19:34.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-03-31T23:19:34.025 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/metag/ 2024-03-31T23:19:34.026 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-03-31T23:19:34.027 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-03-31T23:19:34.028 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/ 2024-03-31T23:19:34.029 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-03-31T23:19:34.030 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-03-31T23:19:34.031 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-03-31T23:19:34.032 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-03-31T23:19:34.033 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-03-31T23:19:34.034 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-03-31T23:19:34.035 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-03-31T23:19:34.036 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-03-31T23:19:34.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-03-31T23:19:34.038 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-03-31T23:19:34.039 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mips/ 2024-03-31T23:19:34.040 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-03-31T23:19:34.041 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-03-31T23:19:34.042 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-03-31T23:19:34.043 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-03-31T23:19:34.044 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-03-31T23:19:34.045 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-03-31T23:19:34.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-03-31T23:19:34.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-03-31T23:19:34.047 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-03-31T23:19:34.048 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-03-31T23:19:34.049 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-03-31T23:19:34.050 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-03-31T23:19:34.051 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-03-31T23:19:34.052 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-03-31T23:19:34.053 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-03-31T23:19:34.054 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-03-31T23:19:34.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-03-31T23:19:34.055 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-03-31T23:19:34.056 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-03-31T23:19:34.057 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-03-31T23:19:34.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-03-31T23:19:34.059 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mmc/ 2024-03-31T23:19:34.060 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-03-31T23:19:34.061 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-03-31T23:19:34.062 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-03-31T23:19:34.063 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-03-31T23:19:34.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mn10300/ 2024-03-31T23:19:34.065 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-03-31T23:19:34.066 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-03-31T23:19:34.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-03-31T23:19:34.068 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mono.txt 2024-03-31T23:19:34.069 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mtd/ 2024-03-31T23:19:34.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-03-31T23:19:34.071 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-03-31T23:19:34.072 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-03-31T23:19:34.073 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-03-31T23:19:34.074 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/namespaces/ 2024-03-31T23:19:34.074 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-03-31T23:19:34.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:33 smithi042 ceph-mon[32380]: pgmap v44: 129 pgs: 129 active+clean; 84 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 6.9 MiB/s wr, 36 op/s 2024-03-31T23:19:34.075 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-03-31T23:19:34.076 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/netlabel/ 2024-03-31T23:19:34.077 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-03-31T23:19:34.078 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-03-31T23:19:34.079 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-03-31T23:19:34.080 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-03-31T23:19:34.081 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-03-31T23:19:34.082 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ 2024-03-31T23:19:34.083 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-03-31T23:19:34.084 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-03-31T23:19:34.085 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-03-31T23:19:34.086 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-03-31T23:19:34.087 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-03-31T23:19:34.088 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-03-31T23:19:34.089 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-03-31T23:19:34.090 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-03-31T23:19:34.091 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-03-31T23:19:34.092 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-03-31T23:19:34.093 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-03-31T23:19:34.094 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-03-31T23:19:34.095 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-03-31T23:19:34.096 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-03-31T23:19:34.097 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-03-31T23:19:34.098 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-03-31T23:19:34.099 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-03-31T23:19:34.100 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-03-31T23:19:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-03-31T23:19:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-03-31T23:19:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-03-31T23:19:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-03-31T23:19:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-03-31T23:19:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-03-31T23:19:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-03-31T23:19:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-03-31T23:19:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-03-31T23:19:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-03-31T23:19:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-03-31T23:19:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-03-31T23:19:34.115 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-03-31T23:19:34.117 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-03-31T23:19:34.118 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-03-31T23:19:34.120 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-03-31T23:19:34.121 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-03-31T23:19:34.122 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-03-31T23:19:34.124 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-03-31T23:19:34.125 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-03-31T23:19:34.127 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-03-31T23:19:34.128 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-03-31T23:19:34.130 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-03-31T23:19:34.131 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-03-31T23:19:34.132 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-03-31T23:19:34.134 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-03-31T23:19:34.135 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-03-31T23:19:34.137 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-03-31T23:19:34.138 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-03-31T23:19:34.140 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-03-31T23:19:34.141 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-03-31T23:19:34.146 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-03-31T23:19:34.147 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-03-31T23:19:34.147 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-03-31T23:19:34.148 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-03-31T23:19:34.149 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-03-31T23:19:34.150 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-03-31T23:19:34.152 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-03-31T23:19:34.153 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-03-31T23:19:34.155 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-03-31T23:19:34.156 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-03-31T23:19:34.158 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-03-31T23:19:34.159 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-03-31T23:19:34.160 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-03-31T23:19:34.162 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-03-31T23:19:34.163 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-03-31T23:19:34.165 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-03-31T23:19:34.166 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-03-31T23:19:34.167 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-03-31T23:19:34.169 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-03-31T23:19:34.171 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-03-31T23:19:34.172 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-03-31T23:19:34.173 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-03-31T23:19:34.175 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-03-31T23:19:34.176 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-03-31T23:19:34.177 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-03-31T23:19:34.179 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-03-31T23:19:34.180 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-03-31T23:19:34.182 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-03-31T23:19:34.183 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-03-31T23:19:34.185 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-03-31T23:19:34.186 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-03-31T23:19:34.188 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-03-31T23:19:34.190 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-03-31T23:19:34.191 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-03-31T23:19:34.193 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-03-31T23:19:34.194 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-03-31T23:19:34.195 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-03-31T23:19:34.197 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-03-31T23:19:34.199 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-03-31T23:19:34.200 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-03-31T23:19:34.202 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-03-31T23:19:34.203 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-03-31T23:19:34.205 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-03-31T23:19:34.207 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-03-31T23:19:34.208 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-03-31T23:19:34.210 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-03-31T23:19:34.211 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-03-31T23:19:34.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-03-31T23:19:34.213 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-03-31T23:19:34.215 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-03-31T23:19:34.216 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-03-31T23:19:34.217 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-03-31T23:19:34.218 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-03-31T23:19:34.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-03-31T23:19:34.219 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-03-31T23:19:34.220 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-03-31T23:19:34.221 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-03-31T23:19:34.222 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-03-31T23:19:34.223 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-03-31T23:19:34.224 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-03-31T23:19:34.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-03-31T23:19:34.225 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-03-31T23:19:34.226 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-03-31T23:19:34.227 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-03-31T23:19:34.228 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-03-31T23:19:34.229 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-03-31T23:19:34.230 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-03-31T23:19:34.231 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-03-31T23:19:34.232 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-03-31T23:19:34.232 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-03-31T23:19:34.233 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-03-31T23:19:34.234 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-03-31T23:19:34.235 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-03-31T23:19:34.236 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-03-31T23:19:34.237 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-03-31T23:19:34.238 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-03-31T23:19:34.239 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-03-31T23:19:34.240 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-03-31T23:19:34.241 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-03-31T23:19:34.242 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-03-31T23:19:34.243 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-03-31T23:19:34.244 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-03-31T23:19:34.245 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-03-31T23:19:34.246 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-03-31T23:19:34.247 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-03-31T23:19:34.248 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-03-31T23:19:34.249 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/nfc/ 2024-03-31T23:19:34.250 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-03-31T23:19:34.251 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-03-31T23:19:34.252 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/nios2/ 2024-03-31T23:19:34.253 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/nios2/README 2024-03-31T23:19:34.254 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-03-31T23:19:34.255 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/numastat.txt 2024-03-31T23:19:34.256 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-03-31T23:19:34.257 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/padata.txt 2024-03-31T23:19:34.258 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/parisc/ 2024-03-31T23:19:34.259 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-03-31T23:19:34.260 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-03-31T23:19:34.261 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/parisc/registers 2024-03-31T23:19:34.261 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-03-31T23:19:34.263 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/parport.txt 2024-03-31T23:19:34.264 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-03-31T23:19:34.265 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-03-31T23:19:34.266 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-03-31T23:19:34.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-03-31T23:19:34.267 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-03-31T23:19:34.268 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-03-31T23:19:34.269 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-03-31T23:19:34.270 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-03-31T23:19:34.271 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-03-31T23:19:34.272 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/phy.txt 2024-03-31T23:19:34.273 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/phy/ 2024-03-31T23:19:34.274 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-03-31T23:19:34.275 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-03-31T23:19:34.276 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-03-31T23:19:34.277 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/platform/ 2024-03-31T23:19:34.278 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-03-31T23:19:34.279 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pnp.txt 2024-03-31T23:19:34.280 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/ 2024-03-31T23:19:34.281 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-03-31T23:19:34.282 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-03-31T23:19:34.282 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-03-31T23:19:34.283 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-03-31T23:19:34.285 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-03-31T23:19:34.286 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-03-31T23:19:34.286 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-03-31T23:19:34.288 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-03-31T23:19:34.289 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-03-31T23:19:34.290 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-03-31T23:19:34.291 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-03-31T23:19:34.292 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-03-31T23:19:34.293 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-03-31T23:19:34.294 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-03-31T23:19:34.295 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-03-31T23:19:34.296 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-03-31T23:19:34.297 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-03-31T23:19:34.297 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-03-31T23:19:34.298 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-03-31T23:19:34.299 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-03-31T23:19:34.300 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-03-31T23:19:34.301 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-03-31T23:19:34.302 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-03-31T23:19:34.302 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/states.txt 2024-03-31T23:19:34.303 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-03-31T23:19:34.304 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-03-31T23:19:34.305 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-03-31T23:19:34.306 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-03-31T23:19:34.307 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-03-31T23:19:34.308 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-03-31T23:19:34.309 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-03-31T23:19:34.310 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/power/video.txt 2024-03-31T23:19:34.311 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/ 2024-03-31T23:19:34.312 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-03-31T23:19:34.313 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-03-31T23:19:34.314 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-03-31T23:19:34.315 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-03-31T23:19:34.316 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-03-31T23:19:34.317 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-03-31T23:19:34.318 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-03-31T23:19:34.319 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-03-31T23:19:34.320 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-03-31T23:19:34.320 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-03-31T23:19:34.321 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-03-31T23:19:34.322 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-03-31T23:19:34.323 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-03-31T23:19:34.325 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pps/ 2024-03-31T23:19:34.325 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-03-31T23:19:34.326 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/ 2024-03-31T23:19:34.327 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-03-31T23:19:34.328 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-03-31T23:19:34.329 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-03-31T23:19:34.330 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-03-31T23:19:34.331 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-03-31T23:19:34.332 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-03-31T23:19:34.332 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-03-31T23:19:34.333 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-03-31T23:19:34.334 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-03-31T23:19:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pti/ 2024-03-31T23:19:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-03-31T23:19:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ptp/ 2024-03-31T23:19:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-03-31T23:19:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-03-31T23:19:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-03-31T23:19:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-03-31T23:19:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-03-31T23:19:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/pwm.txt 2024-03-31T23:19:34.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-03-31T23:19:34.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rapidio/ 2024-03-31T23:19:34.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-03-31T23:19:34.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-03-31T23:19:34.351 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-03-31T23:19:34.352 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-03-31T23:19:34.352 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-03-31T23:19:34.354 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-03-31T23:19:34.355 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-03-31T23:19:34.356 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-03-31T23:19:34.357 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-03-31T23:19:34.358 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/rtc.txt 2024-03-31T23:19:34.359 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/ 2024-03-31T23:19:34.360 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-03-31T23:19:34.361 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-03-31T23:19:34.362 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-03-31T23:19:34.363 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-03-31T23:19:34.364 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/DASD 2024-03-31T23:19:34.365 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-03-31T23:19:34.366 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-03-31T23:19:34.367 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-03-31T23:19:34.368 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-03-31T23:19:34.369 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-03-31T23:19:34.370 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-03-31T23:19:34.370 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-03-31T23:19:34.371 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-03-31T23:19:34.372 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-03-31T23:19:34.373 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/ 2024-03-31T23:19:34.374 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-03-31T23:19:34.375 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-03-31T23:19:34.376 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-03-31T23:19:34.377 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-03-31T23:19:34.378 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-03-31T23:19:34.379 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-03-31T23:19:34.380 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-03-31T23:19:34.381 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-03-31T23:19:34.382 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-03-31T23:19:34.382 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-03-31T23:19:34.383 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ 2024-03-31T23:19:34.384 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-03-31T23:19:34.385 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-03-31T23:19:34.386 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-03-31T23:19:34.388 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-03-31T23:19:34.389 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-03-31T23:19:34.391 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-03-31T23:19:34.392 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-03-31T23:19:34.394 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-03-31T23:19:34.396 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-03-31T23:19:34.398 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-03-31T23:19:34.399 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-03-31T23:19:34.401 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-03-31T23:19:34.402 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-03-31T23:19:34.404 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-03-31T23:19:34.406 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-03-31T23:19:34.407 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-03-31T23:19:34.409 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-03-31T23:19:34.410 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-03-31T23:19:34.412 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-03-31T23:19:34.413 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-03-31T23:19:34.415 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-03-31T23:19:34.416 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-03-31T23:19:34.418 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-03-31T23:19:34.419 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-03-31T23:19:34.421 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-03-31T23:19:34.422 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-03-31T23:19:34.424 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-03-31T23:19:34.426 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-03-31T23:19:34.427 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-03-31T23:19:34.429 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-03-31T23:19:34.430 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-03-31T23:19:34.432 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-03-31T23:19:34.433 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-03-31T23:19:34.435 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-03-31T23:19:34.437 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-03-31T23:19:34.438 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-03-31T23:19:34.440 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-03-31T23:19:34.441 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-03-31T23:19:34.443 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-03-31T23:19:34.444 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-03-31T23:19:34.445 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-03-31T23:19:34.446 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-03-31T23:19:34.447 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-03-31T23:19:34.448 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-03-31T23:19:34.448 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-03-31T23:19:34.450 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-03-31T23:19:34.450 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-03-31T23:19:34.451 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-03-31T23:19:34.453 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-03-31T23:19:34.454 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-03-31T23:19:34.455 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-03-31T23:19:34.456 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-03-31T23:19:34.457 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-03-31T23:19:34.458 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-03-31T23:19:34.459 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-03-31T23:19:34.460 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-03-31T23:19:34.461 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-03-31T23:19:34.462 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-03-31T23:19:34.464 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-03-31T23:19:34.465 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/ 2024-03-31T23:19:34.467 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-03-31T23:19:34.468 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-03-31T23:19:34.470 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-03-31T23:19:34.471 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-03-31T23:19:34.472 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-03-31T23:19:34.474 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-03-31T23:19:34.476 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-03-31T23:19:34.477 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-03-31T23:19:34.479 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-03-31T23:19:34.480 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-03-31T23:19:34.482 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-03-31T23:19:34.483 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-03-31T23:19:34.485 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-03-31T23:19:34.486 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-03-31T23:19:34.488 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/ 2024-03-31T23:19:34.489 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-03-31T23:19:34.491 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-03-31T23:19:34.492 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/driver 2024-03-31T23:19:34.494 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-03-31T23:19:34.495 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-03-31T23:19:34.497 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-03-31T23:19:34.498 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-03-31T23:19:34.500 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-03-31T23:19:34.501 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-03-31T23:19:34.503 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sh/ 2024-03-31T23:19:34.505 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-03-31T23:19:34.506 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-03-31T23:19:34.507 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-03-31T23:19:34.509 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/ 2024-03-31T23:19:34.510 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-03-31T23:19:34.512 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-03-31T23:19:34.513 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-03-31T23:19:34.515 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-03-31T23:19:34.517 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-03-31T23:19:34.518 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-03-31T23:19:34.519 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-03-31T23:19:34.520 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-03-31T23:19:34.522 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-03-31T23:19:34.523 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-03-31T23:19:34.525 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-03-31T23:19:34.527 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-03-31T23:19:34.528 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-03-31T23:19:34.530 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-03-31T23:19:34.531 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-03-31T23:19:34.532 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-03-31T23:19:34.534 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-03-31T23:19:34.535 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-03-31T23:19:34.537 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-03-31T23:19:34.538 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-03-31T23:19:34.540 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-03-31T23:19:34.541 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-03-31T23:19:34.542 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-03-31T23:19:34.544 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-03-31T23:19:34.545 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-03-31T23:19:34.546 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-03-31T23:19:34.548 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-03-31T23:19:34.549 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-03-31T23:19:34.555 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-03-31T23:19:34.556 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-03-31T23:19:34.556 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-03-31T23:19:34.556 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-03-31T23:19:34.557 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-03-31T23:19:34.558 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-03-31T23:19:34.559 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-03-31T23:19:34.561 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-03-31T23:19:34.562 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-03-31T23:19:34.564 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-03-31T23:19:34.565 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-03-31T23:19:34.566 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-03-31T23:19:34.568 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-03-31T23:19:34.569 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-03-31T23:19:34.570 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-03-31T23:19:34.572 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-03-31T23:19:34.573 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-03-31T23:19:34.574 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-03-31T23:19:34.575 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-03-31T23:19:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-03-31T23:19:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-03-31T23:19:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-03-31T23:19:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-03-31T23:19:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-03-31T23:19:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-03-31T23:19:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-03-31T23:19:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-03-31T23:19:34.590 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-03-31T23:19:34.591 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-03-31T23:19:34.592 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-03-31T23:19:34.594 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-03-31T23:19:34.595 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-03-31T23:19:34.596 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-03-31T23:19:34.597 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-03-31T23:19:34.598 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sparse.txt 2024-03-31T23:19:34.599 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/ 2024-03-31T23:19:34.601 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-03-31T23:19:34.602 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-03-31T23:19:34.603 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-03-31T23:19:34.604 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-03-31T23:19:34.605 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-03-31T23:19:34.607 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-03-31T23:19:34.609 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-03-31T23:19:34.611 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-03-31T23:19:34.612 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-03-31T23:19:34.613 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/spidev 2024-03-31T23:19:34.615 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-03-31T23:19:34.616 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-03-31T23:19:34.617 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-03-31T23:19:34.618 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-03-31T23:19:34.620 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-03-31T23:19:34.621 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/svga.txt 2024-03-31T23:19:34.622 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/ 2024-03-31T23:19:34.623 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-03-31T23:19:34.624 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/README 2024-03-31T23:19:34.626 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-03-31T23:19:34.627 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-03-31T23:19:34.628 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-03-31T23:19:34.629 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-03-31T23:19:34.630 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-03-31T23:19:34.631 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-03-31T23:19:34.632 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-03-31T23:19:34.633 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-03-31T23:19:34.635 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/target/ 2024-03-31T23:19:34.636 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-03-31T23:19:34.637 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-03-31T23:19:34.638 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-03-31T23:19:34.639 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/ 2024-03-31T23:19:34.640 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-03-31T23:19:34.641 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-03-31T23:19:34.642 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-03-31T23:19:34.644 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-03-31T23:19:34.645 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-03-31T23:19:34.646 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-03-31T23:19:34.647 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-03-31T23:19:34.648 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-03-31T23:19:34.650 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/ 2024-03-31T23:19:34.651 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-03-31T23:19:34.652 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-03-31T23:19:34.654 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-03-31T23:19:34.656 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-03-31T23:19:34.658 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-03-31T23:19:34.660 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-03-31T23:19:34.662 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-03-31T23:19:34.664 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-03-31T23:19:34.666 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-03-31T23:19:34.668 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-03-31T23:19:34.669 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-03-31T23:19:34.670 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/tpm/ 2024-03-31T23:19:34.672 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-03-31T23:19:34.673 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/ 2024-03-31T23:19:34.675 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-03-31T23:19:34.676 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-03-31T23:19:34.678 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-03-31T23:19:34.679 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-03-31T23:19:34.680 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-03-31T23:19:34.682 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-03-31T23:19:34.683 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-03-31T23:19:34.685 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-03-31T23:19:34.687 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-03-31T23:19:34.688 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-03-31T23:19:34.690 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-03-31T23:19:34.691 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-03-31T23:19:34.692 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-03-31T23:19:34.694 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-03-31T23:19:34.695 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-03-31T23:19:34.696 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-03-31T23:19:34.698 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-03-31T23:19:34.699 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-03-31T23:19:34.701 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/unicode.txt 2024-03-31T23:19:34.702 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/unshare.txt 2024-03-31T23:19:34.704 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/ 2024-03-31T23:19:34.706 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-03-31T23:19:34.707 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-03-31T23:19:34.708 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-03-31T23:19:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-03-31T23:19:34.712 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-03-31T23:19:34.714 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-03-31T23:19:34.716 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-03-31T23:19:34.718 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-03-31T23:19:34.719 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-03-31T23:19:34.721 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-03-31T23:19:34.722 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-03-31T23:19:34.723 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-03-31T23:19:34.724 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-03-31T23:19:34.726 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-03-31T23:19:34.727 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-03-31T23:19:34.729 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-03-31T23:19:34.730 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-03-31T23:19:34.731 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-03-31T23:19:34.733 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-03-31T23:19:34.734 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-03-31T23:19:34.735 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-03-31T23:19:34.736 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-03-31T23:19:34.737 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-03-31T23:19:34.738 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-03-31T23:19:34.740 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-03-31T23:19:34.741 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-03-31T23:19:34.742 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-03-31T23:19:34.743 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-03-31T23:19:34.745 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-03-31T23:19:34.746 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-03-31T23:19:34.747 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-03-31T23:19:34.749 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-03-31T23:19:34.750 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-03-31T23:19:34.751 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-03-31T23:19:34.752 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-03-31T23:19:34.753 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-03-31T23:19:34.754 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vDSO/ 2024-03-31T23:19:34.755 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-03-31T23:19:34.756 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-03-31T23:19:34.757 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-03-31T23:19:34.758 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-03-31T23:19:34.761 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-03-31T23:19:34.762 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vfio.txt 2024-03-31T23:19:34.762 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-03-31T23:19:34.763 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video-output.txt 2024-03-31T23:19:34.764 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/ 2024-03-31T23:19:34.766 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-03-31T23:19:34.767 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-03-31T23:19:34.768 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-03-31T23:19:34.769 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-03-31T23:19:34.770 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-03-31T23:19:34.772 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-03-31T23:19:34.773 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-03-31T23:19:34.774 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-03-31T23:19:34.775 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-03-31T23:19:34.776 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-03-31T23:19:34.777 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-03-31T23:19:34.778 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-03-31T23:19:34.780 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-03-31T23:19:34.781 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-03-31T23:19:34.782 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-03-31T23:19:34.783 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-03-31T23:19:34.784 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-03-31T23:19:34.786 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-03-31T23:19:34.787 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-03-31T23:19:34.788 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-03-31T23:19:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-03-31T23:19:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-03-31T23:19:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-03-31T23:19:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-03-31T23:19:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-03-31T23:19:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-03-31T23:19:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-03-31T23:19:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-03-31T23:19:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-03-31T23:19:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-03-31T23:19:34.806 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-03-31T23:19:34.808 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-03-31T23:19:34.810 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-03-31T23:19:34.812 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-03-31T23:19:34.814 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-03-31T23:19:34.815 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-03-31T23:19:34.817 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-03-31T23:19:34.819 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-03-31T23:19:34.821 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-03-31T23:19:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-03-31T23:19:34.825 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-03-31T23:19:34.827 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-03-31T23:19:34.829 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-03-31T23:19:34.831 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-03-31T23:19:34.832 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-03-31T23:19:34.834 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-03-31T23:19:34.836 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-03-31T23:19:34.837 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-03-31T23:19:34.838 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-03-31T23:19:34.840 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-03-31T23:19:34.841 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-03-31T23:19:34.842 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-03-31T23:19:34.844 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-03-31T23:19:34.845 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-03-31T23:19:34.846 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-03-31T23:19:34.848 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-03-31T23:19:34.849 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-03-31T23:19:34.851 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-03-31T23:19:34.852 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-03-31T23:19:34.854 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-03-31T23:19:34.855 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-03-31T23:19:34.857 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-03-31T23:19:34.858 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-03-31T23:19:34.859 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-03-31T23:19:34.861 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-03-31T23:19:34.862 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-03-31T23:19:34.863 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-03-31T23:19:34.865 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-03-31T23:19:34.866 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-03-31T23:19:34.867 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-03-31T23:19:34.868 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-03-31T23:19:34.870 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-03-31T23:19:34.871 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-03-31T23:19:34.872 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-03-31T23:19:34.874 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-03-31T23:19:34.875 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-03-31T23:19:34.877 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-03-31T23:19:34.878 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-03-31T23:19:34.880 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/ 2024-03-31T23:19:34.881 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-03-31T23:19:34.882 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-03-31T23:19:34.883 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-03-31T23:19:34.884 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-03-31T23:19:34.886 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-03-31T23:19:34.886 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-03-31T23:19:34.888 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-03-31T23:19:34.889 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-03-31T23:19:34.890 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-03-31T23:19:34.891 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-03-31T23:19:34.893 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-03-31T23:19:34.895 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-03-31T23:19:34.897 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-03-31T23:19:34.898 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-03-31T23:19:34.899 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-03-31T23:19:34.901 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-03-31T23:19:34.902 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-03-31T23:19:34.904 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-03-31T23:19:34.905 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-03-31T23:19:34.906 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-03-31T23:19:34.908 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-03-31T23:19:34.909 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-03-31T23:19:34.911 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-03-31T23:19:34.912 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-03-31T23:19:34.913 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-03-31T23:19:34.915 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/ 2024-03-31T23:19:34.916 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-03-31T23:19:34.918 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-03-31T23:19:34.919 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-03-31T23:19:34.921 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/balance 2024-03-31T23:19:34.922 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-03-31T23:19:34.924 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-03-31T23:19:34.925 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-03-31T23:19:34.926 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-03-31T23:19:34.928 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-03-31T23:19:34.929 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-03-31T23:19:34.931 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/numa 2024-03-31T23:19:34.932 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-03-31T23:19:34.933 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-03-31T23:19:34.934 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-03-31T23:19:34.935 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-03-31T23:19:34.936 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-03-31T23:19:34.937 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-03-31T23:19:34.938 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-03-31T23:19:34.940 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-03-31T23:19:34.941 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-03-31T23:19:34.942 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-03-31T23:19:34.944 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-03-31T23:19:34.945 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-03-31T23:19:34.947 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-03-31T23:19:34.948 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-03-31T23:19:34.950 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/ 2024-03-31T23:19:34.951 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-03-31T23:19:34.953 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-03-31T23:19:34.955 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-03-31T23:19:34.956 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-03-31T23:19:34.957 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-03-31T23:19:34.958 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-03-31T23:19:34.959 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-03-31T23:19:34.961 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-03-31T23:19:34.962 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-03-31T23:19:34.963 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-03-31T23:19:34.964 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-03-31T23:19:34.965 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-03-31T23:19:34.966 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-03-31T23:19:34.967 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-03-31T23:19:34.968 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-03-31T23:19:34.969 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-03-31T23:19:34.970 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/ 2024-03-31T23:19:34.971 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-03-31T23:19:34.973 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-03-31T23:19:34.974 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-03-31T23:19:34.975 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-03-31T23:19:34.976 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-03-31T23:19:34.977 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-03-31T23:19:34.978 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-03-31T23:19:34.980 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-03-31T23:19:34.981 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-03-31T23:19:34.982 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-03-31T23:19:34.983 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-03-31T23:19:34.984 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-03-31T23:19:34.986 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-03-31T23:19:34.987 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/wimax/ 2024-03-31T23:19:34.988 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-03-31T23:19:34.989 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-03-31T23:19:34.990 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-03-31T23:19:34.992 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/ 2024-03-31T23:19:34.993 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-03-31T23:19:34.995 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-03-31T23:19:34.996 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-03-31T23:19:34.998 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-03-31T23:19:34.999 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-03-31T23:19:35.001 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-03-31T23:19:35.003 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-03-31T23:19:35.004 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-03-31T23:19:35.006 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-03-31T23:19:35.008 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-03-31T23:19:35.009 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-03-31T23:19:35.011 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-03-31T23:19:35.012 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-03-31T23:19:35.014 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-03-31T23:19:35.016 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-03-31T23:19:35.017 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-03-31T23:19:35.019 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-03-31T23:19:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-03-31T23:19:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-03-31T23:19:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-03-31T23:19:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-03-31T23:19:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-03-31T23:19:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-03-31T23:19:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-03-31T23:19:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/xtensa/ 2024-03-31T23:19:35.034 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-03-31T23:19:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-03-31T23:19:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/xz.txt 2024-03-31T23:19:35.039 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-03-31T23:19:35.041 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-03-31T23:19:35.043 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-03-31T23:19:35.044 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-03-31T23:19:35.046 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-03-31T23:19:35.048 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-03-31T23:19:35.049 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-03-31T23:19:35.051 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-03-31T23:19:35.053 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-03-31T23:19:35.054 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-03-31T23:19:35.056 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-03-31T23:19:35.058 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-03-31T23:19:35.059 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-03-31T23:19:35.061 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-03-31T23:19:35.062 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-03-31T23:19:35.064 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-03-31T23:19:35.066 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-03-31T23:19:35.067 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-03-31T23:19:35.068 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-03-31T23:19:35.070 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-03-31T23:19:35.071 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-03-31T23:19:35.073 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-03-31T23:19:35.074 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-03-31T23:19:35.076 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-03-31T23:19:35.077 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-03-31T23:19:35.078 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-03-31T23:19:35.079 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-03-31T23:19:35.081 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-03-31T23:19:35.082 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-03-31T23:19:35.083 INFO:tasks.workunit.client.0.smithi042.stdout:linux-4.0.5/Documentation/zorro.txt 2024-03-31T23:19:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:35 smithi094 ceph-mon[36167]: pgmap v45: 129 pgs: 129 active+clean; 84 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 6.9 MiB/s wr, 31 op/s 2024-03-31T23:19:35.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:35 smithi188 ceph-mon[36068]: pgmap v45: 129 pgs: 129 active+clean; 84 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 6.9 MiB/s wr, 31 op/s 2024-03-31T23:19:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:35 smithi042 ceph-mon[32380]: pgmap v45: 129 pgs: 129 active+clean; 84 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 6.9 MiB/s wr, 31 op/s 2024-03-31T23:19:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:37 smithi094 ceph-mon[36167]: pgmap v46: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 7.4 MiB/s wr, 521 op/s 2024-03-31T23:19:37.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:19:37.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:19:37.953 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:37 smithi042 ceph-mon[32380]: pgmap v46: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 7.4 MiB/s wr, 521 op/s 2024-03-31T23:19:37.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:37 smithi188 ceph-mon[36068]: pgmap v46: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 7.4 MiB/s wr, 521 op/s 2024-03-31T23:19:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 -- 172.21.15.42:0/1240237180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc490068950 msgr2=0x7fc490068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 --2- 172.21.15.42:0/1240237180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc490068950 0x7fc490068dd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc484009930 tx=0x7fc48402bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:38.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 -- 172.21.15.42:0/1240237180 shutdown_connections 2024-03-31T23:19:38.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 --2- 172.21.15.42:0/1240237180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc490069310 0x7fc49010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 --2- 172.21.15.42:0/1240237180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc490068950 0x7fc490068dd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 --2- 172.21.15.42:0/1240237180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4901077a0 0x7fc490107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 -- 172.21.15.42:0/1240237180 >> 172.21.15.42:0/1240237180 conn(0x7fc490077750 msgr2=0x7fc490077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 -- 172.21.15.42:0/1240237180 shutdown_connections 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.036+0000 7fc4959ae640 1 -- 172.21.15.42:0/1240237180 wait complete. 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 Processor -- start 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 -- start start 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc490068950 0x7fc490198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc490069310 0x7fc4901985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 0x7fc49019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc490111c10 con 0x7fc4901077a0 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc490111a90 con 0x7fc490069310 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc4959ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc490111d90 con 0x7fc490068950 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 0x7fc49019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 0x7fc49019c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36174/0 (socket says 172.21.15.42:36174) 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 -- 172.21.15.42:0/3132163930 learned_addr learned my addr 172.21.15.42:0/3132163930 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48effd640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc490068950 0x7fc490198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc490069310 0x7fc4901985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 -- 172.21.15.42:0/3132163930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc490068950 msgr2=0x7fc490198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc490068950 0x7fc490198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 -- 172.21.15.42:0/3132163930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc490069310 msgr2=0x7fc4901985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc490069310 0x7fc4901985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.037+0000 7fc48f7fe640 1 -- 172.21.15.42:0/3132163930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49019d080 con 0x7fc4901077a0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.038+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 0x7fc49019c950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc48800eb10 tx=0x7fc48800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.038+0000 7fc4949ac640 1 -- 172.21.15.42:0/3132163930 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488004b20 con 0x7fc4901077a0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.038+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49019d370 con 0x7fc4901077a0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.038+0000 7fc4949ac640 1 -- 172.21.15.42:0/3132163930 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc488004cc0 con 0x7fc4901077a0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.038+0000 7fc4949ac640 1 -- 172.21.15.42:0/3132163930 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4880107f0 con 0x7fc4901077a0 2024-03-31T23:19:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.038+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4901a4c00 con 0x7fc4901077a0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.040+0000 7fc4949ac640 1 -- 172.21.15.42:0/3132163930 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7fc488005020 con 0x7fc4901077a0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.040+0000 7fc49858b740 1 Processor -- start 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.040+0000 7fc49858b740 1 -- start start 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc4949ac640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4780a2730 0x7fc4780a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc49858b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d0ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc49858b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d15660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc49858b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d17f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc49858b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf73c6c180 con 0x55cf73d0cfc0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc49858b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55cf73c14b70 con 0x55cf73d15ba0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc49858b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cf73c68220 con 0x55cf73d0c6a0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc4949ac640 1 -- 172.21.15.42:0/3132163930 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc4880cf730 con 0x7fc4901077a0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4780a2730 0x7fc4780a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d0ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d17f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d17f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:47748/0 (socket says 172.21.15.42:47748) 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d0ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53170/0 (socket says 172.21.15.42:53170) 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 -- 172.21.15.42:0/1673096993 learned_addr learned my addr 172.21.15.42:0/1673096993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d15660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 -- 172.21.15.42:0/1673096993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 msgr2=0x55cf73d0ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d0ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 -- 172.21.15.42:0/1673096993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 msgr2=0x55cf73d15660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d15660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 -- 172.21.15.42:0/1673096993 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf73c287c0 con 0x55cf73d15ba0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d17f90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc488098280 tx=0x7fc48809b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b926b33452f69db server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.041+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4780a2730 0x7fc4780a4bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc484000c00 tx=0x7fc48402c610 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc475ffb640 1 -- 172.21.15.42:0/1673096993 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48809bfb0 con 0x55cf73d15ba0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc475ffb640 1 -- 172.21.15.42:0/1673096993 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc488014230 con 0x55cf73d15ba0 2024-03-31T23:19:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc475ffb640 1 -- 172.21.15.42:0/1673096993 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488099c40 con 0x55cf73d15ba0 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 -- 172.21.15.42:0/1673096993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 msgr2=0x55cf73d17f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d17f90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc488098280 tx=0x7fc48809b740 comp rx=0 tx=0).stop 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 -- 172.21.15.42:0/1673096993 shutdown_connections 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d17f90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d15660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 --2- 172.21.15.42:0/1673096993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d0ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 -- 172.21.15.42:0/1673096993 >> 172.21.15.42:0/1673096993 conn(0x55cf73d06dd0 msgr2=0x55cf73d071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 -- 172.21.15.42:0/1673096993 shutdown_connections 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.042+0000 7fc49858b740 1 -- 172.21.15.42:0/1673096993 wait complete. 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 -- start start 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 Processor -- start 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d0c6a0 0x55cf73d12cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d13200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d15ba0 0x55cf73d13740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf73d18990 con 0x55cf73d0cfc0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55cf73c0a4a0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cf73d18b10 con 0x55cf73d15ba0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc49858b740 10 client.0 _ll_register_callbacks cb 0x55cf73c0dd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d13200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d13200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36194/0 (socket says 172.21.15.42:36194) 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48e7fc640 1 -- 172.21.15.42:0/2036019828 learned_addr learned my addr 172.21.15.42:0/2036019828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48effd640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d0c6a0 0x55cf73d12cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d15ba0 0x55cf73d13740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48e7fc640 1 -- 172.21.15.42:0/2036019828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d15ba0 msgr2=0x55cf73d13740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.043+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d15ba0 0x55cf73d13740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc48e7fc640 1 -- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d0c6a0 msgr2=0x55cf73d12cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d0c6a0 0x55cf73d12cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc48e7fc640 1 -- 172.21.15.42:0/2036019828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf73a4a7d0 con 0x55cf73d0cfc0 2024-03-31T23:19:38.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc48effd640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d0c6a0 0x55cf73d12cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d13200 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc484035000 tx=0x7fc484046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb14c5f05582353 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc46effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc46effd640 1 -- 172.21.15.42:0/2036019828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484053060 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc46effd640 1 -- 172.21.15.42:0/2036019828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc4840346f0 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc488014230 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc46effd640 1 -- 172.21.15.42:0/2036019828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc48405a050 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc49858b740 10 client.16209 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf739803f0 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc46effd640 1 -- 172.21.15.42:0/2036019828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc488014230 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.044+0000 7fc46effd640 1 -- 172.21.15.42:0/2036019828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc484043780 con 0x55cf73d0cfc0 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc49858b740 10 client.16209 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc49858b740 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc49858b740 20 client.16209 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc49858b740 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d26010 0x55cf73d28400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc49858b740 4 client.16209 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf73c796c0 con 0x55cf73d26010 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc48effd640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d26010 0x55cf73d28400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc46effd640 10 client.16209 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.045+0000 7fc48effd640 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d26010 0x55cf73d28400 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad51291d2182785a server_cookie=f496a488c9c177a0 in_seq=0 out_seq=0 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc46effd640 1 -- 172.21.15.42:0/2036019828 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55cf73c796c0 con 0x55cf73d26010 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc46effd640 10 client.16209 handle_command_reply: tid=0 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 client.16209 shutdown 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 msgr2=0x55cf73d13200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d13200 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc484035000 tx=0x7fc484046040 comp rx=0 tx=0).stop 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 shutdown_connections 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d26010 0x55cf73d28400 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d15ba0 0x55cf73d13740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d13200 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc46effd640 0 client.16209 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:38.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 --2- 172.21.15.42:0/2036019828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d0c6a0 0x55cf73d12cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 >> 172.21.15.42:0/2036019828 conn(0x55cf73d06dd0 msgr2=0x55cf73d08290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 shutdown_connections 2024-03-31T23:19:38.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 1 -- 172.21.15.42:0/2036019828 wait complete. 2024-03-31T23:19:38.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.046+0000 7fc49858b740 20 client.16209 trim_cache size 0 max 16384 2024-03-31T23:19:38.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 Processor -- start 2024-03-31T23:19:38.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 -- start start 2024-03-31T23:19:38.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 0x55cf73d21730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0cfc0 0x55cf73d088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d2dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc4901aca10 con 0x55cf73d0c6a0 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc4901ae550 con 0x55cf73d15ba0 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc49858b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4901ad0e0 con 0x55cf73d0cfc0 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 0x55cf73d21730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 0x55cf73d21730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36200/0 (socket says 172.21.15.42:36200) 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 -- 172.21.15.42:0/1712266673 learned_addr learned my addr 172.21.15.42:0/1712266673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0cfc0 0x55cf73d088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d2dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 -- 172.21.15.42:0/1712266673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0cfc0 msgr2=0x55cf73d088a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0cfc0 0x55cf73d088a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 -- 172.21.15.42:0/1712266673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 msgr2=0x55cf73d2dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.064+0000 7fc48effd640 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d2dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.065+0000 7fc48effd640 1 -- 172.21.15.42:0/1712266673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf739400f0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.065+0000 7fc48effd640 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 0x55cf73d21730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc480009fa0 tx=0x7fc480005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2744d0c5919971 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.065+0000 7fc4757fa640 1 -- 172.21.15.42:0/1712266673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480004230 con 0x55cf73d0c6a0 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.065+0000 7fc4757fa640 1 -- 172.21.15.42:0/1712266673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4800043d0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.065+0000 7fc4757fa640 1 -- 172.21.15.42:0/1712266673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480003e10 con 0x55cf73d0c6a0 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- 172.21.15.42:0/1712266673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 msgr2=0x55cf73d21730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 0x55cf73d21730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc480009fa0 tx=0x7fc480005f90 comp rx=0 tx=0).stop 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- 172.21.15.42:0/1712266673 shutdown_connections 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d2dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0cfc0 0x55cf73d088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- 172.21.15.42:0/1712266673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0c6a0 0x55cf73d21730 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- 172.21.15.42:0/1712266673 >> 172.21.15.42:0/1712266673 conn(0x55cf73d06dd0 msgr2=0x55cf73d08190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- 172.21.15.42:0/1712266673 shutdown_connections 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- 172.21.15.42:0/1712266673 wait complete. 2024-03-31T23:19:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- start start 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 Processor -- start 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d1df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d1ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d1b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc4901ade80 con 0x55cf73d0cfc0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc4901ad7b0 con 0x55cf73d15ba0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.066+0000 7fc49858b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4901aa9d0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc49858b740 10 client.0 _ll_register_callbacks cb 0x7fc484009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d1df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d1ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d1df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53206/0 (socket says 172.21.15.42:53206) 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d1ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36214/0 (socket says 172.21.15.42:36214) 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 -- 172.21.15.42:0/1293538223 learned_addr learned my addr 172.21.15.42:0/1293538223 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d1b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 -- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 msgr2=0x55cf73d1b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d1b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 -- 172.21.15.42:0/1293538223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 msgr2=0x55cf73d1ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d1ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 -- 172.21.15.42:0/1293538223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf73d1b930 con 0x55cf73d0c6a0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48f7fe640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d1b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d1ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc48effd640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d1df50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc48000a010 tx=0x7fc480004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3bf799a30965e34 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc46effd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc46effd640 1 -- 172.21.15.42:0/1293538223 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4800201b0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4800043d0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc46effd640 1 -- 172.21.15.42:0/1293538223 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fc480020350 con 0x55cf73d0c6a0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.067+0000 7fc46effd640 1 -- 172.21.15.42:0/1293538223 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc48003c050 con 0x55cf73d0c6a0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 10 client.25987 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf73d8d210 con 0x55cf73d0c6a0 2024-03-31T23:19:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc46effd640 1 -- 172.21.15.42:0/1293538223 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4800043d0 con 0x55cf73d0c6a0 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc46effd640 1 -- 172.21.15.42:0/1293538223 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc480003e10 con 0x55cf73d0c6a0 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 10 client.25987 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 10 client.25987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 20 client.25987 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d8d880 0x55cf73d8fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 4 client.25987 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf73c73a10 con 0x55cf73d8d880 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d8d880 0x55cf73d8fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc46effd640 10 client.25987 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.068+0000 7fc48e7fc640 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d8d880 0x55cf73d8fc70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97db902bc0409808 server_cookie=3fb6f59a8a921476 in_seq=0 out_seq=0 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc46effd640 1 -- 172.21.15.42:0/1293538223 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cf73c73a10 con 0x55cf73d8d880 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc46effd640 10 client.25987 handle_command_reply: tid=0 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 client.25987 shutdown 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 msgr2=0x55cf73d1df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d1df50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc48000a010 tx=0x7fc480004610 comp rx=0 tx=0).stop 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 shutdown_connections 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cf73d8d880 0x55cf73d8fc70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cf73d15ba0 0x55cf73d1b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc46effd640 0 client.25987 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf73d0cfc0 0x55cf73d1ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 --2- 172.21.15.42:0/1293538223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf73d0c6a0 0x55cf73d1df50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 >> 172.21.15.42:0/1293538223 conn(0x55cf73d06dd0 msgr2=0x55cf73d13510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 shutdown_connections 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 1 -- 172.21.15.42:0/1293538223 wait complete. 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc49858b740 20 client.25987 trim_cache size 0 max 16384 2024-03-31T23:19:38.076 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:19:38.077 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-03-31T23:19:38.077 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-03-31T23:19:38.077 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4780a2730 msgr2=0x7fc4780a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc4959ae640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4780a2730 0x7fc4780a4bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc484000c00 tx=0x7fc48402c610 comp rx=0 tx=0).stop 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 msgr2=0x7fc49019c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.069+0000 7fc4959ae640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 0x7fc49019c950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc48800eb10 tx=0x7fc48800c2d0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 shutdown_connections 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4780a2730 0x7fc4780a4bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4901077a0 0x7fc49019c950 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc490069310 0x7fc4901985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 --2- 172.21.15.42:0/3132163930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc490068950 0x7fc490198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 >> 172.21.15.42:0/3132163930 conn(0x7fc490077750 msgr2=0x7fc4900fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 shutdown_connections 2024-03-31T23:19:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.070+0000 7fc4959ae640 1 -- 172.21.15.42:0/3132163930 wait complete. 2024-03-31T23:19:38.081 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-31T23:19:38.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 -- 172.21.15.42:0/1612920077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888100650 msgr2=0x7f5888100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1612920077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888100650 0x7f5888100ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5878009900 tx=0x7f587802bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 -- 172.21.15.42:0/1612920077 shutdown_connections 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1612920077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888101010 0x7f588810d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1612920077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888100650 0x7f5888100ad0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1612920077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 0x7f5888106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 -- 172.21.15.42:0/1612920077 >> 172.21.15.42:0/1612920077 conn(0x7f5888077750 msgr2=0x7f5888077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 -- 172.21.15.42:0/1612920077 shutdown_connections 2024-03-31T23:19:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.228+0000 7f588f7c9640 1 -- 172.21.15.42:0/1612920077 wait complete. 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 Processor -- start 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 -- start start 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 0x7f5888198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888101010 0x7f58881986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 0x7f588819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5888110b90 con 0x7f5888106660 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5888110a10 con 0x7f5888101010 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588f7c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5888110d10 con 0x7f5888100650 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588d565640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 0x7f5888198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 0x7f588819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588d565640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 0x7f5888198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53224/0 (socket says 172.21.15.42:53224) 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588d565640 1 -- 172.21.15.42:0/1152464820 learned_addr learned my addr 172.21.15.42:0/1152464820 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588cd64640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888101010 0x7f58881986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 -- 172.21.15.42:0/1152464820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 msgr2=0x7f5888198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 0x7f5888198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 -- 172.21.15.42:0/1152464820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888101010 msgr2=0x7f58881986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888101010 0x7f58881986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 -- 172.21.15.42:0/1152464820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588819d180 con 0x7f5888106660 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588d565640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 0x7f5888198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588cd64640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888101010 0x7f58881986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.229+0000 7f588dd66640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 0x7f588819ca50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5880009fd0 tx=0x7f588000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.230+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588000ce20 con 0x7f5888106660 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.230+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5880004b20 con 0x7f5888106660 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.230+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588819d470 con 0x7f5888106660 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.230+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880010790 con 0x7f5888106660 2024-03-31T23:19:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.230+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58881a4d00 con 0x7f5888106660 2024-03-31T23:19:38.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.231+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5888068540 con 0x7f5888106660 2024-03-31T23:19:38.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.232+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f5880005020 con 0x7f5888106660 2024-03-31T23:19:38.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.233+0000 7f587e7fc640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58740a2730 0x7f58740a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.233+0000 7f588d565640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58740a2730 0x7f58740a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.233+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f58800cf8b0 con 0x7f5888106660 2024-03-31T23:19:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.233+0000 7f588d565640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58740a2730 0x7f58740a4bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58840095f0 tx=0x7f5884005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.237+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f588009c170 con 0x7f5888106660 2024-03-31T23:19:38.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.463+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5888109bf0 con 0x7f5888106660 2024-03-31T23:19:38.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.463+0000 7f587e7fc640 1 -- 172.21.15.42:0/1152464820 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11923 (secure 0 0 0) 0x7f588009ba70 con 0x7f5888106660 2024-03-31T23:19:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:19:38.464 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:17:54.070406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:19:38.465 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-03-31T23:19:38.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58740a2730 msgr2=0x7f58740a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58740a2730 0x7f58740a4bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58840095f0 tx=0x7f5884005f90 comp rx=0 tx=0).stop 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 msgr2=0x7f588819ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 0x7f588819ca50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5880009fd0 tx=0x7f588000ef10 comp rx=0 tx=0).stop 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 shutdown_connections 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58740a2730 0x7f58740a4bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5888106660 0x7f588819ca50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5888101010 0x7f58881986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 --2- 172.21.15.42:0/1152464820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5888100650 0x7f5888198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 >> 172.21.15.42:0/1152464820 conn(0x7f5888077750 msgr2=0x7f5888068b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 shutdown_connections 2024-03-31T23:19:38.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.466+0000 7f588f7c9640 1 -- 172.21.15.42:0/1152464820 wait complete. 2024-03-31T23:19:38.477 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 -- 172.21.15.42:0/1996975157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60106660 msgr2=0x7faf60106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 --2- 172.21.15.42:0/1996975157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60106660 0x7faf60106a40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faf50009930 tx=0x7faf5002bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 -- 172.21.15.42:0/1996975157 shutdown_connections 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 --2- 172.21.15.42:0/1996975157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf60100f80 0x7faf6010d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 --2- 172.21.15.42:0/1996975157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf601005c0 0x7faf60100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 --2- 172.21.15.42:0/1996975157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60106660 0x7faf60106a40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 -- 172.21.15.42:0/1996975157 >> 172.21.15.42:0/1996975157 conn(0x7faf60077750 msgr2=0x7faf60077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 -- 172.21.15.42:0/1996975157 shutdown_connections 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.582+0000 7faf656ed640 1 -- 172.21.15.42:0/1996975157 wait complete. 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 Processor -- start 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 -- start start 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf601005c0 0x7faf60102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 0x7faf601027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf60106660 0x7faf60102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf60110a70 con 0x7faf60100f80 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faf601108f0 con 0x7faf60106660 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf656ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faf60110bf0 con 0x7faf601005c0 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf567fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 0x7faf601027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf567fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 0x7faf601027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36246/0 (socket says 172.21.15.42:36246) 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf567fc640 1 -- 172.21.15.42:0/3503028611 learned_addr learned my addr 172.21.15.42:0/3503028611 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf5effd640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf601005c0 0x7faf60102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.583+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf60106660 0x7faf60102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf567fc640 1 -- 172.21.15.42:0/3503028611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf601005c0 msgr2=0x7faf60102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf567fc640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf601005c0 0x7faf60102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf567fc640 1 -- 172.21.15.42:0/3503028611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf60106660 msgr2=0x7faf60102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf567fc640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf60106660 0x7faf60102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf567fc640 1 -- 172.21.15.42:0/3503028611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf601a65c0 con 0x7faf60100f80 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf567fc640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 0x7faf601027a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faf4800e9f0 tx=0x7faf4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf5cff9640 1 -- 172.21.15.42:0/3503028611 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4800cd80 con 0x7faf60100f80 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf5cff9640 1 -- 172.21.15.42:0/3503028611 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf48010930 con 0x7faf60100f80 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf5cff9640 1 -- 172.21.15.42:0/3503028611 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48018b00 con 0x7faf60100f80 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601a68b0 con 0x7faf60100f80 2024-03-31T23:19:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.584+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601a6e00 con 0x7faf60100f80 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.586+0000 7faf5cff9640 1 -- 172.21.15.42:0/3503028611 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7faf48018ca0 con 0x7faf60100f80 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 Processor -- start 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 -- start start 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5cff9640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7faf4c0a2730 0x7faf4c0a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7faf4c0a2730 0x7faf4c0a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5cff9640 1 -- 172.21.15.42:0/3503028611 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7faf480cf430 con 0x7faf60100f80 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cdbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559836c341b0 con 0x559836cd0470 2024-03-31T23:19:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559836bdcc00 con 0x559836cd9970 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf683a9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559836c30250 con 0x559836cd0d90 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36250/0 (socket says 172.21.15.42:36250) 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf567fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5effd640 1 -- 172.21.15.42:0/2955041324 learned_addr learned my addr 172.21.15.42:0/2955041324 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.587+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cdbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7faf4c0a2730 0x7faf4c0a4bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf58005fd0 tx=0x7faf58009500 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf567fc640 1 -- 172.21.15.42:0/2955041324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 msgr2=0x559836cdbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf567fc640 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cdbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf567fc640 1 -- 172.21.15.42:0/2955041324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 msgr2=0x559836cd0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf567fc640 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf567fc640 1 -- 172.21.15.42:0/2955041324 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559836bfc3d0 con 0x559836cd0d90 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf5effd640 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf567fc640 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd9430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf480cc730 tx=0x7faf480979e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eaf6bb462d449de server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf557fa640 1 -- 172.21.15.42:0/2955041324 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48099a40 con 0x559836cd0d90 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf557fa640 1 -- 172.21.15.42:0/2955041324 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf480cf170 con 0x559836cd0d90 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.588+0000 7faf557fa640 1 -- 172.21.15.42:0/2955041324 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf480cca10 con 0x559836cd0d90 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 -- 172.21.15.42:0/2955041324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 msgr2=0x559836cd9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd9430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf480cc730 tx=0x7faf480979e0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 -- 172.21.15.42:0/2955041324 shutdown_connections 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cdbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd9430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 --2- 172.21.15.42:0/2955041324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 -- 172.21.15.42:0/2955041324 >> 172.21.15.42:0/2955041324 conn(0x559836ccaba0 msgr2=0x559836ccaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 -- 172.21.15.42:0/2955041324 shutdown_connections 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 -- 172.21.15.42:0/2955041324 wait complete. 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 -- start start 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.589+0000 7faf683a9740 1 Processor -- start 2024-03-31T23:19:38.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0d90 0x559836cd6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd9970 0x559836cd74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559836cdc760 con 0x559836cd0470 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559836bd2470 con 0x559836cd0d90 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559836cdc8e0 con 0x559836cd9970 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 10 client.0 _ll_register_callbacks cb 0x559836befcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36262/0 (socket says 172.21.15.42:36262) 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 -- 172.21.15.42:0/2977653031 learned_addr learned my addr 172.21.15.42:0/2977653031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf567fc640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0d90 0x559836cd6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd9970 0x559836cd74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 -- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd9970 msgr2=0x559836cd74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd9970 0x559836cd74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 -- 172.21.15.42:0/2977653031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0d90 msgr2=0x559836cd6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0d90 0x559836cd6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 -- 172.21.15.42:0/2977653031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598369483f0 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf567fc640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0d90 0x559836cd6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf5effd640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd6a70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faf50009230 tx=0x7faf5002cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c6978beb36b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf467fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf467fc640 1 -- 172.21.15.42:0/2977653031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50004310 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf467fc640 1 -- 172.21.15.42:0/2977653031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7faf50005030 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.590+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf480cf170 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf467fc640 1 -- 172.21.15.42:0/2977653031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf5004e050 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 10 client.16233 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559836a127d0 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf467fc640 1 -- 172.21.15.42:0/2977653031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf480cf170 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf467fc640 1 -- 172.21.15.42:0/2977653031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faf500035f0 con 0x559836cd0470 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 10 client.16233 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 10 client.16233 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 20 client.16233 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836ce9a40 0x559836cebe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 4 client.16233 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559836c416f0 con 0x559836ce9a40 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.591+0000 7faf567fc640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836ce9a40 0x559836cebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.592+0000 7faf467fc640 10 client.16233 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.592+0000 7faf567fc640 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836ce9a40 0x559836cebe70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8789daa7b8bf417d server_cookie=27068c6221bb65a8 in_seq=0 out_seq=0 2024-03-31T23:19:38.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf467fc640 1 -- 172.21.15.42:0/2977653031 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559836c416f0 con 0x559836ce9a40 2024-03-31T23:19:38.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf467fc640 10 client.16233 handle_command_reply: tid=0 2024-03-31T23:19:38.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 client.16233 shutdown 2024-03-31T23:19:38.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 msgr2=0x559836cd6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd6a70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faf50009230 tx=0x7faf5002cd40 comp rx=0 tx=0).stop 2024-03-31T23:19:38.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 shutdown_connections 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd9970 0x559836cd74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0d90 0x559836cd6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836ce9a40 0x559836cebe70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 --2- 172.21.15.42:0/2977653031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd6a70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 >> 172.21.15.42:0/2977653031 conn(0x559836ccaba0 msgr2=0x559836ccc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf467fc640 0 client.16233 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 shutdown_connections 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 1 -- 172.21.15.42:0/2977653031 wait complete. 2024-03-31T23:19:38.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.593+0000 7faf683a9740 20 client.16233 trim_cache size 0 max 16384 2024-03-31T23:19:38.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.606+0000 7faf683a9740 1 Processor -- start 2024-03-31T23:19:38.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.606+0000 7faf683a9740 1 -- start start 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.606+0000 7faf683a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.606+0000 7faf683a9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836ce5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf683a9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cf1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf683a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf601b0e10 con 0x559836cd0470 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf683a9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faf601b2950 con 0x559836cd9970 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf683a9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faf601b14e0 con 0x559836cd0d90 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36266/0 (socket says 172.21.15.42:36266) 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 -- 172.21.15.42:0/1255279383 learned_addr learned my addr 172.21.15.42:0/1255279383 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf567fc640 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836ce5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cf1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 -- 172.21.15.42:0/1255279383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 msgr2=0x559836ce5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836ce5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 -- 172.21.15.42:0/1255279383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 msgr2=0x559836cf1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cf1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 -- 172.21.15.42:0/1255279383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559836ccf7f0 con 0x559836cd0470 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cf1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf5effd640 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd91a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faf5002f020 tx=0x7faf50001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7921b47443178bac server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf54ff9640 1 -- 172.21.15.42:0/1255279383 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50057070 con 0x559836cd0470 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf54ff9640 1 -- 172.21.15.42:0/1255279383 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf50004bc0 con 0x559836cd0470 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.607+0000 7faf54ff9640 1 -- 172.21.15.42:0/1255279383 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50004e90 con 0x559836cd0470 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 -- 172.21.15.42:0/1255279383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 msgr2=0x559836cd91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd91a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faf5002f020 tx=0x7faf50001e70 comp rx=0 tx=0).stop 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 -- 172.21.15.42:0/1255279383 shutdown_connections 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd9970 0x559836cf1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836ce5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 --2- 172.21.15.42:0/1255279383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd0470 0x559836cd91a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 -- 172.21.15.42:0/1255279383 >> 172.21.15.42:0/1255279383 conn(0x559836ccaba0 msgr2=0x559836ccc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 -- 172.21.15.42:0/1255279383 shutdown_connections 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.608+0000 7faf683a9740 1 -- 172.21.15.42:0/1255279383 wait complete. 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 -- start start 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 Processor -- start 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0470 0x559836cd3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 0x559836cd42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf601b2280 con 0x559836cd9970 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faf601b1bb0 con 0x559836cd0470 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faf601aedd0 con 0x559836cd0d90 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf683a9740 10 client.0 _ll_register_callbacks cb 0x7faf5002c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 0x559836cd42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 0x559836cd42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36270/0 (socket says 172.21.15.42:36270) 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 -- 172.21.15.42:0/2796920677 learned_addr learned my addr 172.21.15.42:0/2796920677 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5effd640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0470 0x559836cd3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf567fc640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 -- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 msgr2=0x559836cd3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 -- 172.21.15.42:0/2796920677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0470 msgr2=0x559836cd3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0470 0x559836cd3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5f7fe640 1 -- 172.21.15.42:0/2796920677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559836d4ef20 con 0x559836cd9970 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf567fc640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.609+0000 7faf5effd640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0470 0x559836cd3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf5f7fe640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 0x559836cd42c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faf58004420 tx=0x7faf58004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e58395fab18b5d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf467fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf467fc640 1 -- 172.21.15.42:0/2796920677 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5801e580 con 0x559836cd9970 2024-03-31T23:19:38.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf467fc640 1 -- 172.21.15.42:0/2796920677 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7faf5801e720 con 0x559836cd9970 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf50004bc0 con 0x559836cd9970 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf467fc640 1 -- 172.21.15.42:0/2796920677 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf58035050 con 0x559836cd9970 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 10 client.16239 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559836d50200 con 0x559836cd9970 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf467fc640 1 -- 172.21.15.42:0/2796920677 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf50004bc0 con 0x559836cd9970 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf467fc640 1 -- 172.21.15.42:0/2796920677 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faf58027b20 con 0x559836cd9970 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 10 client.16239 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 10 client.16239 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 20 client.16239 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836d50a00 0x559836d52e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 4 client.16239 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.610+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559836c3ba40 con 0x559836d50a00 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf5effd640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836d50a00 0x559836d52e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf5effd640 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836d50a00 0x559836d52e20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2f522f103bd77e76 server_cookie=13216d44a293f893 in_seq=0 out_seq=0 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf467fc640 10 client.16239 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf467fc640 1 -- 172.21.15.42:0/2796920677 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559836c3ba40 con 0x559836d50a00 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf467fc640 10 client.16239 handle_command_reply: tid=0 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 client.16239 shutdown 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 msgr2=0x559836cd42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 0x559836cd42c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faf58004420 tx=0x7faf58004ab0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 shutdown_connections 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x559836d50a00 0x559836d52e20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559836cd9970 0x559836cd42c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf467fc640 0 client.16239 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559836cd0d90 0x559836cd3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 --2- 172.21.15.42:0/2796920677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559836cd0470 0x559836cd3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 >> 172.21.15.42:0/2796920677 conn(0x559836ccaba0 msgr2=0x559836ccbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 shutdown_connections 2024-03-31T23:19:38.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 1 -- 172.21.15.42:0/2796920677 wait complete. 2024-03-31T23:19:38.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.611+0000 7faf683a9740 20 client.16239 trim_cache size 0 max 16384 2024-03-31T23:19:38.619 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7faf4c0a2730 msgr2=0x7faf4c0a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7faf4c0a2730 0x7faf4c0a4bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf58005fd0 tx=0x7faf58009500 comp rx=0 tx=0).stop 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 msgr2=0x7faf601027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 0x7faf601027a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faf4800e9f0 tx=0x7faf4800eeb0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 shutdown_connections 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf60106660 0x7faf60102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7faf4c0a2730 0x7faf4c0a4bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf60100f80 0x7faf601027a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 --2- 172.21.15.42:0/3503028611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf601005c0 0x7faf60102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 >> 172.21.15.42:0/3503028611 conn(0x7faf60077750 msgr2=0x7faf600ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 shutdown_connections 2024-03-31T23:19:38.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.612+0000 7faf656ed640 1 -- 172.21.15.42:0/3503028611 wait complete. 2024-03-31T23:19:38.623 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-31T23:19:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2846394276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881076f0 msgr2=0x7ff288107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2846394276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881076f0 0x7ff288107ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff278009930 tx=0x7ff27802bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2846394276 shutdown_connections 2024-03-31T23:19:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2846394276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881020a0 0x7ff28810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2846394276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881016e0 0x7ff288101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2846394276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881076f0 0x7ff288107ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2846394276 >> 172.21.15.42:0/2846394276 conn(0x7ff2880fd1f0 msgr2=0x7ff2880ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2846394276 shutdown_connections 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.730+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2846394276 wait complete. 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 Processor -- start 2024-03-31T23:19:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 -- start start 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 0x7ff2881980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 0x7ff288198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881076f0 0x7ff28819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff288111bd0 con 0x7ff2881020a0 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff288111a50 con 0x7ff2881076f0 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28e7e9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff288111d50 con 0x7ff2881016e0 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 0x7ff288198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff287fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 0x7ff2881980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 0x7ff288198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36284/0 (socket says 172.21.15.42:36284) 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff287fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 0x7ff2881980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53286/0 (socket says 172.21.15.42:53286) 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff2877fe640 1 -- 172.21.15.42:0/2509111852 learned_addr learned my addr 172.21.15.42:0/2509111852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.731+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881076f0 0x7ff28819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2877fe640 1 -- 172.21.15.42:0/2509111852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 msgr2=0x7ff2881980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 0x7ff2881980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2877fe640 1 -- 172.21.15.42:0/2509111852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881076f0 msgr2=0x7ff28819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881076f0 0x7ff28819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2877fe640 1 -- 172.21.15.42:0/2509111852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28819d0c0 con 0x7ff2881020a0 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff287fff640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 0x7ff2881980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881076f0 0x7ff28819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 0x7ff288198610 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00ea60 tx=0x7ff27c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2857fa640 1 -- 172.21.15.42:0/2509111852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00cde0 con 0x7ff2881020a0 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2857fa640 1 -- 172.21.15.42:0/2509111852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff27c0035f0 con 0x7ff2881020a0 2024-03-31T23:19:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28819d3b0 con 0x7ff2881020a0 2024-03-31T23:19:38.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff2857fa640 1 -- 172.21.15.42:0/2509111852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c010720 con 0x7ff2881020a0 2024-03-31T23:19:38.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.732+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881a4c40 con 0x7ff2881020a0 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.734+0000 7ff2913d1740 1 Processor -- start 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.734+0000 7ff2913d1740 1 -- start start 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2857fa640 1 -- 172.21.15.42:0/2509111852 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7ff27c0037a0 con 0x7ff2881020a0 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f14840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f17170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2913d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561058e6b1b0 con 0x561058f07800 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2913d1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x561058e13c00 con 0x561058f06e50 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2913d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561058e67250 con 0x561058f14d80 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f14840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f14840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36288/0 (socket says 172.21.15.42:36288) 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 -- 172.21.15.42:0/2528797037 learned_addr learned my addr 172.21.15.42:0/2528797037 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f17170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 -- 172.21.15.42:0/2528797037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 msgr2=0x561058f17170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f17170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 -- 172.21.15.42:0/2528797037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 msgr2=0x561058f07230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f07230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff287fff640 1 -- 172.21.15.42:0/2528797037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561058e333d0 con 0x561058f07800 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f07230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f17170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2857fa640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff2700a2730 0x7ff2700a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff2700a2730 0x7ff2700a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.735+0000 7ff2857fa640 1 -- 172.21.15.42:0/2509111852 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff27c0cf490 con 0x7ff2881020a0 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff287fff640 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f14840 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff278006010 tx=0x7ff2780095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdc3744e5f0ab47 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff26e7fc640 1 -- 172.21.15.42:0/2528797037 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27802dae0 con 0x561058f07800 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff26e7fc640 1 -- 172.21.15.42:0/2528797037 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff27802dc80 con 0x561058f07800 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff26e7fc640 1 -- 172.21.15.42:0/2528797037 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278004920 con 0x561058f07800 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff2913d1740 1 -- 172.21.15.42:0/2528797037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 msgr2=0x561058f14840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff2700a2730 0x7ff2700a4bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff280009fd0 tx=0x7ff280009500 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.736+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f14840 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff278006010 tx=0x7ff2780095f0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- 172.21.15.42:0/2528797037 shutdown_connections 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f17170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f14840 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2528797037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f07230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- 172.21.15.42:0/2528797037 >> 172.21.15.42:0/2528797037 conn(0x561058f01ba0 msgr2=0x561058f01f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- 172.21.15.42:0/2528797037 shutdown_connections 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- 172.21.15.42:0/2528797037 wait complete. 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- start start 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 Processor -- start 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 0x561058f11d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f07800 0x561058f12250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f12790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561058f17ae0 con 0x561058f06e50 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x561058e09470 con 0x561058f07800 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561058f17c60 con 0x561058f14d80 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.737+0000 7ff2913d1740 10 client.0 _ll_register_callbacks cb 0x561058e26cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 0x561058f11d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 0x561058f11d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36294/0 (socket says 172.21.15.42:36294) 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 -- 172.21.15.42:0/3380462524 learned_addr learned my addr 172.21.15.42:0/3380462524 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff28cd86640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f12790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2877fe640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f07800 0x561058f12250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 -- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 msgr2=0x561058f12790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f12790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 -- 172.21.15.42:0/3380462524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f07800 msgr2=0x561058f12250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f07800 0x561058f12250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 -- 172.21.15.42:0/3380462524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561058b7f3f0 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff287fff640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 0x561058f11d10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff278005ab0 tx=0x7ff278005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae7447c1ee8f285 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2677fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2677fe640 1 -- 172.21.15.42:0/3380462524 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27804d070 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2677fe640 1 -- 172.21.15.42:0/3380462524 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff278003ac0 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff27802dc80 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2677fe640 1 -- 172.21.15.42:0/3380462524 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff278059050 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2913d1740 10 client.16251 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.738+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561058c497d0 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2677fe640 1 -- 172.21.15.42:0/3380462524 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff27802dc80 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2677fe640 1 -- 172.21.15.42:0/3380462524 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff278041480 con 0x561058f06e50 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2913d1740 10 client.16251 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2913d1740 10 client.16251 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2913d1740 20 client.16251 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2913d1740 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f24b40 0x561058f26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2913d1740 4 client.16251 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561058e786f0 con 0x561058f24b40 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2877fe640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f24b40 0x561058f26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2677fe640 10 client.16251 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.739+0000 7ff2877fe640 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f24b40 0x561058f26f30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8791a538b7a8026f server_cookie=92e763845ed1f408 in_seq=0 out_seq=0 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2677fe640 1 -- 172.21.15.42:0/3380462524 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561058e786f0 con 0x561058f24b40 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2677fe640 10 client.16251 handle_command_reply: tid=0 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 client.16251 shutdown 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 msgr2=0x561058f11d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 0x561058f11d10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff278005ab0 tx=0x7ff278005970 comp rx=0 tx=0).stop 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 shutdown_connections 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f24b40 0x561058f26f30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f12790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f07800 0x561058f12250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 --2- 172.21.15.42:0/3380462524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f06e50 0x561058f11d10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2677fe640 0 client.16251 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 >> 172.21.15.42:0/3380462524 conn(0x561058f01ba0 msgr2=0x561058f038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 shutdown_connections 2024-03-31T23:19:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 1 -- 172.21.15.42:0/3380462524 wait complete. 2024-03-31T23:19:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.740+0000 7ff2913d1740 20 client.16251 trim_cache size 0 max 16384 2024-03-31T23:19:38.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 Processor -- start 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 -- start start 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f14440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881aca20 con 0x561058f07800 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881ae560 con 0x561058f06e50 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2913d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881ad0f0 con 0x561058f14d80 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36300/0 (socket says 172.21.15.42:36300) 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 -- 172.21.15.42:0/2847601951 learned_addr learned my addr 172.21.15.42:0/2847601951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff287fff640 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f14440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff28cd86640 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 -- 172.21.15.42:0/2847601951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 msgr2=0x561058f208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 -- 172.21.15.42:0/2847601951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 msgr2=0x561058f14440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f14440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 -- 172.21.15.42:0/2847601951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561058f0cb50 con 0x561058f07800 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff287fff640 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f14440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff2877fe640 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0d060 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff27c097fe0 tx=0x7ff27c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d954d8d33d99c77 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.754+0000 7ff26dffb640 1 -- 172.21.15.42:0/2847601951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c09af70 con 0x561058f07800 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff26dffb640 1 -- 172.21.15.42:0/2847601951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff27c097040 con 0x561058f07800 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff26dffb640 1 -- 172.21.15.42:0/2847601951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0d2d30 con 0x561058f07800 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 -- 172.21.15.42:0/2847601951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 msgr2=0x561058f0d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0d060 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff27c097fe0 tx=0x7ff27c00ef90 comp rx=0 tx=0).stop 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 -- 172.21.15.42:0/2847601951 shutdown_connections 2024-03-31T23:19:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f14d80 0x561058f208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0d060 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 --2- 172.21.15.42:0/2847601951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f06e50 0x561058f14440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 -- 172.21.15.42:0/2847601951 >> 172.21.15.42:0/2847601951 conn(0x561058f01ba0 msgr2=0x561058f00d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 -- 172.21.15.42:0/2847601951 shutdown_connections 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 -- 172.21.15.42:0/2847601951 wait complete. 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.755+0000 7ff2913d1740 1 -- start start 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 Processor -- start 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f06e50 0x561058f0ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f14d80 0x561058f89bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881ade90 con 0x561058f07800 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881ad7c0 con 0x561058f14d80 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881aa9e0 con 0x561058f06e50 2024-03-31T23:19:38.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2913d1740 10 client.0 _ll_register_callbacks cb 0x7ff278004370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36304/0 (socket says 172.21.15.42:36304) 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 -- 172.21.15.42:0/289756295 learned_addr learned my addr 172.21.15.42:0/289756295 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff287fff640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f06e50 0x561058f0ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff28cd86640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f14d80 0x561058f89bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 -- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f06e50 msgr2=0x561058f0ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f06e50 0x561058f0ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 -- 172.21.15.42:0/289756295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f14d80 msgr2=0x561058f89bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f14d80 0x561058f89bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff2877fe640 1 -- 172.21.15.42:0/289756295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561058f0f9e0 con 0x561058f07800 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.756+0000 7ff287fff640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f06e50 0x561058f0ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2677fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2877fe640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0f140 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff27c097a70 tx=0x7ff27c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ee0be074e719aa server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2677fe640 1 -- 172.21.15.42:0/289756295 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0b3020 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2677fe640 1 -- 172.21.15.42:0/289756295 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff27c0b4250 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff27c097040 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2677fe640 1 -- 172.21.15.42:0/289756295 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff27c09af70 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 10 client.16257 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561058f8b1c0 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2677fe640 1 -- 172.21.15.42:0/289756295 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff27c097040 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2677fe640 1 -- 172.21.15.42:0/289756295 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff27c084b50 con 0x561058f07800 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 10 client.16257 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 10 client.16257 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 20 client.16257 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f8b7e0 0x561058f8dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 4 client.16257 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.757+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561058e72a40 con 0x561058f8b7e0 2024-03-31T23:19:38.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff287fff640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f8b7e0 0x561058f8dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff287fff640 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f8b7e0 0x561058f8dc00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dcba7a453a7c5b7e server_cookie=bcf2bf1b55f91f74 in_seq=0 out_seq=0 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2677fe640 10 client.16257 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2677fe640 1 -- 172.21.15.42:0/289756295 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561058e72a40 con 0x561058f8b7e0 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2677fe640 10 client.16257 handle_command_reply: tid=0 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 client.16257 shutdown 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 msgr2=0x561058f0f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0f140 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff27c097a70 tx=0x7ff27c003f30 comp rx=0 tx=0).stop 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 shutdown_connections 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x561058f8b7e0 0x561058f8dc00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561058f14d80 0x561058f89bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561058f07800 0x561058f0f140 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2677fe640 0 client.16257 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 --2- 172.21.15.42:0/289756295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561058f06e50 0x561058f0ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 >> 172.21.15.42:0/289756295 conn(0x561058f01ba0 msgr2=0x561058f11b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 shutdown_connections 2024-03-31T23:19:38.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 1 -- 172.21.15.42:0/289756295 wait complete. 2024-03-31T23:19:38.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.758+0000 7ff2913d1740 20 client.16257 trim_cache size 0 max 16384 2024-03-31T23:19:38.766 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff2700a2730 msgr2=0x7ff2700a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff2700a2730 0x7ff2700a4bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff280009fd0 tx=0x7ff280009500 comp rx=0 tx=0).stop 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 msgr2=0x7ff288198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 0x7ff288198610 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00ea60 tx=0x7ff27c00ef20 comp rx=0 tx=0).stop 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 shutdown_connections 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2881076f0 0x7ff28819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff2700a2730 0x7ff2700a4bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2881020a0 0x7ff288198610 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 --2- 172.21.15.42:0/2509111852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2881016e0 0x7ff2881980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 >> 172.21.15.42:0/2509111852 conn(0x7ff2880fd1f0 msgr2=0x7ff2880fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 shutdown_connections 2024-03-31T23:19:38.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.759+0000 7ff28e7e9640 1 -- 172.21.15.42:0/2509111852 wait complete. 2024-03-31T23:19:38.769 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:38 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1152464820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:19:38.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-31T23:19:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 -- 172.21.15.42:0/3460143630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60100f80 msgr2=0x7f8d6010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/3460143630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60100f80 0x7f8d6010d490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009c10 tx=0x7f8d5802bef0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 -- 172.21.15.42:0/3460143630 shutdown_connections 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/3460143630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60100f80 0x7f8d6010d490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/3460143630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/3460143630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60106660 0x7f8d60106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 -- 172.21.15.42:0/3460143630 >> 172.21.15.42:0/3460143630 conn(0x7f8d60077750 msgr2=0x7f8d60077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 -- 172.21.15.42:0/3460143630 shutdown_connections 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 -- 172.21.15.42:0/3460143630 wait complete. 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 Processor -- start 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.875+0000 7f8d66f1e640 1 -- start start 2024-03-31T23:19:38.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60100f80 0x7f8d601027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60106660 0x7f8d60102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60110ac0 con 0x7f8d601005c0 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60110940 con 0x7f8d60100f80 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60110c40 con 0x7f8d60106660 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60102260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36324/0 (socket says 172.21.15.42:36324) 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 -- 172.21.15.42:0/4028746327 learned_addr learned my addr 172.21.15.42:0/4028746327 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60100f80 0x7f8d601027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d654bb640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60106660 0x7f8d60102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 -- 172.21.15.42:0/4028746327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60106660 msgr2=0x7f8d60102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60106660 0x7f8d60102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 -- 172.21.15.42:0/4028746327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60100f80 msgr2=0x7f8d601027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60100f80 0x7f8d601027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 -- 172.21.15.42:0/4028746327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d601a64f0 con 0x7f8d601005c0 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60100f80 0x7f8d601027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d64cba640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60102260 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e9c0 tx=0x7f8d5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d5dffb640 1 -- 172.21.15.42:0/4028746327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400cd80 con 0x7f8d601005c0 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d601a67e0 con 0x7f8d601005c0 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d5dffb640 1 -- 172.21.15.42:0/4028746327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d540035f0 con 0x7f8d601005c0 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.876+0000 7f8d5dffb640 1 -- 172.21.15.42:0/4028746327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54010670 con 0x7f8d601005c0 2024-03-31T23:19:38.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.877+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601a6d30 con 0x7f8d601005c0 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.879+0000 7f8d5dffb640 1 -- 172.21.15.42:0/4028746327 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f8d540037a0 con 0x7f8d601005c0 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.879+0000 7f8d5dffb640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8d500a2760 0x7f8d500a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.879+0000 7f8d69bda740 1 Processor -- start 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.879+0000 7f8d69bda740 1 -- start start 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8d500a2760 0x7f8d500a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d5dffb640 1 -- 172.21.15.42:0/4028746327 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8d540cf410 con 0x7f8d601005c0 2024-03-31T23:19:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dff9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9d90 0x557d7e002430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7e002970 0x557d7e004d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d69bda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d7df5d1b0 con 0x557d7e002970 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d69bda740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557d7df05c00 con 0x557d7dff9d90 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d69bda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557d7df59250 con 0x557d7dff9470 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dff9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dff9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53378/0 (socket says 172.21.15.42:53378) 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d5ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9d90 0x557d7e002430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d64cba640 1 -- 172.21.15.42:0/507000447 learned_addr learned my addr 172.21.15.42:0/507000447 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7e002970 0x557d7e004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8d500a2760 0x7f8d500a4c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d60103ca0 tx=0x7f8d4c011ce0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 -- 172.21.15.42:0/507000447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 msgr2=0x557d7dff9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dff9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 -- 172.21.15.42:0/507000447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9d90 msgr2=0x557d7e002430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9d90 0x557d7e002430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 -- 172.21.15.42:0/507000447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7df253d0 con 0x557d7e002970 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9d90 0x557d7e002430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.880+0000 7f8d654bb640 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7e002970 0x557d7e004d60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8d5802c430 tx=0x7f8d58009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f2ff9c310d1c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d4affd640 1 -- 172.21.15.42:0/507000447 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58043030 con 0x557d7e002970 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d4affd640 1 -- 172.21.15.42:0/507000447 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d58033c40 con 0x557d7e002970 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d4affd640 1 -- 172.21.15.42:0/507000447 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5802c890 con 0x557d7e002970 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 -- 172.21.15.42:0/507000447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7e002970 msgr2=0x557d7e004d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7e002970 0x557d7e004d60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8d5802c430 tx=0x7f8d58009310 comp rx=0 tx=0).stop 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 -- 172.21.15.42:0/507000447 shutdown_connections 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7e002970 0x557d7e004d60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9d90 0x557d7e002430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 --2- 172.21.15.42:0/507000447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dff9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 -- 172.21.15.42:0/507000447 >> 172.21.15.42:0/507000447 conn(0x557d7dff3ba0 msgr2=0x557d7dff3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 -- 172.21.15.42:0/507000447 shutdown_connections 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.881+0000 7f8d69bda740 1 -- 172.21.15.42:0/507000447 wait complete. 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 -- start start 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 Processor -- start 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dfff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7dffff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e000450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d7e005700 con 0x557d7dff9d90 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557d7defb470 con 0x557d7e002970 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557d7e005880 con 0x557d7dff9470 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d69bda740 10 client.0 _ll_register_callbacks cb 0x557d7df18cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7dffff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7dffff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36338/0 (socket says 172.21.15.42:36338) 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d5ffff640 1 -- 172.21.15.42:0/1827699135 learned_addr learned my addr 172.21.15.42:0/1827699135 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d654bb640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e000450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.882+0000 7f8d64cba640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dfff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d5ffff640 1 -- 172.21.15.42:0/1827699135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 msgr2=0x557d7dfff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dfff9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d5ffff640 1 -- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 msgr2=0x557d7e000450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e000450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d5ffff640 1 -- 172.21.15.42:0/1827699135 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7dc713f0 con 0x557d7dff9d90 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d654bb640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e000450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7dffff10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00ffd0 tx=0x7f8d4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a75bdb2261cf2f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1827699135 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c01a040 con 0x557d7dff9d90 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1827699135 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8d4c005020 con 0x557d7dff9d90 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d58033c40 con 0x557d7dff9d90 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1827699135 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8d4c030050 con 0x557d7dff9d90 2024-03-31T23:19:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d69bda740 10 client.16269 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d7dd3b7d0 con 0x557d7dff9d90 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.883+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1827699135 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d58033c40 con 0x557d7dff9d90 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1827699135 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8d4c01d030 con 0x557d7dff9d90 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d69bda740 10 client.16269 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d69bda740 10 client.16269 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d69bda740 20 client.16269 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e0129c0 0x557d7e014de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d69bda740 4 client.16269 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d7df6a6f0 con 0x557d7e0129c0 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d64cba640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e0129c0 0x557d7e014de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d64cba640 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e0129c0 0x557d7e014de0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aaa1045837c705a6 server_cookie=f12d4596e1b62c2c in_seq=0 out_seq=0 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.884+0000 7f8d3ffff640 10 client.16269 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1827699135 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557d7df6a6f0 con 0x557d7e0129c0 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d3ffff640 10 client.16269 handle_command_reply: tid=0 2024-03-31T23:19:38.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 client.16269 shutdown 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 msgr2=0x557d7dffff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7dffff10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00ffd0 tx=0x7f8d4c004730 comp rx=0 tx=0).stop 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 shutdown_connections 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e0129c0 0x557d7e014de0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e000450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7dffff10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d3ffff640 0 client.16269 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1827699135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9470 0x557d7dfff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 >> 172.21.15.42:0/1827699135 conn(0x557d7dff3ba0 msgr2=0x557d7dff58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 shutdown_connections 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 1 -- 172.21.15.42:0/1827699135 wait complete. 2024-03-31T23:19:38.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.885+0000 7f8d69bda740 20 client.16269 trim_cache size 0 max 16384 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 Processor -- start 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 -- start start 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 0x557d7e00e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7e001800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7e002970 0x557d7e01a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601b0e30 con 0x557d7dff9d90 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601b2970 con 0x557d7dff9470 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d69bda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601b1500 con 0x557d7e002970 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7e001800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 0x557d7e00e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 0x557d7e00e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:47976/0 (socket says 172.21.15.42:47976) 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d654bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7e002970 0x557d7e01a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d64cba640 1 -- 172.21.15.42:0/3243650722 learned_addr learned my addr 172.21.15.42:0/3243650722 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7e001800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36354/0 (socket says 172.21.15.42:36354) 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d654bb640 1 -- 172.21.15.42:0/3243650722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 msgr2=0x557d7e00e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d654bb640 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 0x557d7e00e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.912+0000 7f8d654bb640 1 -- 172.21.15.42:0/3243650722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 msgr2=0x557d7e001800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d654bb640 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7e001800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d654bb640 1 -- 172.21.15.42:0/3243650722 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7dff3900 con 0x557d7e002970 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d64cba640 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 0x557d7e00e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d654bb640 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7e002970 0x557d7e01a690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d58036040 tx=0x7f8d58003d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bac9d57746af87c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d4a7fc640 1 -- 172.21.15.42:0/3243650722 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58043040 con 0x557d7e002970 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d4a7fc640 1 -- 172.21.15.42:0/3243650722 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d5804c030 con 0x557d7e002970 2024-03-31T23:19:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.913+0000 7f8d4a7fc640 1 -- 172.21.15.42:0/3243650722 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5803f6c0 con 0x557d7e002970 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- 172.21.15.42:0/3243650722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7e002970 msgr2=0x557d7e01a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7e002970 0x557d7e01a690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d58036040 tx=0x7f8d58003d90 comp rx=0 tx=0).stop 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- 172.21.15.42:0/3243650722 shutdown_connections 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7e002970 0x557d7e01a690 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9d90 0x557d7e001800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- 172.21.15.42:0/3243650722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7dff9470 0x557d7e00e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- 172.21.15.42:0/3243650722 >> 172.21.15.42:0/3243650722 conn(0x557d7dff3ba0 msgr2=0x557d7e0010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- 172.21.15.42:0/3243650722 shutdown_connections 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- 172.21.15.42:0/3243650722 wait complete. 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- start start 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 Processor -- start 2024-03-31T23:19:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 0x557d7e00aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9d90 0x557d7e007aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e007fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601b22a0 con 0x557d7dff9470 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601b1bd0 con 0x557d7e002970 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601aedf0 con 0x557d7dff9d90 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.914+0000 7f8d69bda740 10 client.0 _ll_register_callbacks cb 0x7f8d4c00feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 0x557d7e00aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 0x557d7e00aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36366/0 (socket says 172.21.15.42:36366) 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d5ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9d90 0x557d7e007aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 -- 172.21.15.42:0/1707844349 learned_addr learned my addr 172.21.15.42:0/1707844349 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d654bb640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e007fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 -- 172.21.15.42:0/1707844349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9d90 msgr2=0x557d7e007aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9d90 0x557d7e007aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 -- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 msgr2=0x557d7e007fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e007fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 -- 172.21.15.42:0/1707844349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7e008520 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9d90 0x557d7e007aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d654bb640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e007fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d64cba640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 0x557d7e00aad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8d540bb010 tx=0x7f8d540ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2788f961053564e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1707844349 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5409b5d0 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1707844349 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8d540cf120 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d5804c030 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1707844349 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8d5409f720 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d69bda740 10 client.16275 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.915+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d7e079890 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1707844349 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d5804c030 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1707844349 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8d540a3b50 con 0x557d7dff9470 2024-03-31T23:19:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d69bda740 10 client.16275 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d69bda740 10 client.16275 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d69bda740 20 client.16275 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e079f10 0x557d7e07c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d69bda740 4 client.16275 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d7df64a40 con 0x557d7e079f10 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e079f10 0x557d7e07c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d3ffff640 10 client.16275 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.916+0000 7f8d5ffff640 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e079f10 0x557d7e07c330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10cc511d68c422 server_cookie=8340b0420ae70b41 in_seq=0 out_seq=0 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d3ffff640 1 -- 172.21.15.42:0/1707844349 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d7df64a40 con 0x557d7e079f10 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d3ffff640 10 client.16275 handle_command_reply: tid=0 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 client.16275 shutdown 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 msgr2=0x557d7e00aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 0x557d7e00aad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8d540bb010 tx=0x7f8d540ce040 comp rx=0 tx=0).stop 2024-03-31T23:19:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 shutdown_connections 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x557d7e079f10 0x557d7e07c330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d3ffff640 0 client.16275 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557d7e002970 0x557d7e007fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d7dff9d90 0x557d7e007aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 --2- 172.21.15.42:0/1707844349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d7dff9470 0x557d7e00aad0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 >> 172.21.15.42:0/1707844349 conn(0x557d7dff3ba0 msgr2=0x557d7dff2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 shutdown_connections 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 1 -- 172.21.15.42:0/1707844349 wait complete. 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.917+0000 7f8d69bda740 20 client.16275 trim_cache size 0 max 16384 2024-03-31T23:19:38.924 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8d500a2760 msgr2=0x7f8d500a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8d500a2760 0x7f8d500a4c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d60103ca0 tx=0x7f8d4c011ce0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 msgr2=0x7f8d60102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60102260 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e9c0 tx=0x7f8d5400ee80 comp rx=0 tx=0).stop 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 shutdown_connections 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d60106660 0x7f8d60102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d60100f80 0x7f8d601027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8d500a2760 0x7f8d500a4c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 --2- 172.21.15.42:0/4028746327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d601005c0 0x7f8d60102260 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 >> 172.21.15.42:0/4028746327 conn(0x7f8d60077750 msgr2=0x7f8d600ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 shutdown_connections 2024-03-31T23:19:38.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:38.918+0000 7f8d66f1e640 1 -- 172.21.15.42:0/4028746327 wait complete. 2024-03-31T23:19:38.926 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:38 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1152464820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:19:38.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-31T23:19:38.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:38 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1152464820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:19:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 -- 172.21.15.42:0/809564665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 msgr2=0x7f122810dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 --2- 172.21.15.42:0/809564665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122810dbd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f121c009900 tx=0x7f121c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 -- 172.21.15.42:0/809564665 shutdown_connections 2024-03-31T23:19:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 --2- 172.21.15.42:0/809564665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f122810e110 0x7f1228110500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 --2- 172.21.15.42:0/809564665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122810dbd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 --2- 172.21.15.42:0/809564665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1228100560 0x7f1228100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 -- 172.21.15.42:0/809564665 >> 172.21.15.42:0/809564665 conn(0x7f12280777b0 msgr2=0x7f1228077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 -- 172.21.15.42:0/809564665 shutdown_connections 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.033+0000 7f122e9d0640 1 -- 172.21.15.42:0/809564665 wait complete. 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 Processor -- start 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 -- start start 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1228100560 0x7f122819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f122810e110 0x7f122819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1228113df0 con 0x7f1228100e80 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1228113c70 con 0x7f1228100560 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f122e9d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1228113f70 con 0x7f122810e110 2024-03-31T23:19:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.034+0000 7f12277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36372/0 (socket says 172.21.15.42:36372) 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f1227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1228100560 0x7f122819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 -- 172.21.15.42:0/2150505605 learned_addr learned my addr 172.21.15.42:0/2150505605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f122cf6d640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f122810e110 0x7f122819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 -- 172.21.15.42:0/2150505605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f122810e110 msgr2=0x7f122819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f122810e110 0x7f122819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 -- 172.21.15.42:0/2150505605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1228100560 msgr2=0x7f122819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1228100560 0x7f122819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 -- 172.21.15.42:0/2150505605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122819f2e0 con 0x7f1228100e80 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f1227fff640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1228100560 0x7f122819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12277fe640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122819a830 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f121c005940 tx=0x7f121c02dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12257fa640 1 -- 172.21.15.42:0/2150505605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c043020 con 0x7f1228100e80 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122819f570 con 0x7f1228100e80 2024-03-31T23:19:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12257fa640 1 -- 172.21.15.42:0/2150505605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f121c004250 con 0x7f1228100e80 2024-03-31T23:19:39.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f12257fa640 1 -- 172.21.15.42:0/2150505605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c003a10 con 0x7f1228100e80 2024-03-31T23:19:39.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.035+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12281a6e60 con 0x7f1228100e80 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.037+0000 7f12257fa640 1 -- 172.21.15.42:0/2150505605 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f121c046020 con 0x7f1228100e80 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 Processor -- start 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 -- start start 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12257fa640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12100a2730 0x7f12100a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd36850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd3f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd41d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b05fc9a1b0 con 0x55b05fd3f970 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b05fc42c00 con 0x55b05fd36470 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12315b1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b05fc96250 con 0x55b05fd36d90 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12257fa640 1 -- 172.21.15.42:0/2150505605 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f121c0f1060 con 0x7f1228100e80 2024-03-31T23:19:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f122cf6d640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12100a2730 0x7f12100a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f1227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd36850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f12277fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd3f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f1227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd36850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:48024/0 (socket says 172.21.15.42:48024) 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f1227fff640 1 -- 172.21.15.42:0/822141540 learned_addr learned my addr 172.21.15.42:0/822141540 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.038+0000 7f122cf6d640 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd41d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f1227fff640 1 -- 172.21.15.42:0/822141540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 msgr2=0x55b05fd3f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f1227fff640 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd3f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f1227fff640 1 -- 172.21.15.42:0/822141540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 msgr2=0x55b05fd41d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f1227fff640 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd41d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f1227fff640 1 -- 172.21.15.42:0/822141540 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b05fc623d0 con 0x55b05fd36470 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f122cf6d640 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd41d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f12277fe640 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd3f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f122cf6d640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12100a2730 0x7f12100a4bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55b05fd31d30 tx=0x7f1220009960 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f1227fff640 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd36850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f12180115f0 tx=0x7f1218011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f3f8fd64efc2246 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f120e7fc640 1 -- 172.21.15.42:0/822141540 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121801e070 con 0x55b05fd36470 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f120e7fc640 1 -- 172.21.15.42:0/822141540 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f121800fb40 con 0x55b05fd36470 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.039+0000 7f120e7fc640 1 -- 172.21.15.42:0/822141540 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218019cd0 con 0x55b05fd36470 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- 172.21.15.42:0/822141540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 msgr2=0x55b05fd36850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd36850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f12180115f0 tx=0x7f1218011ab0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- 172.21.15.42:0/822141540 shutdown_connections 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd41d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd3f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- 172.21.15.42:0/822141540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd36850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- 172.21.15.42:0/822141540 >> 172.21.15.42:0/822141540 conn(0x55b05fd30ba0 msgr2=0x55b05fd30f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- 172.21.15.42:0/822141540 shutdown_connections 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- 172.21.15.42:0/822141540 wait complete. 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- start start 2024-03-31T23:19:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 Processor -- start 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd3c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 0x55b05fd3cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd3f970 0x55b05fd3d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.040+0000 7f12315b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b05fd42760 con 0x55b05fd36d90 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12315b1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b05fc38470 con 0x55b05fd36470 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12315b1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b05fd428e0 con 0x55b05fd3f970 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12315b1740 10 client.0 _ll_register_callbacks cb 0x55b05fc55cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 0x55b05fd3cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 0x55b05fd3cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36394/0 (socket says 172.21.15.42:36394) 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f1227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd3c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 -- 172.21.15.42:0/3624928486 learned_addr learned my addr 172.21.15.42:0/3624928486 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f122cf6d640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd3f970 0x55b05fd3d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 -- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd3f970 msgr2=0x55b05fd3d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd3f970 0x55b05fd3d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 -- 172.21.15.42:0/3624928486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 msgr2=0x55b05fd3c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd3c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 -- 172.21.15.42:0/3624928486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b05f9ae3f0 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f1227fff640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd3c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12277fe640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 0x55b05fd3cec0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f121c0bcff0 tx=0x7f121c0bccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f041062cb8f856f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12077fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12077fe640 1 -- 172.21.15.42:0/3624928486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c0b7e60 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12077fe640 1 -- 172.21.15.42:0/3624928486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f121c004400 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f121800fb40 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.041+0000 7f12077fe640 1 -- 172.21.15.42:0/3624928486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f121c0c1440 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 10 client.16287 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b05fa787d0 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12077fe640 1 -- 172.21.15.42:0/3624928486 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f121800fb40 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12077fe640 1 -- 172.21.15.42:0/3624928486 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f121c003bb0 con 0x55b05fd36d90 2024-03-31T23:19:39.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 10 client.16287 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 10 client.16287 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 20 client.16287 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fd4f890 0x55b05fd51d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 4 client.16287 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b05fca76f0 con 0x55b05fd4f890 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.042+0000 7f1227fff640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fd4f890 0x55b05fd51d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12077fe640 10 client.16287 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f1227fff640 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fd4f890 0x55b05fd51d00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=269ec0996672e3c9 server_cookie=a1286f6946b5a1d9 in_seq=0 out_seq=0 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12077fe640 1 -- 172.21.15.42:0/3624928486 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b05fca76f0 con 0x55b05fd4f890 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12077fe640 10 client.16287 handle_command_reply: tid=0 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 client.16287 shutdown 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 msgr2=0x55b05fd3cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 0x55b05fd3cec0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f121c0bcff0 tx=0x7f121c0bccd0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 shutdown_connections 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fd4f890 0x55b05fd51d00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd3f970 0x55b05fd3d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd36d90 0x55b05fd3cec0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12077fe640 0 client.16287 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 --2- 172.21.15.42:0/3624928486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd3c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.043+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 >> 172.21.15.42:0/3624928486 conn(0x55b05fd30ba0 msgr2=0x55b05fd328f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.044+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 shutdown_connections 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.044+0000 7f12315b1740 1 -- 172.21.15.42:0/3624928486 wait complete. 2024-03-31T23:19:39.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.044+0000 7f12315b1740 20 client.16287 trim_cache size 0 max 16384 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 Processor -- start 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 -- start start 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd4b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd57610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd47b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12281b0e30 con 0x55b05fd3f970 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12281b2970 con 0x55b05fd36470 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12315b1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12281b1500 con 0x55b05fd36d90 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f122cf6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd47b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f12277fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd57610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f1227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd4b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f122cf6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd47b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36396/0 (socket says 172.21.15.42:36396) 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.058+0000 7f122cf6d640 1 -- 172.21.15.42:0/711177927 learned_addr learned my addr 172.21.15.42:0/711177927 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f12277fe640 1 -- 172.21.15.42:0/711177927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 msgr2=0x55b05fd4b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f12277fe640 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd4b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f12277fe640 1 -- 172.21.15.42:0/711177927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 msgr2=0x55b05fd47b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f12277fe640 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd47b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f12277fe640 1 -- 172.21.15.42:0/711177927 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b05fd36bc0 con 0x55b05fd36d90 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f1227fff640 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd4b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f122cf6d640 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd47b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f12277fe640 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd57610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f121c0b9750 tx=0x7f121c005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38f7ed83565e766 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f120dffb640 1 -- 172.21.15.42:0/711177927 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c0b7e60 con 0x55b05fd36d90 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f120dffb640 1 -- 172.21.15.42:0/711177927 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f121c0ee2d0 con 0x55b05fd36d90 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.059+0000 7f120dffb640 1 -- 172.21.15.42:0/711177927 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c0dd180 con 0x55b05fd36d90 2024-03-31T23:19:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 -- 172.21.15.42:0/711177927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 msgr2=0x55b05fd57610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd57610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f121c0b9750 tx=0x7f121c005750 comp rx=0 tx=0).stop 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 -- 172.21.15.42:0/711177927 shutdown_connections 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd47b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36d90 0x55b05fd57610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 --2- 172.21.15.42:0/711177927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36470 0x55b05fd4b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 -- 172.21.15.42:0/711177927 >> 172.21.15.42:0/711177927 conn(0x55b05fd30ba0 msgr2=0x55b05fd3c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 -- 172.21.15.42:0/711177927 shutdown_connections 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 -- 172.21.15.42:0/711177927 wait complete. 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 -- start start 2024-03-31T23:19:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.060+0000 7f12315b1740 1 Processor -- start 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36470 0x55b05fd47d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36d90 0x55b05fd44b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd45040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12281b22a0 con 0x55b05fd3f970 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12281b1bd0 con 0x55b05fd36d90 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12281aedf0 con 0x55b05fd36470 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 10 client.0 _ll_register_callbacks cb 0x7f121c0bce30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f122cf6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd45040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36470 0x55b05fd47d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12277fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36d90 0x55b05fd44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f122cf6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd45040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36406/0 (socket says 172.21.15.42:36406) 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f122cf6d640 1 -- 172.21.15.42:0/2437821052 learned_addr learned my addr 172.21.15.42:0/2437821052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12277fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36d90 0x55b05fd44b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:48036/0 (socket says 172.21.15.42:48036) 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 -- 172.21.15.42:0/2437821052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36d90 msgr2=0x55b05fd44b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36d90 0x55b05fd44b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 -- 172.21.15.42:0/2437821052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 msgr2=0x55b05fd45040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd45040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 -- 172.21.15.42:0/2437821052 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b05fd45870 con 0x55b05fd36470 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f122cf6d640 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd45040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f1227fff640 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36470 0x55b05fd47d20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12180199b0 tx=0x7f12180198b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4cc4ef50f799c96 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12077fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12077fe640 1 -- 172.21.15.42:0/2437821052 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121802a070 con 0x55b05fd36470 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12077fe640 1 -- 172.21.15.42:0/2437821052 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f121800f6c0 con 0x55b05fd36470 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.061+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f121c0ee2d0 con 0x55b05fd36470 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12077fe640 1 -- 172.21.15.42:0/2437821052 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f121801e040 con 0x55b05fd36470 2024-03-31T23:19:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 10 client.26065 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b05fdb6b40 con 0x55b05fd36470 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12077fe640 1 -- 172.21.15.42:0/2437821052 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f121c0ee2d0 con 0x55b05fd36470 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12077fe640 1 -- 172.21.15.42:0/2437821052 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f12180262b0 con 0x55b05fd36470 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 10 client.26065 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 10 client.26065 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 20 client.26065 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fdb7070 0x55b05fdb9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 4 client.26065 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b05fca1a40 con 0x55b05fdb7070 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.062+0000 7f12277fe640 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fdb7070 0x55b05fdb9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12077fe640 10 client.26065 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12277fe640 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fdb7070 0x55b05fdb9460 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e71a99e2ea7363cf server_cookie=c6d44460185c4030 in_seq=0 out_seq=0 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12077fe640 1 -- 172.21.15.42:0/2437821052 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b05fca1a40 con 0x55b05fdb7070 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12077fe640 10 client.26065 handle_command_reply: tid=0 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 client.26065 shutdown 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36470 msgr2=0x55b05fd47d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36470 0x55b05fd47d20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12180199b0 tx=0x7f12180198b0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 shutdown_connections 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b05fd3f970 0x55b05fd45040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b05fd36d90 0x55b05fd44b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55b05fdb7070 0x55b05fdb9460 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 --2- 172.21.15.42:0/2437821052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b05fd36470 0x55b05fd47d20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 >> 172.21.15.42:0/2437821052 conn(0x55b05fd30ba0 msgr2=0x55b05fd3d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12077fe640 0 client.26065 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 shutdown_connections 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 1 -- 172.21.15.42:0/2437821052 wait complete. 2024-03-31T23:19:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.063+0000 7f12315b1740 20 client.26065 trim_cache size 0 max 16384 2024-03-31T23:19:39.072 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12100a2730 msgr2=0x7f12100a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12100a2730 0x7f12100a4bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55b05fd31d30 tx=0x7f1220009960 comp rx=0 tx=0).stop 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 msgr2=0x7f122819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122819a830 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f121c005940 tx=0x7f121c02dc90 comp rx=0 tx=0).stop 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 shutdown_connections 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f122810e110 0x7f122819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12100a2730 0x7f12100a4bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1228100e80 0x7f122819a830 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 --2- 172.21.15.42:0/2150505605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1228100560 0x7f122819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 >> 172.21.15.42:0/2150505605 conn(0x7f12280777b0 msgr2=0x7f122810f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 shutdown_connections 2024-03-31T23:19:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.064+0000 7f122e9d0640 1 -- 172.21.15.42:0/2150505605 wait complete. 2024-03-31T23:19:39.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 -- 172.21.15.42:0/2197070301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360100f80 msgr2=0x7ff36010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 --2- 172.21.15.42:0/2197070301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360100f80 0x7ff36010d490 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff350009890 tx=0x7ff35002bb70 comp rx=0 tx=0).stop 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 -- 172.21.15.42:0/2197070301 shutdown_connections 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 --2- 172.21.15.42:0/2197070301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360100f80 0x7ff36010d490 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 --2- 172.21.15.42:0/2197070301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 --2- 172.21.15.42:0/2197070301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360106660 0x7ff360106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 -- 172.21.15.42:0/2197070301 >> 172.21.15.42:0/2197070301 conn(0x7ff360077750 msgr2=0x7ff360077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 -- 172.21.15.42:0/2197070301 shutdown_connections 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 -- 172.21.15.42:0/2197070301 wait complete. 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 Processor -- start 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.181+0000 7ff367c2e640 1 -- start start 2024-03-31T23:19:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 0x7ff3601985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 0x7ff36019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff360110b00 con 0x7ff360106660 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff360110980 con 0x7ff360100f80 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff360110c80 con 0x7ff3601005c0 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3661cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 0x7ff36019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3659ca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 0x7ff3601985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3659ca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53480/0 (socket says 172.21.15.42:53480) 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 0x7ff3601985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:48056/0 (socket says 172.21.15.42:48056) 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3659ca640 1 -- 172.21.15.42:0/297666368 learned_addr learned my addr 172.21.15.42:0/297666368 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3661cb640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 0x7ff36019c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36424/0 (socket says 172.21.15.42:36424) 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 -- 172.21.15.42:0/297666368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 msgr2=0x7ff360198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 -- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 msgr2=0x7ff36019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 0x7ff36019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 -- 172.21.15.42:0/297666368 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36019d020 con 0x7ff360100f80 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3661cb640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 0x7ff36019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3659ca640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff3651c9640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 0x7ff3601985c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff354009fd0 tx=0x7ff35400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff35effd640 1 -- 172.21.15.42:0/297666368 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35400ccc0 con 0x7ff360100f80 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36019d310 con 0x7ff360100f80 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff35effd640 1 -- 172.21.15.42:0/297666368 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff35400ee70 con 0x7ff360100f80 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.182+0000 7ff35effd640 1 -- 172.21.15.42:0/297666368 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354004a00 con 0x7ff360100f80 2024-03-31T23:19:39.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.183+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3601a4ba0 con 0x7ff360100f80 2024-03-31T23:19:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff35effd640 1 -- 172.21.15.42:0/297666368 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7ff354004be0 con 0x7ff360100f80 2024-03-31T23:19:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 Processor -- start 2024-03-31T23:19:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 -- start start 2024-03-31T23:19:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 0x55e907be7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907bf4d80 0x55e907bf7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e907b4b1b0 con 0x55e907bf4d80 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e907af3c00 con 0x55e907be7a40 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff36a815740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e907b47250 con 0x55e907be7120 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.185+0000 7ff35effd640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff3480a2730 0x7ff3480a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 0x55e907be7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3659ca640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907bf4d80 0x55e907bf7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 0x55e907be7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53496/0 (socket says 172.21.15.42:53496) 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 -- 172.21.15.42:0/2869592781 learned_addr learned my addr 172.21.15.42:0/2869592781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff3480a2730 0x7ff3480a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff35effd640 1 -- 172.21.15.42:0/297666368 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff3540ceff0 con 0x7ff360100f80 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 -- 172.21.15.42:0/2869592781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 msgr2=0x55e907bf4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 -- 172.21.15.42:0/2869592781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907bf4d80 msgr2=0x55e907bf7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907bf4d80 0x55e907bf7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 -- 172.21.15.42:0/2869592781 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e907b133d0 con 0x55e907be7120 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff3480a2730 0x7ff3480a4bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff35002c0b0 tx=0x7ff350048000 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff3661cb640 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 0x55e907be7500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff350035fd0 tx=0x7ff3500045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=308f761872e761b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff347fff640 1 -- 172.21.15.42:0/2869592781 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350039040 con 0x55e907be7120 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.186+0000 7ff347fff640 1 -- 172.21.15.42:0/2869592781 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff350051070 con 0x55e907be7120 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff347fff640 1 -- 172.21.15.42:0/2869592781 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350032e70 con 0x55e907be7120 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 -- 172.21.15.42:0/2869592781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 msgr2=0x55e907be7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 0x55e907be7500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff350035fd0 tx=0x7ff3500045c0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 -- 172.21.15.42:0/2869592781 shutdown_connections 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907bf4d80 0x55e907bf7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 --2- 172.21.15.42:0/2869592781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907be7120 0x55e907be7500 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 -- 172.21.15.42:0/2869592781 >> 172.21.15.42:0/2869592781 conn(0x55e907be1ba0 msgr2=0x55e907be1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 -- 172.21.15.42:0/2869592781 shutdown_connections 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.187+0000 7ff36a815740 1 -- 172.21.15.42:0/2869592781 wait complete. 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 -- start start 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 Processor -- start 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7120 0x55e907bf1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bf2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e907bf7b60 con 0x55e907be7120 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e907ae9470 con 0x55e907be7a40 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e907bf7ce0 con 0x55e907bf4d80 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff36a815740 10 client.0 _ll_register_callbacks cb 0x55e907b06cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff3659ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7120 0x55e907bf1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff3661cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bf2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:48070/0 (socket says 172.21.15.42:48070) 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.188+0000 7ff3651c9640 1 -- 172.21.15.42:0/1217213420 learned_addr learned my addr 172.21.15.42:0/1217213420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3651c9640 1 -- 172.21.15.42:0/1217213420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 msgr2=0x55e907bf2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3651c9640 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bf2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3651c9640 1 -- 172.21.15.42:0/1217213420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7120 msgr2=0x55e907bf1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3651c9640 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7120 0x55e907bf1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3651c9640 1 -- 172.21.15.42:0/1217213420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90785f3f0 con 0x55e907be7a40 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3659ca640 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7120 0x55e907bf1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3651c9640 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf22c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c6a0 tx=0x7ff35406a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d04e5b7c4f9a9bc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3457fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3457fa640 1 -- 172.21.15.42:0/1217213420 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35401c050 con 0x55e907be7a40 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff350051070 con 0x55e907be7a40 2024-03-31T23:19:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3457fa640 1 -- 172.21.15.42:0/1217213420 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff3540662b0 con 0x55e907be7a40 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3457fa640 1 -- 172.21.15.42:0/1217213420 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff35409ab10 con 0x55e907be7a40 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff36a815740 10 client.26129 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e9079297d0 con 0x55e907be7a40 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3457fa640 1 -- 172.21.15.42:0/1217213420 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff350051070 con 0x55e907be7a40 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.189+0000 7ff3457fa640 1 -- 172.21.15.42:0/1217213420 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff3540b6ce0 con 0x55e907be7a40 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff36a815740 10 client.26129 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff36a815740 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff36a815740 20 client.26129 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff36a815740 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c04c20 0x55e907c07010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff36a815740 4 client.26129 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e907b586f0 con 0x55e907c04c20 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff3659ca640 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c04c20 0x55e907c07010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff3457fa640 10 client.26129 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.190+0000 7ff3659ca640 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c04c20 0x55e907c07010 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06dfcbce822d9dc server_cookie=31c3a70d010aa71a in_seq=0 out_seq=0 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff3457fa640 1 -- 172.21.15.42:0/1217213420 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e907b586f0 con 0x55e907c04c20 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff3457fa640 10 client.26129 handle_command_reply: tid=0 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 client.26129 shutdown 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 msgr2=0x55e907bf22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf22c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c6a0 tx=0x7ff35406a0e0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 shutdown_connections 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c04c20 0x55e907c07010 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bf2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7a40 0x55e907bf22c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff3457fa640 0 client.26129 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 --2- 172.21.15.42:0/1217213420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7120 0x55e907bf1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 >> 172.21.15.42:0/1217213420 conn(0x55e907be1ba0 msgr2=0x55e907be38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 shutdown_connections 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 1 -- 172.21.15.42:0/1217213420 wait complete. 2024-03-31T23:19:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.191+0000 7ff36a815740 20 client.26129 trim_cache size 0 max 16384 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 Processor -- start 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 -- start start 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907c00970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bdcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601ac9c0 con 0x55e907be7a40 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601ae500 con 0x55e907be7120 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff36a815740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601ad090 con 0x55e907bf4d80 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff3661cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bdcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907c00970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907c00970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36456/0 (socket says 172.21.15.42:36456) 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff3661cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bdcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:53506/0 (socket says 172.21.15.42:53506) 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff3651c9640 1 -- 172.21.15.42:0/104977531 learned_addr learned my addr 172.21.15.42:0/104977531 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.205+0000 7ff3659ca640 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3661cb640 1 -- 172.21.15.42:0/104977531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 msgr2=0x55e907bf44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3661cb640 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3661cb640 1 -- 172.21.15.42:0/104977531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 msgr2=0x55e907c00970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3661cb640 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907c00970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3661cb640 1 -- 172.21.15.42:0/104977531 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e907bf0d30 con 0x55e907bf4d80 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3651c9640 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907c00970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3659ca640 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3661cb640 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bdcbd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff35002c180 tx=0x7ff35002bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=586bbccb30c2169f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3477fe640 1 -- 172.21.15.42:0/104977531 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35005b070 con 0x55e907bf4d80 2024-03-31T23:19:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3477fe640 1 -- 172.21.15.42:0/104977531 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff350051040 con 0x55e907bf4d80 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.206+0000 7ff3477fe640 1 -- 172.21.15.42:0/104977531 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350039040 con 0x55e907bf4d80 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 -- 172.21.15.42:0/104977531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 msgr2=0x55e907bdcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bdcbd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff35002c180 tx=0x7ff35002bb70 comp rx=0 tx=0).stop 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 -- 172.21.15.42:0/104977531 shutdown_connections 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907bdcbd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907c00970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 --2- 172.21.15.42:0/104977531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 -- 172.21.15.42:0/104977531 >> 172.21.15.42:0/104977531 conn(0x55e907be1ba0 msgr2=0x55e907be0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 -- 172.21.15.42:0/104977531 shutdown_connections 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 -- 172.21.15.42:0/104977531 wait complete. 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 -- start start 2024-03-31T23:19:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.207+0000 7ff36a815740 1 Processor -- start 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907bf95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907c69ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601ade30 con 0x55e907be7a40 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601ad760 con 0x55e907be7120 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601aa980 con 0x55e907bf4d80 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 10 client.0 _ll_register_callbacks cb 0x55e907b06cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907bf95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3659ca640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907bf95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36468/0 (socket says 172.21.15.42:36468) 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 -- 172.21.15.42:0/2961141092 learned_addr learned my addr 172.21.15.42:0/2961141092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3661cb640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907c69ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 -- 172.21.15.42:0/2961141092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 msgr2=0x55e907c69ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907c69ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 -- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 msgr2=0x55e907bf9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 -- 172.21.15.42:0/2961141092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e907be7870 con 0x55e907be7a40 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3659ca640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3651c9640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907bf95d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff354004770 tx=0x7ff3540a3af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c1aaa8724fe10c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3457fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3457fa640 1 -- 172.21.15.42:0/2961141092 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35401c040 con 0x55e907be7a40 2024-03-31T23:19:39.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff3457fa640 1 -- 172.21.15.42:0/2961141092 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff3540ccb20 con 0x55e907be7a40 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.208+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff350051040 con 0x55e907be7a40 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff3457fa640 1 -- 172.21.15.42:0/2961141092 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3540cc190 con 0x55e907be7a40 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 10 client.16311 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e907c6b630 con 0x55e907be7a40 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff3457fa640 1 -- 172.21.15.42:0/2961141092 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff350051040 con 0x55e907be7a40 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff3457fa640 1 -- 172.21.15.42:0/2961141092 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff35409a070 con 0x55e907be7a40 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 10 client.16311 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 20 client.16311 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c6bd60 0x55e907c6e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 4 client.16311 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e907b52a40 con 0x55e907c6bd60 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.209+0000 7ff3659ca640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c6bd60 0x55e907c6e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:39.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff3457fa640 10 client.16311 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff3659ca640 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c6bd60 0x55e907c6e180 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd94aacae06315ed server_cookie=19f84ab6100116e6 in_seq=0 out_seq=0 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff3457fa640 1 -- 172.21.15.42:0/2961141092 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e907b52a40 con 0x55e907c6bd60 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff3457fa640 10 client.16311 handle_command_reply: tid=0 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 client.16311 shutdown 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 msgr2=0x55e907bf95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907bf95d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff354004770 tx=0x7ff3540a3af0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 shutdown_connections 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55e907c6bd60 0x55e907c6e180 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e907bf4d80 0x55e907c69ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff3457fa640 0 client.16311 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e907be7a40 0x55e907bf95d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 --2- 172.21.15.42:0/2961141092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e907be7120 0x55e907bf9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 >> 172.21.15.42:0/2961141092 conn(0x55e907be1ba0 msgr2=0x55e907bf1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 shutdown_connections 2024-03-31T23:19:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 1 -- 172.21.15.42:0/2961141092 wait complete. 2024-03-31T23:19:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.210+0000 7ff36a815740 20 client.16311 trim_cache size 0 max 16384 2024-03-31T23:19:39.218 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff3480a2730 msgr2=0x7ff3480a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff3480a2730 0x7ff3480a4bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff35002c0b0 tx=0x7ff350048000 comp rx=0 tx=0).stop 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 msgr2=0x7ff3601985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 0x7ff3601985c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff354009fd0 tx=0x7ff35400ec20 comp rx=0 tx=0).stop 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 shutdown_connections 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff3480a2730 0x7ff3480a4bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff360106660 0x7ff36019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff360100f80 0x7ff3601985c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 --2- 172.21.15.42:0/297666368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3601005c0 0x7ff360198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 >> 172.21.15.42:0/297666368 conn(0x7ff360077750 msgr2=0x7ff3600ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 shutdown_connections 2024-03-31T23:19:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:39.211+0000 7ff367c2e640 1 -- 172.21.15.42:0/297666368 wait complete. 2024-03-31T23:19:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:39 smithi094 ceph-mon[36167]: pgmap v47: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-31T23:19:39.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:39 smithi188 ceph-mon[36068]: pgmap v47: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-31T23:19:40.027 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar cf doc.tar linux-4.0.5 2024-03-31T23:19:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:39 smithi042 ceph-mon[32380]: pgmap v47: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-31T23:19:40.223 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-31T23:19:40.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:19:40.224 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-31T23:19:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 -- 172.21.15.42:0/656846255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401020a0 msgr2=0x7f124010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 --2- 172.21.15.42:0/656846255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401020a0 0x7f124010e5b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1238009cd0 tx=0x7f123802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 -- 172.21.15.42:0/656846255 shutdown_connections 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 --2- 172.21.15.42:0/656846255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401020a0 0x7f124010e5b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 --2- 172.21.15.42:0/656846255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12401016e0 0x7f1240101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 --2- 172.21.15.42:0/656846255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12401076f0 0x7f1240107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.332+0000 7f1246a5c640 1 -- 172.21.15.42:0/656846255 >> 172.21.15.42:0/656846255 conn(0x7f1240078b50 msgr2=0x7f1240078f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 -- 172.21.15.42:0/656846255 shutdown_connections 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 -- 172.21.15.42:0/656846255 wait complete. 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 Processor -- start 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 -- start start 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 0x7f1240198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12401020a0 0x7f1240198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12401076f0 0x7f124019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1240111c20 con 0x7f12401016e0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1240111aa0 con 0x7f12401020a0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.333+0000 7f1246a5c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1240111da0 con 0x7f12401076f0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 0x7f1240198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 0x7f1240198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36478/0 (socket says 172.21.15.42:36478) 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 -- 172.21.15.42:0/2976993520 learned_addr learned my addr 172.21.15.42:0/2976993520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123f7fe640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12401020a0 0x7f1240198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f1244ff9640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12401076f0 0x7f124019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 -- 172.21.15.42:0/2976993520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12401076f0 msgr2=0x7f124019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12401076f0 0x7f124019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 -- 172.21.15.42:0/2976993520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12401020a0 msgr2=0x7f1240198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12401020a0 0x7f1240198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 -- 172.21.15.42:0/2976993520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124019d010 con 0x7f12401016e0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123ffff640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 0x7f1240198020 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f123400e9f0 tx=0x7f123400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123d7fa640 1 -- 172.21.15.42:0/2976993520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123400cd80 con 0x7f12401016e0 2024-03-31T23:19:40.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123d7fa640 1 -- 172.21.15.42:0/2976993520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1234010930 con 0x7f12401016e0 2024-03-31T23:19:40.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124019d300 con 0x7f12401016e0 2024-03-31T23:19:40.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f123d7fa640 1 -- 172.21.15.42:0/2976993520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234018b00 con 0x7f12401016e0 2024-03-31T23:19:40.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.334+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12401a4b90 con 0x7f12401016e0 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f123d7fa640 1 -- 172.21.15.42:0/2976993520 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f1234018ca0 con 0x7f12401016e0 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 Processor -- start 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 -- start start 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc8efe10b0 con 0x55cc8f0e1310 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55cc8f043ea0 con 0x55cc8f0e09f0 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f124963e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cc8efecc00 con 0x55cc8f0e9ef0 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f123ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f123ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36484/0 (socket says 172.21.15.42:36484) 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f1244ff9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f123ffff640 1 -- 172.21.15.42:0/414804430 learned_addr learned my addr 172.21.15.42:0/414804430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f123d7fa640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12280a2730 0x7f12280a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f123f7fe640 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.337+0000 7f1244ff9640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12280a2730 0x7f12280a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123d7fa640 1 -- 172.21.15.42:0/2976993520 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f12340cf480 con 0x7f12401016e0 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123ffff640 1 -- 172.21.15.42:0/414804430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 msgr2=0x55cc8f0ec2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123ffff640 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0ec2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123ffff640 1 -- 172.21.15.42:0/414804430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 msgr2=0x55cc8f0e0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123ffff640 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123ffff640 1 -- 172.21.15.42:0/414804430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc8ee207e0 con 0x55cc8f0e1310 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123f7fe640 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0ec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f1244ff9640 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f123ffff640 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e99b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f12340cc730 tx=0x7f1234018520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa1cee89fa984ec server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f12267fc640 1 -- 172.21.15.42:0/414804430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123409f750 con 0x55cc8f0e1310 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f1244ff9640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12280a2730 0x7f12280a4bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1238005cc0 tx=0x7f123802c0f0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f12267fc640 1 -- 172.21.15.42:0/414804430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12340a4010 con 0x55cc8f0e1310 2024-03-31T23:19:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.338+0000 7f12267fc640 1 -- 172.21.15.42:0/414804430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340cc980 con 0x55cc8f0e1310 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- 172.21.15.42:0/414804430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 msgr2=0x55cc8f0e99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e99b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f12340cc730 tx=0x7f1234018520 comp rx=0 tx=0).stop 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- 172.21.15.42:0/414804430 shutdown_connections 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0ec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e99b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- 172.21.15.42:0/414804430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- 172.21.15.42:0/414804430 >> 172.21.15.42:0/414804430 conn(0x55cc8f0db120 msgr2=0x55cc8f0db500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- 172.21.15.42:0/414804430 shutdown_connections 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- 172.21.15.42:0/414804430 wait complete. 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- start start 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 Processor -- start 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc8efe23d0 con 0x55cc8f0e09f0 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55cc8f03ff40 con 0x55cc8f0e1310 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cc8f0ecc20 con 0x55cc8f0e9ef0 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.339+0000 7f124963e740 10 client.0 _ll_register_callbacks cb 0x55cc8efffb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36496/0 (socket says 172.21.15.42:36496) 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 -- 172.21.15.42:0/1002588104 learned_addr learned my addr 172.21.15.42:0/1002588104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123f7fe640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f1244ff9640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 -- 172.21.15.42:0/1002588104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 msgr2=0x55cc8f0e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 -- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e1310 msgr2=0x55cc8f0e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 -- 172.21.15.42:0/1002588104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8ee80f70 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f123ffff640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e6fb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1234098080 tx=0x7f1234010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7586964057cc30f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f121f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f121f7fe640 1 -- 172.21.15.42:0/1002588104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340cf1b0 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f121f7fe640 1 -- 172.21.15.42:0/1002588104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f12340ccb90 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12340a4010 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f121f7fe640 1 -- 172.21.15.42:0/1002588104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f123409ab00 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f124963e740 10 client.16323 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc8ed18170 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.340+0000 7f121f7fe640 1 -- 172.21.15.42:0/1002588104 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12340a4010 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f121f7fe640 1 -- 172.21.15.42:0/1002588104 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f12340d2ce0 con 0x55cc8f0e09f0 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f124963e740 10 client.16323 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f124963e740 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f124963e740 20 client.16323 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f124963e740 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f0f9c50 0x55cc8f0fc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f124963e740 4 client.16323 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc8f0513e0 con 0x55cc8f0f9c50 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f123f7fe640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f0f9c50 0x55cc8f0fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f121f7fe640 10 client.16323 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.341+0000 7f123f7fe640 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f0f9c50 0x55cc8f0fc040 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3acf000f6cdeb29a server_cookie=41beeec5b5615fa0 in_seq=0 out_seq=0 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f121f7fe640 1 -- 172.21.15.42:0/1002588104 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55cc8f0513e0 con 0x55cc8f0f9c50 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f121f7fe640 10 client.16323 handle_command_reply: tid=0 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 client.16323 shutdown 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 msgr2=0x55cc8f0e6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e6fb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1234098080 tx=0x7f1234010e00 comp rx=0 tx=0).stop 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 shutdown_connections 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f0f9c50 0x55cc8f0fc040 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e1310 0x55cc8f0e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 --2- 172.21.15.42:0/1002588104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e6fb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f121f7fe640 0 client.16323 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 >> 172.21.15.42:0/1002588104 conn(0x55cc8f0db120 msgr2=0x55cc8f0dce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 shutdown_connections 2024-03-31T23:19:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 1 -- 172.21.15.42:0/1002588104 wait complete. 2024-03-31T23:19:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.342+0000 7f124963e740 20 client.16323 trim_cache size 0 max 16384 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 Processor -- start 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 -- start start 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0ff060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12401aca60 con 0x55cc8f0e1310 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12401ae5a0 con 0x55cc8f0e09f0 2024-03-31T23:19:40.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f124963e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12401ad130 con 0x55cc8f0e9ef0 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0ff060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36504/0 (socket says 172.21.15.42:36504) 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 -- 172.21.15.42:0/86262150 learned_addr learned my addr 172.21.15.42:0/86262150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f1244ff9640 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 -- 172.21.15.42:0/86262150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 msgr2=0x55cc8f0e4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 -- 172.21.15.42:0/86262150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 msgr2=0x55cc8f0e96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.361+0000 7f123f7fe640 1 -- 172.21.15.42:0/86262150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc8f0e5500 con 0x55cc8f0e1310 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f123f7fe640 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0ff060 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55cc8f0e6810 tx=0x7f1230005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9309881b6169ccd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f1225ffb640 1 -- 172.21.15.42:0/86262150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123002a070 con 0x55cc8f0e1310 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f1225ffb640 1 -- 172.21.15.42:0/86262150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f123000fd90 con 0x55cc8f0e1310 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f1225ffb640 1 -- 172.21.15.42:0/86262150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12300035f0 con 0x55cc8f0e1310 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 -- 172.21.15.42:0/86262150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 msgr2=0x55cc8f0ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0ff060 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55cc8f0e6810 tx=0x7f1230005f90 comp rx=0 tx=0).stop 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 -- 172.21.15.42:0/86262150 shutdown_connections 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0e4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0ff060 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 --2- 172.21.15.42:0/86262150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0e96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.362+0000 7f124963e740 1 -- 172.21.15.42:0/86262150 >> 172.21.15.42:0/86262150 conn(0x55cc8f0db120 msgr2=0x55cc8f0da180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 -- 172.21.15.42:0/86262150 shutdown_connections 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 -- 172.21.15.42:0/86262150 wait complete. 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 -- start start 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 Processor -- start 2024-03-31T23:19:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0fdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0fe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12401aded0 con 0x55cc8f0e1310 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12401ad800 con 0x55cc8f0e9ef0 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12401aaa20 con 0x55cc8f0e09f0 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f124963e740 10 client.0 _ll_register_callbacks cb 0x7f12340cc640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f123f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0fdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f123f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0fdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36508/0 (socket says 172.21.15.42:36508) 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f123f7fe640 1 -- 172.21.15.42:0/140685470 learned_addr learned my addr 172.21.15.42:0/140685470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f123ffff640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.363+0000 7f1244ff9640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f123f7fe640 1 -- 172.21.15.42:0/140685470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e09f0 msgr2=0x55cc8f0fd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f123f7fe640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0fd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f123f7fe640 1 -- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e9ef0 msgr2=0x55cc8f0fe450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f123f7fe640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0fe450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f123f7fe640 1 -- 172.21.15.42:0/140685470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8f15fc00 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f123f7fe640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0fdf10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ca0 tx=0x7f123000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7248b3bfbd00f2f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f121f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f121f7fe640 1 -- 172.21.15.42:0/140685470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123002a040 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f121f7fe640 1 -- 172.21.15.42:0/140685470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f123000f890 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f123000fd90 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f121f7fe640 1 -- 172.21.15.42:0/140685470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f123003d050 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f124963e740 10 client.16329 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc8f160ea0 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f121f7fe640 1 -- 172.21.15.42:0/140685470 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f123000fd90 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.364+0000 7f121f7fe640 1 -- 172.21.15.42:0/140685470 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f12300046c0 con 0x55cc8f0e1310 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f124963e740 10 client.16329 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f124963e740 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f124963e740 20 client.16329 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f124963e740 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f161540 0x55cc8f163960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f124963e740 4 client.16329 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-31T23:19:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cc8f04b730 con 0x55cc8f161540 2024-03-31T23:19:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f123ffff640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f161540 0x55cc8f163960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f121f7fe640 10 client.16329 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.365+0000 7f123ffff640 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f161540 0x55cc8f163960 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22acbdf66b5110d server_cookie=35907bf16b31228d in_seq=0 out_seq=0 2024-03-31T23:19:40.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f121f7fe640 1 -- 172.21.15.42:0/140685470 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cc8f04b730 con 0x55cc8f161540 2024-03-31T23:19:40.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f121f7fe640 10 client.16329 handle_command_reply: tid=0 2024-03-31T23:19:40.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 client.16329 shutdown 2024-03-31T23:19:40.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 msgr2=0x55cc8f0fdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0fdf10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ca0 tx=0x7f123000ffd0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 shutdown_connections 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55cc8f161540 0x55cc8f163960 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cc8f0e9ef0 0x55cc8f0fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc8f0e1310 0x55cc8f0fdf10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 --2- 172.21.15.42:0/140685470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc8f0e09f0 0x55cc8f0fd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 >> 172.21.15.42:0/140685470 conn(0x55cc8f0db120 msgr2=0x55cc8f0f4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f121f7fe640 0 client.16329 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 shutdown_connections 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 1 -- 172.21.15.42:0/140685470 wait complete. 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.368+0000 7f124963e740 20 client.16329 trim_cache size 0 max 16384 2024-03-31T23:19:40.373 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:19:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-03-31T23:19:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "fe925dc0-b88b-4635-9039-3acc41336dca", 2024-03-31T23:19:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-03-31T23:19:40.374 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12280a2730 msgr2=0x7f12280a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12280a2730 0x7f12280a4bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1238005cc0 tx=0x7f123802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 msgr2=0x7f1240198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 0x7f1240198020 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f123400e9f0 tx=0x7f123400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 shutdown_connections 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12401076f0 0x7f124019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12401020a0 0x7f1240198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f12280a2730 0x7f12280a4bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 --2- 172.21.15.42:0/2976993520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12401016e0 0x7f1240198020 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 >> 172.21.15.42:0/2976993520 conn(0x7f1240078b50 msgr2=0x7f1240103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 shutdown_connections 2024-03-31T23:19:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.369+0000 7f1246a5c640 1 -- 172.21.15.42:0/2976993520 wait complete. 2024-03-31T23:19:40.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:19:40.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 -- 172.21.15.42:0/2634265509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30107700 msgr2=0x7f8c30107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 --2- 172.21.15.42:0/2634265509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30107700 0x7f8c30107ae0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009930 tx=0x7f8c2c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 -- 172.21.15.42:0/2634265509 shutdown_connections 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 --2- 172.21.15.42:0/2634265509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c301020b0 0x7f8c3010e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 --2- 172.21.15.42:0/2634265509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c301016f0 0x7f8c30101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 --2- 172.21.15.42:0/2634265509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30107700 0x7f8c30107ae0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 -- 172.21.15.42:0/2634265509 >> 172.21.15.42:0/2634265509 conn(0x7f8c300fd180 msgr2=0x7f8c300ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 -- 172.21.15.42:0/2634265509 shutdown_connections 2024-03-31T23:19:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.487+0000 7f8c37281640 1 -- 172.21.15.42:0/2634265509 wait complete. 2024-03-31T23:19:40.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 Processor -- start 2024-03-31T23:19:40.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 -- start start 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c301016f0 0x7f8c30198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 0x7f8c30198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c30107700 0x7f8c3019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30111be0 con 0x7f8c301020b0 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30111a60 con 0x7f8c301016f0 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c37281640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30111d60 con 0x7f8c30107700 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 0x7f8c30198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 0x7f8c30198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36520/0 (socket says 172.21.15.42:36520) 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 -- 172.21.15.42:0/255883372 learned_addr learned my addr 172.21.15.42:0/255883372 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3501d640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c301016f0 0x7f8c30198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3581e640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c30107700 0x7f8c3019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 -- 172.21.15.42:0/255883372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c30107700 msgr2=0x7f8c3019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c30107700 0x7f8c3019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 -- 172.21.15.42:0/255883372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c301016f0 msgr2=0x7f8c30198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c301016f0 0x7f8c30198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 -- 172.21.15.42:0/255883372 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3019d130 con 0x7f8c301020b0 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.488+0000 7f8c3481c640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 0x7f8c30198680 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000e9f0 tx=0x7f8c2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.489+0000 7f8c267fc640 1 -- 172.21.15.42:0/255883372 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2000cd80 con 0x7f8c301020b0 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.489+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3019d420 con 0x7f8c301020b0 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.489+0000 7f8c267fc640 1 -- 172.21.15.42:0/255883372 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c20005520 con 0x7f8c301020b0 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.489+0000 7f8c267fc640 1 -- 172.21.15.42:0/255883372 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20010690 con 0x7f8c301020b0 2024-03-31T23:19:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.489+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c301a4cb0 con 0x7f8c301020b0 2024-03-31T23:19:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.491+0000 7f8c267fc640 1 -- 172.21.15.42:0/255883372 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 24) ==== 137553+0+0 (secure 0 0 0) 0x7f8c200046c0 con 0x7f8c301020b0 2024-03-31T23:19:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.491+0000 7f8c39e5d740 1 Processor -- start 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.491+0000 7f8c39e5d740 1 -- start start 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b71517e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715187250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b715189b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b7150e2180 con 0x55b71517ebb0 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b71508ab70 con 0x55b715187790 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b7150de220 con 0x55b71517e290 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c267fc640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c1c0a2730 0x7f8c1c0a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715187250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3581e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b71517e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715187250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36534/0 (socket says 172.21.15.42:36534) 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 -- 172.21.15.42:0/2294798627 learned_addr learned my addr 172.21.15.42:0/2294798627 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3481c640 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b715189b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3581e640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c1c0a2730 0x7f8c1c0a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c267fc640 1 -- 172.21.15.42:0/255883372 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c200cf580 con 0x7f8c301020b0 2024-03-31T23:19:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 -- 172.21.15.42:0/2294798627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 msgr2=0x55b71517e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b71517e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 -- 172.21.15.42:0/2294798627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 msgr2=0x55b715189b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b715189b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 -- 172.21.15.42:0/2294798627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71509e7c0 con 0x55b71517ebb0 2024-03-31T23:19:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.492+0000 7f8c3501d640 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715187250 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c036040 tx=0x7f8c2c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ffc836eb67d151 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.493+0000 7f8c3581e640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c1c0a2730 0x7f8c1c0a4bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c28005fd0 tx=0x7f8c28009500 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.493+0000 7f8c1b7fe640 1 -- 172.21.15.42:0/2294798627 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c02c710 con 0x55b71517ebb0 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.493+0000 7f8c1b7fe640 1 -- 172.21.15.42:0/2294798627 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2c004040 con 0x55b71517ebb0 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.493+0000 7f8c1b7fe640 1 -- 172.21.15.42:0/2294798627 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0046c0 con 0x55b71517ebb0 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2294798627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 msgr2=0x55b715187250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715187250 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c036040 tx=0x7f8c2c009560 comp rx=0 tx=0).stop 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2294798627 shutdown_connections 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b715189b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715187250 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2294798627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b71517e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2294798627 >> 172.21.15.42:0/2294798627 conn(0x55b7151789c0 msgr2=0x55b715178da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2294798627 shutdown_connections 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2294798627 wait complete. 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 -- start start 2024-03-31T23:19:40.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 Processor -- start 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 0x55b715184740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517ebb0 0x55b715184c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.494+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b7151851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b71518a520 con 0x55b71517e290 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b7150804a0 con 0x55b71517ebb0 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b71518a6a0 con 0x55b715187790 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c39e5d740 10 client.0 _ll_register_callbacks cb 0x55b715083d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 0x55b715184740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 0x55b715184740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36540/0 (socket says 172.21.15.42:36540) 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 -- 172.21.15.42:0/2896054295 learned_addr learned my addr 172.21.15.42:0/2896054295 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3481c640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517ebb0 0x55b715184c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3581e640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b7151851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 -- 172.21.15.42:0/2896054295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 msgr2=0x55b7151851c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b7151851c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 -- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517ebb0 msgr2=0x55b715184c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517ebb0 0x55b715184c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 -- 172.21.15.42:0/2896054295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b714ec07d0 con 0x55b71517e290 2024-03-31T23:19:40.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c3501d640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 0x55b715184740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c005730 tx=0x7f8c2c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52ff9146c574b10 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.495+0000 7f8c18ff9640 1 -- 172.21.15.42:0/2896054295 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c02c9d0 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c18ff9640 1 -- 172.21.15.42:0/2896054295 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c2c02cb70 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c2c004040 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c18ff9640 1 -- 172.21.15.42:0/2896054295 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c2c059050 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 10 client.16341 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b714df63f0 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c18ff9640 1 -- 172.21.15.42:0/2896054295 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2c004040 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c18ff9640 1 -- 172.21.15.42:0/2896054295 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c2c004860 con 0x55b71517e290 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 10 client.16341 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 20 client.16341 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7151978f0 0x55b715199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 4 client.16341 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7150ef6c0 con 0x55b7151978f0 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.496+0000 7f8c3481c640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7151978f0 0x55b715199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.497+0000 7f8c3481c640 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7151978f0 0x55b715199ce0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b678c00e8aec97 server_cookie=b3eab0d19a5516cc in_seq=0 out_seq=0 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.497+0000 7f8c18ff9640 10 client.16341 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c18ff9640 1 -- 172.21.15.42:0/2896054295 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b7150ef6c0 con 0x55b7151978f0 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c18ff9640 10 client.16341 handle_command_reply: tid=0 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 client.16341 shutdown 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 msgr2=0x55b715184740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 0x55b715184740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c005730 tx=0x7f8c2c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 shutdown_connections 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7151978f0 0x55b715199ce0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b7151851c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517ebb0 0x55b715184c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c18ff9640 0 client.16341 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/2896054295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517e290 0x55b715184740 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.498+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 >> 172.21.15.42:0/2896054295 conn(0x55b7151789c0 msgr2=0x55b71517a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.499+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 shutdown_connections 2024-03-31T23:19:40.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.499+0000 7f8c39e5d740 1 -- 172.21.15.42:0/2896054295 wait complete. 2024-03-31T23:19:40.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.499+0000 7f8c39e5d740 20 client.16341 trim_cache size 0 max 16384 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 Processor -- start 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 -- start start 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b715186e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b7151932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b7151835f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301aeba0 con 0x55b71517ebb0 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301b06e0 con 0x55b715187790 2024-03-31T23:19:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.517+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301af270 con 0x55b71517e290 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b7151932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b7151932f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36554/0 (socket says 172.21.15.42:36554) 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 -- 172.21.15.42:0/191792404 learned_addr learned my addr 172.21.15.42:0/191792404 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3501d640 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b715186e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3581e640 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b7151835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 -- 172.21.15.42:0/191792404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 msgr2=0x55b715186e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b715186e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 -- 172.21.15.42:0/191792404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 msgr2=0x55b7151835f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b7151835f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 -- 172.21.15.42:0/191792404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b714db60f0 con 0x55b71517ebb0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c3481c640 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b7151932f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000e9c0 tx=0x7f8c20086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9967f3f88a9ba1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c1affd640 1 -- 172.21.15.42:0/191792404 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2009b740 con 0x55b71517ebb0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c1affd640 1 -- 172.21.15.42:0/191792404 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2009f890 con 0x55b71517ebb0 2024-03-31T23:19:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.518+0000 7f8c1affd640 1 -- 172.21.15.42:0/191792404 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2009b9a0 con 0x55b71517ebb0 2024-03-31T23:19:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 -- 172.21.15.42:0/191792404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 msgr2=0x55b7151932f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b7151932f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000e9c0 tx=0x7f8c20086040 comp rx=0 tx=0).stop 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 -- 172.21.15.42:0/191792404 shutdown_connections 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b715187790 0x55b7151835f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b7151932f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/191792404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b71517e290 0x55b715186e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 -- 172.21.15.42:0/191792404 >> 172.21.15.42:0/191792404 conn(0x55b7151789c0 msgr2=0x55b715182ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 -- 172.21.15.42:0/191792404 shutdown_connections 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 -- 172.21.15.42:0/191792404 wait complete. 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 -- start start 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.519+0000 7f8c39e5d740 1 Processor -- start 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517e290 0x55b7151812c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715181800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b715181d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301b0010 con 0x55b71517ebb0 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301af940 con 0x55b71517e290 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301acb60 con 0x55b715187790 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715181800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 10 client.0 _ll_register_callbacks cb 0x7f8c2009b510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715181800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36560/0 (socket says 172.21.15.42:36560) 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3501d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517e290 0x55b7151812c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 -- 172.21.15.42:0/4144090947 learned_addr learned my addr 172.21.15.42:0/4144090947 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3581e640 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b715181d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 -- 172.21.15.42:0/4144090947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 msgr2=0x55b715181d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b715181d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 -- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517e290 msgr2=0x55b7151812c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517e290 0x55b7151812c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 -- 172.21.15.42:0/4144090947 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b715200e10 con 0x55b71517ebb0 2024-03-31T23:19:40.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c3481c640 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715181800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c6a0 tx=0x7f8c20097b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9051e6f820e00b44 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c18ff9640 1 -- 172.21.15.42:0/4144090947 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c200a4150 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c18ff9640 1 -- 172.21.15.42:0/4144090947 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c200860b0 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.520+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c2009f890 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c18ff9640 1 -- 172.21.15.42:0/4144090947 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c200997e0 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 10 client.16347 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7152020e0 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c18ff9640 1 -- 172.21.15.42:0/4144090947 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2009f890 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c18ff9640 1 -- 172.21.15.42:0/4144090947 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c200a3cc0 con 0x55b71517ebb0 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 10 client.16347 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 20 client.16347 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7152027a0 0x55b715204bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 4 client.16347 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:19:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7150e9a10 con 0x55b7152027a0 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.521+0000 7f8c3501d640 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7152027a0 0x55b715204bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c18ff9640 10 client.16347 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c3501d640 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7152027a0 0x55b715204bc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08606c0dc361d2c server_cookie=71500814b5468fe6 in_seq=0 out_seq=0 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c18ff9640 1 -- 172.21.15.42:0/4144090947 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55b7150e9a10 con 0x55b7152027a0 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c18ff9640 10 client.16347 handle_command_reply: tid=0 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 client.16347 shutdown 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 msgr2=0x55b715181800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715181800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c6a0 tx=0x7f8c20097b10 comp rx=0 tx=0).stop 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 shutdown_connections 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b7152027a0 0x55b715204bc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b715187790 0x55b715181d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b71517ebb0 0x55b715181800 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 --2- 172.21.15.42:0/4144090947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b71517e290 0x55b7151812c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 >> 172.21.15.42:0/4144090947 conn(0x55b7151789c0 msgr2=0x55b715184f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.522+0000 7f8c18ff9640 0 client.16347 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 shutdown_connections 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c39e5d740 1 -- 172.21.15.42:0/4144090947 wait complete. 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c39e5d740 20 client.16347 trim_cache size 0 max 16384 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (1321 inodes in the stack)", 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "fe925dc0-b88b-4635-9039-3acc41336dca": { 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "fe925dc0-b88b-4635-9039-3acc41336dca", 2024-03-31T23:19:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-03-31T23:19:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:19:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:19:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:19:40.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c1c0a2730 msgr2=0x7f8c1c0a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c1c0a2730 0x7f8c1c0a4bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c28005fd0 tx=0x7f8c28009500 comp rx=0 tx=0).stop 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 msgr2=0x7f8c30198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 0x7f8c30198680 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000e9f0 tx=0x7f8c2000edf0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 shutdown_connections 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c30107700 0x7f8c3019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c1c0a2730 0x7f8c1c0a4bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c301020b0 0x7f8c30198680 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 --2- 172.21.15.42:0/255883372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c301016f0 0x7f8c30198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 >> 172.21.15.42:0/255883372 conn(0x7f8c300fd180 msgr2=0x7f8c300fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 shutdown_connections 2024-03-31T23:19:40.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:19:40.523+0000 7f8c37281640 1 -- 172.21.15.42:0/255883372 wait complete. 2024-03-31T23:19:40.535 INFO:tasks.cephfs.filesystem:scrub status for tag:fe925dc0-b88b-4635-9039-3acc41336dca - {'path': '/', 'tag': 'fe925dc0-b88b-4635-9039-3acc41336dca', 'options': 'recursive,force'} 2024-03-31T23:19:41.820 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar xf doc.tar 2024-03-31T23:19:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:41 smithi188 ceph-mon[36068]: pgmap v48: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-31T23:19:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:41 smithi188 ceph-mon[36068]: scrub queued for path: / 2024-03-31T23:19:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:41 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:41.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:41 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:19:42.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:41 smithi042 ceph-mon[32380]: pgmap v48: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-31T23:19:42.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:41 smithi042 ceph-mon[32380]: scrub queued for path: / 2024-03-31T23:19:42.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:41 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:42.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:41 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:19:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:41 smithi094 ceph-mon[36167]: pgmap v48: 129 pgs: 129 active+clean; 84 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 7.4 MiB/s wr, 516 op/s 2024-03-31T23:19:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:41 smithi094 ceph-mon[36167]: scrub queued for path: / 2024-03-31T23:19:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:41 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:41 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:19:42.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:42 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:43.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:42 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:43.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:42 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:19:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:43 smithi188 ceph-mon[36068]: pgmap v49: 129 pgs: 129 active+clean; 85 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 7.5 MiB/s wr, 570 op/s 2024-03-31T23:19:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:43 smithi188 ceph-mon[36068]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-03-31T23:19:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:43 smithi042 ceph-mon[32380]: pgmap v49: 129 pgs: 129 active+clean; 85 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 7.5 MiB/s wr, 570 op/s 2024-03-31T23:19:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:43 smithi042 ceph-mon[32380]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-03-31T23:19:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:43 smithi094 ceph-mon[36167]: pgmap v49: 129 pgs: 129 active+clean; 85 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 7.5 MiB/s wr, 570 op/s 2024-03-31T23:19:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:43 smithi094 ceph-mon[36167]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-03-31T23:19:44.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:44 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:19:45.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:44 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:19:45.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:44 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:19:45.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:45 smithi188 ceph-mon[36068]: pgmap v50: 129 pgs: 129 active+clean; 85 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 647 KiB/s wr, 544 op/s 2024-03-31T23:19:46.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:45 smithi042 ceph-mon[32380]: pgmap v50: 129 pgs: 129 active+clean; 85 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 647 KiB/s wr, 544 op/s 2024-03-31T23:19:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:45 smithi094 ceph-mon[36167]: pgmap v50: 129 pgs: 129 active+clean; 85 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 647 KiB/s wr, 544 op/s 2024-03-31T23:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 -- 172.21.15.42:0/2245623306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c107700 msgr2=0x7f8c8c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2245623306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c107700 0x7f8c8c107ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009900 tx=0x7f8c7c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 -- 172.21.15.42:0/2245623306 shutdown_connections 2024-03-31T23:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2245623306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c10e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2245623306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c8c1016f0 0x7f8c8c101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2245623306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c107700 0x7f8c8c107ae0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 -- 172.21.15.42:0/2245623306 >> 172.21.15.42:0/2245623306 conn(0x7f8c8c0fd1e0 msgr2=0x7f8c8c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 -- 172.21.15.42:0/2245623306 shutdown_connections 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 -- 172.21.15.42:0/2245623306 wait complete. 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.187+0000 7f8c919f2640 1 Processor -- start 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 -- start start 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c1016f0 0x7f8c8c197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c8c107700 0x7f8c8c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c111bf0 con 0x7f8c8c1020b0 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c111a70 con 0x7f8c8c1016f0 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c919f2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c111d70 con 0x7f8c8c107700 2024-03-31T23:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35350/0 (socket says 172.21.15.42:35350) 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c1016f0 0x7f8c8c197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 -- 172.21.15.42:0/2019639350 learned_addr learned my addr 172.21.15.42:0/2019639350 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c8c107700 0x7f8c8c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 -- 172.21.15.42:0/2019639350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c8c107700 msgr2=0x7f8c8c19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c8c107700 0x7f8c8c19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 -- 172.21.15.42:0/2019639350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c1016f0 msgr2=0x7f8c8c197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c1016f0 0x7f8c8c197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 -- 172.21.15.42:0/2019639350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c19cf90 con 0x7f8c8c1020b0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.188+0000 7f8c8a7fc640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c198530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000e9f0 tx=0x7f8c8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.189+0000 7f8c909f0640 1 -- 172.21.15.42:0/2019639350 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000cd80 con 0x7f8c8c1020b0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.189+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c19d280 con 0x7f8c8c1020b0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.189+0000 7f8c909f0640 1 -- 172.21.15.42:0/2019639350 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c80010930 con 0x7f8c8c1020b0 2024-03-31T23:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.189+0000 7f8c909f0640 1 -- 172.21.15.42:0/2019639350 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80018b00 con 0x7f8c8c1020b0 2024-03-31T23:19:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.189+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c1a4b10 con 0x7f8c8c1020b0 2024-03-31T23:19:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.191+0000 7f8c909f0640 1 -- 172.21.15.42:0/2019639350 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f8c80018ca0 con 0x7f8c8c1020b0 2024-03-31T23:19:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.191+0000 7f8c945cb740 1 Processor -- start 2024-03-31T23:19:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.191+0000 7f8c945cb740 1 -- start start 2024-03-31T23:19:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafa9baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c909f0640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c740a26b0 0x7f8c740a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c945cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55feaf9fe8f0 con 0x55feafaa4db0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c945cb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55feaf9a78d0 con 0x55feafa9b6c0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c945cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55feaf9fa990 con 0x55feafa9bfe0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8affd640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c740a26b0 0x7f8c740a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35366/0 (socket says 172.21.15.42:35366) 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/2729408345 learned_addr learned my addr 172.21.15.42:0/2729408345 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8a7fc640 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafa9baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c909f0640 1 -- 172.21.15.42:0/2019639350 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c800cf1d0 con 0x7f8c8c1020b0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/2729408345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 msgr2=0x55feafaa4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/2729408345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 msgr2=0x55feafa9baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafa9baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/2729408345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feaf713210 con 0x55feafaa4db0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8affd640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c740a26b0 0x7f8c740a4b70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c006010 tx=0x7f8c7c005e40 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa71a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8c84005f40 tx=0x7f8c84005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f169a20956777d03 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.192+0000 7f8c71ffb640 1 -- 172.21.15.42:0/2729408345 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84011130 con 0x55feafaa4db0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c71ffb640 1 -- 172.21.15.42:0/2729408345 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c840112d0 con 0x55feafaa4db0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c71ffb640 1 -- 172.21.15.42:0/2729408345 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400fce0 con 0x55feafaa4db0 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 -- 172.21.15.42:0/2729408345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 msgr2=0x55feafaa71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa71a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8c84005f40 tx=0x7f8c84005bd0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 -- 172.21.15.42:0/2729408345 shutdown_connections 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa71a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2729408345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafa9baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 -- 172.21.15.42:0/2729408345 >> 172.21.15.42:0/2729408345 conn(0x55feafa95fe0 msgr2=0x55feafa963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 -- 172.21.15.42:0/2729408345 shutdown_connections 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.193+0000 7f8c945cb740 1 -- 172.21.15.42:0/2729408345 wait complete. 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 -- start start 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 Processor -- start 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafaa1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55feafaa79e0 con 0x55feafaa4db0 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55feaf99cf80 con 0x55feafa9b6c0 2024-03-31T23:19:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55feafaa7b60 con 0x55feafa9bfe0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c945cb740 10 client.0 _ll_register_callbacks cb 0x55feaf9f5290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c8affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafaa1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c8a7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35376/0 (socket says 172.21.15.42:35376) 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.194+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/1318294835 learned_addr learned my addr 172.21.15.42:0/1318294835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/1318294835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 msgr2=0x55feafaa2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 msgr2=0x55feafaa1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafaa1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/1318294835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feaf7df620 con 0x55feafaa4db0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa28c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8c84006010 tx=0x7f8c84004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f90832112e174cf server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c6affd640 1 -- 172.21.15.42:0/1318294835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84011130 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c6affd640 1 -- 172.21.15.42:0/1318294835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c84005220 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c840112d0 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c6affd640 1 -- 172.21.15.42:0/1318294835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c84030050 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c945cb740 10 client.16359 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55feafab7d20 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c6affd640 1 -- 172.21.15.42:0/1318294835 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c840112d0 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c6affd640 1 -- 172.21.15.42:0/1318294835 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c8401d020 con 0x55feafaa4db0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c945cb740 10 client.16359 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c945cb740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.195+0000 7f8c945cb740 20 client.16359 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.196+0000 7f8c945cb740 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafab9070 0x55feafabb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.196+0000 7f8c945cb740 4 client.16359 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.196+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55feafa12120 con 0x55feafab9070 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.196+0000 7f8c8affd640 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafab9070 0x55feafabb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.196+0000 7f8c8affd640 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafab9070 0x55feafabb460 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ff9d3c295966f02 server_cookie=5055eefdb22426c7 in_seq=0 out_seq=0 2024-03-31T23:19:46.204 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.196+0000 7f8c6affd640 10 client.16359 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c6affd640 1 -- 172.21.15.42:0/1318294835 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55feafa12120 con 0x55feafab9070 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c6affd640 10 client.16359 handle_command_reply: tid=0 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 client.16359 shutdown 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 msgr2=0x55feafaa28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa28c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8c84006010 tx=0x7f8c84004d10 comp rx=0 tx=0).stop 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 shutdown_connections 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafab9070 0x55feafabb460 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafaa4db0 0x55feafaa28c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c6affd640 0 client.16359 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafaa2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 --2- 172.21.15.42:0/1318294835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9b6c0 0x55feafaa1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 >> 172.21.15.42:0/1318294835 conn(0x55feafa95fe0 msgr2=0x55feafa97d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 shutdown_connections 2024-03-31T23:19:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.199+0000 7f8c945cb740 1 -- 172.21.15.42:0/1318294835 wait complete. 2024-03-31T23:19:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.200+0000 7f8c945cb740 20 client.16359 trim_cache size 0 max 16384 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 Processor -- start 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 -- start start 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 0x55feafaa4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafab4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafaa4db0 0x55feafa94e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1aca00 con 0x55feafa9b6c0 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ae540 con 0x55feafaa4db0 2024-03-31T23:19:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.214+0000 7f8c945cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ad0d0 con 0x55feafa9bfe0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 0x55feafaa4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8a7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafab4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafaa4db0 0x55feafa94e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 0x55feafaa4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35388/0 (socket says 172.21.15.42:35388) 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 -- 172.21.15.42:0/2082519385 learned_addr learned my addr 172.21.15.42:0/2082519385 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8a7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafab4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:54268/0 (socket says 172.21.15.42:54268) 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 -- 172.21.15.42:0/2082519385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 msgr2=0x55feafab4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafab4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 -- 172.21.15.42:0/2082519385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafaa4db0 msgr2=0x55feafa94e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafaa4db0 0x55feafa94e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 -- 172.21.15.42:0/2082519385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feafaa03b0 con 0x55feafa9b6c0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c8affd640 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 0x55feafaa4570 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c02c170 tx=0x7f8c7c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7cb52a80c37b7c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c717fa640 1 -- 172.21.15.42:0/2082519385 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c058070 con 0x55feafa9b6c0 2024-03-31T23:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c717fa640 1 -- 172.21.15.42:0/2082519385 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c7c051030 con 0x55feafa9b6c0 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.215+0000 7f8c717fa640 1 -- 172.21.15.42:0/2082519385 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c047040 con 0x55feafa9b6c0 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 -- 172.21.15.42:0/2082519385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 msgr2=0x55feafaa4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 0x55feafaa4570 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c02c170 tx=0x7f8c7c03e000 comp rx=0 tx=0).stop 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 -- 172.21.15.42:0/2082519385 shutdown_connections 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafaa4db0 0x55feafa94e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafa9bfe0 0x55feafab4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 --2- 172.21.15.42:0/2082519385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafa9b6c0 0x55feafaa4570 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 -- 172.21.15.42:0/2082519385 >> 172.21.15.42:0/2082519385 conn(0x55feafa95fe0 msgr2=0x55feafa946f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 -- 172.21.15.42:0/2082519385 shutdown_connections 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 -- 172.21.15.42:0/2082519385 wait complete. 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 -- start start 2024-03-31T23:19:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.216+0000 7f8c945cb740 1 Processor -- start 2024-03-31T23:19:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9bfe0 0x55feafa9f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafaa4db0 0x55feafa9f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 0x55feafb1e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ade70 con 0x55feafb1c210 2024-03-31T23:19:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ad7a0 con 0x55feafa9bfe0 2024-03-31T23:19:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1aa9c0 con 0x55feafaa4db0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 10 client.0 _ll_register_callbacks cb 0x7f8c840115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 0x55feafb1e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9bfe0 0x55feafa9f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 0x55feafb1e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35394/0 (socket says 172.21.15.42:35394) 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/744522951 learned_addr learned my addr 172.21.15.42:0/744522951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8a7fc640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafaa4db0 0x55feafa9f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/744522951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafaa4db0 msgr2=0x55feafa9f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafaa4db0 0x55feafa9f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9bfe0 msgr2=0x55feafa9f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9bfe0 0x55feafa9f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/744522951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feafb1ebc0 con 0x55feafb1c210 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8affd640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9bfe0 0x55feafa9f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 0x55feafb1e600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009270 tx=0x7f8c840116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b382fe836c1da1d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:19:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c6affd640 1 -- 172.21.15.42:0/744522951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84039060 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c6affd640 1 -- 172.21.15.42:0/744522951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c8400f850 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.217+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7c051030 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c6affd640 1 -- 172.21.15.42:0/744522951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c84040050 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 10 client.16365 fetch_fsmap learned FSMap version 29 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55feafb1feb0 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c6affd640 1 -- 172.21.15.42:0/744522951 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c7c051030 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c6affd640 1 -- 172.21.15.42:0/744522951 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c8401d040 con 0x55feafb1c210 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 10 client.16365 fetch_fsmap finished waiting for FSMap version 29 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 20 client.16365 populate_metadata read hostname 'smithi042' 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafb20510 0x55feafb22930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 4 client.16365 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:19:46.224 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55feafa0be30 con 0x55feafb20510 2024-03-31T23:19:46.225 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.218+0000 7f8c8affd640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafb20510 0x55feafb22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:19:46.225 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.219+0000 7f8c6affd640 10 client.16365 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:46.225 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:46.219+0000 7f8c8affd640 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafb20510 0x55feafb22930 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9fda0ee6cae5298 server_cookie=bac37b258488961a in_seq=0 out_seq=0 2024-03-31T23:19:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:47 smithi188 ceph-mon[36068]: pgmap v51: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 693 op/s 2024-03-31T23:19:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:47 smithi042 ceph-mon[32380]: pgmap v51: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 693 op/s 2024-03-31T23:19:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:47 smithi094 ceph-mon[36167]: pgmap v51: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 693 op/s 2024-03-31T23:19:49.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:49 smithi188 ceph-mon[36068]: pgmap v52: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 760 KiB/s wr, 203 op/s 2024-03-31T23:19:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:49 smithi042 ceph-mon[32380]: pgmap v52: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 760 KiB/s wr, 203 op/s 2024-03-31T23:19:50.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:49 smithi094 ceph-mon[36167]: pgmap v52: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 760 KiB/s wr, 203 op/s 2024-03-31T23:19:50.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:50 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:19:51.072 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:50 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:19:51.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:50 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:19:51.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:51 smithi188 ceph-mon[36068]: pgmap v53: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 760 KiB/s wr, 203 op/s 2024-03-31T23:19:52.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:51 smithi042 ceph-mon[32380]: pgmap v53: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 760 KiB/s wr, 203 op/s 2024-03-31T23:19:52.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:51 smithi094 ceph-mon[36167]: pgmap v53: 129 pgs: 129 active+clean; 92 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 760 KiB/s wr, 203 op/s 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c6affd640 1 -- 172.21.15.42:0/744522951 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55feafa0be30 con 0x55feafb20510 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c6affd640 10 client.16365 handle_command_reply: tid=0 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 client.16365 shutdown 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 msgr2=0x55feafb1e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 0x55feafb1e600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009270 tx=0x7f8c840116f0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 shutdown_connections 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55feafb20510 0x55feafb22930 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55feafb1c210 0x55feafb1e600 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55feafaa4db0 0x55feafa9f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 --2- 172.21.15.42:0/744522951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55feafa9bfe0 0x55feafa9f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.610+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 >> 172.21.15.42:0/744522951 conn(0x55feafa95fe0 msgr2=0x55feafa94f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.611+0000 7f8c6affd640 0 client.16365 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.611+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 shutdown_connections 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.611+0000 7f8c945cb740 1 -- 172.21.15.42:0/744522951 wait complete. 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.611+0000 7f8c945cb740 20 client.16365 trim_cache size 0 max 16384 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:19:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c740a26b0 msgr2=0x7f8c740a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c740a26b0 0x7f8c740a4b70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c006010 tx=0x7f8c7c005e40 comp rx=0 tx=0).stop 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 msgr2=0x7f8c8c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c198530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000e9f0 tx=0x7f8c8000eeb0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 shutdown_connections 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c8c107700 0x7f8c8c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c740a26b0 0x7f8c740a4b70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c8c1020b0 0x7f8c8c198530 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 --2- 172.21.15.42:0/2019639350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8c1016f0 0x7f8c8c197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:19:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 >> 172.21.15.42:0/2019639350 conn(0x7f8c8c0fd1e0 msgr2=0x7f8c8c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:19:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 shutdown_connections 2024-03-31T23:19:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:19:52.612+0000 7f8c919f2640 1 -- 172.21.15.42:0/2019639350 wait complete. 2024-03-31T23:19:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:53 smithi188 ceph-mon[36068]: pgmap v54: 129 pgs: 129 active+clean; 98 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 984 op/s 2024-03-31T23:19:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:53 smithi042 ceph-mon[32380]: pgmap v54: 129 pgs: 129 active+clean; 98 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 984 op/s 2024-03-31T23:19:54.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:53 smithi094 ceph-mon[36167]: pgmap v54: 129 pgs: 129 active+clean; 98 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 984 op/s 2024-03-31T23:19:55.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:54 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:19:55.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:54 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:19:55.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:54 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:19:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:55 smithi042 ceph-mon[32380]: pgmap v55: 129 pgs: 129 active+clean; 98 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 930 op/s 2024-03-31T23:19:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:55 smithi094 ceph-mon[36167]: pgmap v55: 129 pgs: 129 active+clean; 98 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 930 op/s 2024-03-31T23:19:56.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:55 smithi188 ceph-mon[36068]: pgmap v55: 129 pgs: 129 active+clean; 98 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 930 op/s 2024-03-31T23:19:58.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:57 smithi042 ceph-mon[32380]: pgmap v56: 129 pgs: 129 active+clean; 130 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 1.32k op/s 2024-03-31T23:19:58.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:57 smithi094 ceph-mon[36167]: pgmap v56: 129 pgs: 129 active+clean; 130 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 1.32k op/s 2024-03-31T23:19:58.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:57 smithi188 ceph-mon[36068]: pgmap v56: 129 pgs: 129 active+clean; 130 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 1.32k op/s 2024-03-31T23:20:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:19:59 smithi042 ceph-mon[32380]: pgmap v57: 129 pgs: 129 active+clean; 139 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 1.30k op/s 2024-03-31T23:20:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:19:59 smithi094 ceph-mon[36167]: pgmap v57: 129 pgs: 129 active+clean; 139 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 1.30k op/s 2024-03-31T23:20:00.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:19:59 smithi188 ceph-mon[36068]: pgmap v57: 129 pgs: 129 active+clean; 139 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 1.30k op/s 2024-03-31T23:20:01.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:00 smithi042 ceph-mon[32380]: overall HEALTH_OK 2024-03-31T23:20:01.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:00 smithi094 ceph-mon[36167]: overall HEALTH_OK 2024-03-31T23:20:01.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:00 smithi188 ceph-mon[36068]: overall HEALTH_OK 2024-03-31T23:20:02.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:01 smithi042 ceph-mon[32380]: pgmap v58: 129 pgs: 129 active+clean; 139 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 1.30k op/s 2024-03-31T23:20:02.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:01 smithi094 ceph-mon[36167]: pgmap v58: 129 pgs: 129 active+clean; 139 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 1.30k op/s 2024-03-31T23:20:02.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:01 smithi188 ceph-mon[36068]: pgmap v58: 129 pgs: 129 active+clean; 139 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 1.30k op/s 2024-03-31T23:20:04.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:03 smithi042 ceph-mon[32380]: pgmap v59: 129 pgs: 129 active+clean; 149 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.8 MiB/s wr, 1.73k op/s 2024-03-31T23:20:04.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:03 smithi094 ceph-mon[36167]: pgmap v59: 129 pgs: 129 active+clean; 149 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.8 MiB/s wr, 1.73k op/s 2024-03-31T23:20:04.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:03 smithi188 ceph-mon[36068]: pgmap v59: 129 pgs: 129 active+clean; 149 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.8 MiB/s wr, 1.73k op/s 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 -- 172.21.15.42:0/3621585570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 msgr2=0x7f780010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 --2- 172.21.15.42:0/3621585570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f780010e630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009be0 tx=0x7f77f802bef0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 -- 172.21.15.42:0/3621585570 shutdown_connections 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 --2- 172.21.15.42:0/3621585570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f780010e630 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 --2- 172.21.15.42:0/3621585570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78000ffc50 0x7f78001000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 --2- 172.21.15.42:0/3621585570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7800107770 0x7f7800107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 -- 172.21.15.42:0/3621585570 >> 172.21.15.42:0/3621585570 conn(0x7f7800076be0 msgr2=0x7f78000fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 -- 172.21.15.42:0/3621585570 shutdown_connections 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 -- 172.21.15.42:0/3621585570 wait complete. 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.713+0000 7f78055b5640 1 Processor -- start 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 -- start start 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78000ffc50 0x7f78001980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f7800198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7800107770 0x7f780019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7800111ca0 con 0x7f7800107770 2024-03-31T23:20:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7800111b20 con 0x7f7800100610 2024-03-31T23:20:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f78055b5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7800111e20 con 0x7f78000ffc50 2024-03-31T23:20:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77feffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78000ffc50 0x7f78001980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7800107770 0x7f780019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77feffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78000ffc50 0x7f78001980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:41038/0 (socket says 172.21.15.42:41038) 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77feffd640 1 -- 172.21.15.42:0/4172777904 learned_addr learned my addr 172.21.15.42:0/4172777904 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f7800198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 -- 172.21.15.42:0/4172777904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78000ffc50 msgr2=0x7f78001980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78000ffc50 0x7f78001980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 -- 172.21.15.42:0/4172777904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 msgr2=0x7f7800198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f7800198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 -- 172.21.15.42:0/4172777904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780019d080 con 0x7f7800107770 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f7800198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.714+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7800107770 0x7f780019c950 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f77f802c430 tx=0x7f77f8033750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.715+0000 7f77e7fff640 1 -- 172.21.15.42:0/4172777904 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8043020 con 0x7f7800107770 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.715+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780019d310 con 0x7f7800107770 2024-03-31T23:20:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.715+0000 7f77e7fff640 1 -- 172.21.15.42:0/4172777904 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77f8033940 con 0x7f7800107770 2024-03-31T23:20:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.715+0000 7f77e7fff640 1 -- 172.21.15.42:0/4172777904 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f803e6b0 con 0x7f7800107770 2024-03-31T23:20:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.715+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78001a4c00 con 0x7f7800107770 2024-03-31T23:20:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.717+0000 7f77e7fff640 1 -- 172.21.15.42:0/4172777904 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f77f8046020 con 0x7f7800107770 2024-03-31T23:20:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 Processor -- start 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 -- start start 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc86baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc874870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77e7fff640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f77e80a26b0 0x7f77e80a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc8771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564edc7ce8f0 con 0x564edc86bfe0 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x564edc7778d0 con 0x564edc874db0 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f7808197740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564edc7ca990 con 0x564edc86b6c0 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc8771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77feffd640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f77e80a26b0 0x7f77e80a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77fe7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc874870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc8771a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41716/0 (socket says 172.21.15.42:41716) 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77fe7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc874870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34536/0 (socket says 172.21.15.42:34536) 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2355532405 learned_addr learned my addr 172.21.15.42:0/2355532405 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77e7fff640 1 -- 172.21.15.42:0/4172777904 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f77f80f1270 con 0x7f7800107770 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc86baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2355532405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 msgr2=0x564edc86baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc86baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2355532405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 msgr2=0x564edc874870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc874870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2355532405 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edc4e3210 con 0x564edc874db0 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.718+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc86baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f77feffd640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f77e80a26b0 0x7f77e80a4b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009c50 tx=0x7f77f0005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc8771a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f77f80c5c30 tx=0x7f77f80046b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c6fce5a8ef87f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f77e57fa640 1 -- 172.21.15.42:0/2355532405 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8030200 con 0x564edc874db0 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f77e57fa640 1 -- 172.21.15.42:0/2355532405 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77f80bde50 con 0x564edc874db0 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f77e57fa640 1 -- 172.21.15.42:0/2355532405 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80b9dc0 con 0x564edc874db0 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 -- 172.21.15.42:0/2355532405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 msgr2=0x564edc8771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc8771a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f77f80c5c30 tx=0x7f77f80046b0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 -- 172.21.15.42:0/2355532405 shutdown_connections 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc8771a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc874870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 --2- 172.21.15.42:0/2355532405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc86baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 -- 172.21.15.42:0/2355532405 >> 172.21.15.42:0/2355532405 conn(0x564edc865fe0 msgr2=0x564edc8663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 -- 172.21.15.42:0/2355532405 shutdown_connections 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.719+0000 7f7808197740 1 -- 172.21.15.42:0/2355532405 wait complete. 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 -- start start 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 Processor -- start 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc871de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc872320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc872860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564edc7778d0 con 0x564edc86bfe0 2024-03-31T23:20:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x564edc76cf80 con 0x564edc874db0 2024-03-31T23:20:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564edc8777a0 con 0x564edc86b6c0 2024-03-31T23:20:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f7808197740 10 client.0 _ll_register_callbacks cb 0x564edc7c5290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f77fe7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc872320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f77feffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc871de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc872860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f77fe7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc872320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34544/0 (socket says 172.21.15.42:34544) 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f77fe7fc640 1 -- 172.21.15.42:0/3337298115 learned_addr learned my addr 172.21.15.42:0/3337298115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.720+0000 7f77fe7fc640 1 -- 172.21.15.42:0/3337298115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 msgr2=0x564edc871de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc871de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77fe7fc640 1 -- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 msgr2=0x564edc872860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc872860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77fe7fc640 1 -- 172.21.15.42:0/3337298115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edc5af620 con 0x564edc86bfe0 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc872860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc872320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012c70 tx=0x7f77f400e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c715fd03d039cd server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77e2ff5640 1 -- 172.21.15.42:0/3337298115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4004020 con 0x564edc86bfe0 2024-03-31T23:20:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77e2ff5640 1 -- 172.21.15.42:0/3337298115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f77f40041c0 con 0x564edc86bfe0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f80bde50 con 0x564edc86bfe0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77e2ff5640 1 -- 172.21.15.42:0/3337298115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f77f4029050 con 0x564edc86bfe0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f7808197740 10 client.16377 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564edc8835a0 con 0x564edc86bfe0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77e2ff5640 1 -- 172.21.15.42:0/3337298115 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77f80bde50 con 0x564edc86bfe0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.721+0000 7f77e2ff5640 1 -- 172.21.15.42:0/3337298115 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f77f4003780 con 0x564edc86bfe0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f7808197740 10 client.16377 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f7808197740 10 client.16377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f7808197740 20 client.16377 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f7808197740 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc884bc0 0x564edc887000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f7808197740 4 client.16377 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564edc7e2120 con 0x564edc884bc0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f77feffd640 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc884bc0 0x564edc887000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f77e2ff5640 10 client.16377 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.722+0000 7f77feffd640 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc884bc0 0x564edc887000 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda8ed36643ad8b3 server_cookie=e3c643a84bf38aa in_seq=0 out_seq=0 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f77e2ff5640 1 -- 172.21.15.42:0/3337298115 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x564edc7e2120 con 0x564edc884bc0 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f77e2ff5640 10 client.16377 handle_command_reply: tid=0 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 client.16377 shutdown 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 msgr2=0x564edc872320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc872320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012c70 tx=0x7f77f400e860 comp rx=0 tx=0).stop 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 shutdown_connections 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc884bc0 0x564edc887000 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc874db0 0x564edc872860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f77e2ff5640 0 client.16377 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86bfe0 0x564edc872320 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 --2- 172.21.15.42:0/3337298115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc871de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 >> 172.21.15.42:0/3337298115 conn(0x564edc865fe0 msgr2=0x564edc867d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 shutdown_connections 2024-03-31T23:20:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 1 -- 172.21.15.42:0/3337298115 wait complete. 2024-03-31T23:20:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.723+0000 7f7808197740 20 client.16377 trim_cache size 0 max 16384 2024-03-31T23:20:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 Processor -- start 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 -- start start 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 0x564edc874510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc8803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc874db0 0x564edc88c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78001aeb10 con 0x564edc86b6c0 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f78001b0710 con 0x564edc86bfe0 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f7808197740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f78001af1e0 con 0x564edc874db0 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 0x564edc874510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 0x564edc874510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34546/0 (socket says 172.21.15.42:34546) 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc874db0 0x564edc88c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77fe7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc8803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 -- 172.21.15.42:0/2386653680 learned_addr learned my addr 172.21.15.42:0/2386653680 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 -- 172.21.15.42:0/2386653680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc874db0 msgr2=0x564edc88c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc874db0 0x564edc88c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 -- 172.21.15.42:0/2386653680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 msgr2=0x564edc8803c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc8803c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 -- 172.21.15.42:0/2386653680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edc887680 con 0x564edc86b6c0 2024-03-31T23:20:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.739+0000 7f77feffd640 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 0x564edc874510 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x564edc8878b0 tx=0x7f77f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446af8cf043f259d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f77e4ff9640 1 -- 172.21.15.42:0/2386653680 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f002f070 con 0x564edc86b6c0 2024-03-31T23:20:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f77e4ff9640 1 -- 172.21.15.42:0/2386653680 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77f002a670 con 0x564edc86b6c0 2024-03-31T23:20:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f77e4ff9640 1 -- 172.21.15.42:0/2386653680 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f000f6b0 con 0x564edc86b6c0 2024-03-31T23:20:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 -- 172.21.15.42:0/2386653680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 msgr2=0x564edc874510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 0x564edc874510 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x564edc8878b0 tx=0x7f77f0014000 comp rx=0 tx=0).stop 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 -- 172.21.15.42:0/2386653680 shutdown_connections 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc874db0 0x564edc88c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc8803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 --2- 172.21.15.42:0/2386653680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc86b6c0 0x564edc874510 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 -- 172.21.15.42:0/2386653680 >> 172.21.15.42:0/2386653680 conn(0x564edc865fe0 msgr2=0x564edc864f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 -- 172.21.15.42:0/2386653680 shutdown_connections 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.740+0000 7f7808197740 1 -- 172.21.15.42:0/2386653680 wait complete. 2024-03-31T23:20:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 -- start start 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 Processor -- start 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc87cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc878160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 0x564edc8788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78001aff80 con 0x564edc874db0 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f78001af8b0 con 0x564edc86bfe0 2024-03-31T23:20:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f78001acad0 con 0x564edc86b6c0 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f7808197740 10 client.0 _ll_register_callbacks cb 0x7f77f4012890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 0x564edc8788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77feffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc87cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 0x564edc8788a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34562/0 (socket says 172.21.15.42:34562) 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 -- 172.21.15.42:0/1635692739 learned_addr learned my addr 172.21.15.42:0/1635692739 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc878160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 -- 172.21.15.42:0/1635692739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 msgr2=0x564edc87cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc87cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 -- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 msgr2=0x564edc878160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc878160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.741+0000 7f77ff7fe640 1 -- 172.21.15.42:0/1635692739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edc8e9f40 con 0x564edc874db0 2024-03-31T23:20:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.742+0000 7f77fe7fc640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc878160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.742+0000 7f77ff7fe640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 0x564edc8788a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f77f80bd450 tx=0x7f77f80d85c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55daecebd8aea01 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.742+0000 7f77e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f77e2ff5640 1 -- 172.21.15.42:0/1635692739 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80bde50 con 0x564edc874db0 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f002a670 con 0x564edc874db0 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f77e2ff5640 1 -- 172.21.15.42:0/1635692739 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f77f80bba50 con 0x564edc874db0 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f77e2ff5640 1 -- 172.21.15.42:0/1635692739 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f77f80c18a0 con 0x564edc874db0 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 10 client.16383 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564edc8eb0b0 con 0x564edc874db0 2024-03-31T23:20:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f77e2ff5640 1 -- 172.21.15.42:0/1635692739 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77f002a670 con 0x564edc874db0 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f77e2ff5640 1 -- 172.21.15.42:0/1635692739 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f77f8004cd0 con 0x564edc874db0 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 10 client.16383 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 10 client.16383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 20 client.16383 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc8eb670 0x564edc8eda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 4 client.16383 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.744+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564edc7dbe30 con 0x564edc8eb670 2024-03-31T23:20:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.745+0000 7f77feffd640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc8eb670 0x564edc8eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.745+0000 7f77e2ff5640 10 client.16383 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:05.745+0000 7f77feffd640 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc8eb670 0x564edc8eda90 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c4984404beea168 server_cookie=757752bc83d620b9 in_seq=0 out_seq=0 2024-03-31T23:20:06.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:05 smithi042 ceph-mon[32380]: pgmap v60: 129 pgs: 129 active+clean; 149 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 948 op/s 2024-03-31T23:20:06.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:05 smithi094 ceph-mon[36167]: pgmap v60: 129 pgs: 129 active+clean; 149 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 948 op/s 2024-03-31T23:20:06.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:05 smithi188 ceph-mon[36068]: pgmap v60: 129 pgs: 129 active+clean; 149 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 948 op/s 2024-03-31T23:20:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.784+0000 7f77e2ff5640 1 -- 172.21.15.42:0/1635692739 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564edc7dbe30 con 0x564edc8eb670 2024-03-31T23:20:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.784+0000 7f77e2ff5640 10 client.16383 handle_command_reply: tid=0 2024-03-31T23:20:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.784+0000 7f7808197740 1 client.16383 shutdown 2024-03-31T23:20:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 msgr2=0x564edc8788a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 0x564edc8788a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f77f80bd450 tx=0x7f77f80d85c0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 shutdown_connections 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x564edc8eb670 0x564edc8eda90 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edc874db0 0x564edc8788a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f77e2ff5640 0 client.16383 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564edc86bfe0 0x564edc878160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 --2- 172.21.15.42:0/1635692739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564edc86b6c0 0x564edc87cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 >> 172.21.15.42:0/1635692739 conn(0x564edc865fe0 msgr2=0x564edc867430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 shutdown_connections 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 1 -- 172.21.15.42:0/1635692739 wait complete. 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.785+0000 7f7808197740 20 client.16383 trim_cache size 0 max 16384 2024-03-31T23:20:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:20:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:20:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:20:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:20:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f77e80a26b0 msgr2=0x7f77e80a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f77e80a26b0 0x7f77e80a4b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009c50 tx=0x7f77f0005f90 comp rx=0 tx=0).stop 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7800107770 msgr2=0x7f780019c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7800107770 0x7f780019c950 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f77f802c430 tx=0x7f77f8033750 comp rx=0 tx=0).stop 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 shutdown_connections 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f77e80a26b0 0x7f77e80a4b70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7800107770 0x7f780019c950 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800100610 0x7f7800198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 --2- 172.21.15.42:0/4172777904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78000ffc50 0x7f78001980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.786+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 >> 172.21.15.42:0/4172777904 conn(0x7f7800076be0 msgr2=0x7f7800104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.787+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 shutdown_connections 2024-03-31T23:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:06.787+0000 7f78055b5640 1 -- 172.21.15.42:0/4172777904 wait complete. 2024-03-31T23:20:07.069 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2024-03-31T23:20:08.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:07 smithi042 ceph-mon[32380]: pgmap v61: 129 pgs: 129 active+clean; 148 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 989 op/s 2024-03-31T23:20:08.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:07 smithi094 ceph-mon[36167]: pgmap v61: 129 pgs: 129 active+clean; 148 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 989 op/s 2024-03-31T23:20:08.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:07 smithi188 ceph-mon[36068]: pgmap v61: 129 pgs: 129 active+clean; 148 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 989 op/s 2024-03-31T23:20:09.795 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar c linux-4.0.5 2024-03-31T23:20:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:09 smithi042 ceph-mon[32380]: pgmap v62: 129 pgs: 129 active+clean; 157 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 694 op/s 2024-03-31T23:20:10.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:09 smithi094 ceph-mon[36167]: pgmap v62: 129 pgs: 129 active+clean; 157 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 694 op/s 2024-03-31T23:20:10.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:09 smithi188 ceph-mon[36068]: pgmap v62: 129 pgs: 129 active+clean; 157 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 694 op/s 2024-03-31T23:20:10.535 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm -rf linux-4.0.5 2024-03-31T23:20:10.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:20:10.536 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/4159775883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb281066a0 msgr2=0x7ffb28106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/4159775883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb281066a0 0x7ffb28106a80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009930 tx=0x7ffb1c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/4159775883 shutdown_connections 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/4159775883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb28100fc0 0x7ffb2810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/4159775883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28100600 0x7ffb28100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/4159775883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb281066a0 0x7ffb28106a80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/4159775883 >> 172.21.15.42:0/4159775883 conn(0x7ffb280769d0 msgr2=0x7ffb28076de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/4159775883 shutdown_connections 2024-03-31T23:20:10.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/4159775883 wait complete. 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 Processor -- start 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.642+0000 7ffb2ed6c640 1 -- start start 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 0x7ffb28196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb28100fc0 0x7ffb28197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb281066a0 0x7ffb2819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110af0 con 0x7ffb28100600 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110970 con 0x7ffb281066a0 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110c70 con 0x7ffb28100fc0 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 0x7ffb28196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 0x7ffb28196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34578/0 (socket says 172.21.15.42:34578) 2024-03-31T23:20:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 -- 172.21.15.42:0/2767035406 learned_addr learned my addr 172.21.15.42:0/2767035406 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2d309640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb281066a0 0x7ffb2819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb27fff640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb28100fc0 0x7ffb28197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 -- 172.21.15.42:0/2767035406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb28100fc0 msgr2=0x7ffb28197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb28100fc0 0x7ffb28197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 -- 172.21.15.42:0/2767035406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb281066a0 msgr2=0x7ffb2819b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb281066a0 0x7ffb2819b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 -- 172.21.15.42:0/2767035406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2819bf90 con 0x7ffb28100600 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 0x7ffb28196ff0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009230 tx=0x7ffb1c02dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb25ffb640 1 -- 172.21.15.42:0/2767035406 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c043020 con 0x7ffb28100600 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2819c220 con 0x7ffb28100600 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.643+0000 7ffb25ffb640 1 -- 172.21.15.42:0/2767035406 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb1c004e50 con 0x7ffb28100600 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.644+0000 7ffb25ffb640 1 -- 172.21.15.42:0/2767035406 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c003a10 con 0x7ffb28100600 2024-03-31T23:20:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.644+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281a3b10 con 0x7ffb28100600 2024-03-31T23:20:10.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb25ffb640 1 -- 172.21.15.42:0/2767035406 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7ffb1c046020 con 0x7ffb28100600 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 Processor -- start 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 -- start start 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb25ffb640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ffb180a2610 0x7ffb180a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 0x555e7d66f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66f620 0x555e7d67a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555e7d5d3180 con 0x555e7d67a9a0 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x555e7d57bb70 con 0x555e7d66ec70 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555e7d5cf220 con 0x555e7d66f620 2024-03-31T23:20:10.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb2d309640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ffb180a2610 0x7ffb180a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb25ffb640 1 -- 172.21.15.42:0/2767035406 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ffb1c0f0cf0 con 0x7ffb28100600 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.646+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 0x555e7d66f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2d309640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 0x555e7d66f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41756/0 (socket says 172.21.15.42:41756) 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4251384743 learned_addr learned my addr 172.21.15.42:0/4251384743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66f620 0x555e7d67a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4251384743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66f620 msgr2=0x555e7d67a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66f620 0x555e7d67a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4251384743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 msgr2=0x555e7d67cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4251384743 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e7d58f7c0 con 0x555e7d66ec70 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 0x555e7d66f050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0b9be0 tx=0x7ffb1c03cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85baa85b2c5ada0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb2d309640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ffb180a2610 0x7ffb180a4ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x555e7d66ade0 tx=0x7ffb20009bf0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb12ffd640 1 -- 172.21.15.42:0/4251384743 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0bd910 con 0x555e7d66ec70 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb12ffd640 1 -- 172.21.15.42:0/4251384743 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb1c0071c0 con 0x555e7d66ec70 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.647+0000 7ffb12ffd640 1 -- 172.21.15.42:0/4251384743 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0c1360 con 0x555e7d66ec70 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4251384743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 msgr2=0x555e7d66f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 0x555e7d66f050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0b9be0 tx=0x7ffb1c03cf40 comp rx=0 tx=0).stop 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4251384743 shutdown_connections 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66f620 0x555e7d67a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4251384743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66ec70 0x555e7d66f050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4251384743 >> 172.21.15.42:0/4251384743 conn(0x555e7d6699c0 msgr2=0x555e7d669da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4251384743 shutdown_connections 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4251384743 wait complete. 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 -- start start 2024-03-31T23:20:10.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.648+0000 7ffb31a2e740 1 Processor -- start 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 0x555e7d6779a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d677ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d67a9a0 0x555e7d678420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555e7d67d520 con 0x555e7d66ec70 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x555e7d5714a0 con 0x555e7d66f620 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555e7d67d6a0 con 0x555e7d67a9a0 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb31a2e740 10 client.0 _ll_register_callbacks cb 0x555e7d574d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 0x555e7d6779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 0x555e7d6779a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34590/0 (socket says 172.21.15.42:34590) 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d677ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4099304672 learned_addr learned my addr 172.21.15.42:0/4099304672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2d309640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d67a9a0 0x555e7d678420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4099304672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d67a9a0 msgr2=0x555e7d678420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d67a9a0 0x555e7d678420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 msgr2=0x555e7d677ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d677ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 -- 172.21.15.42:0/4099304672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e7d3b17d0 con 0x555e7d66ec70 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb27fff640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d677ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 0x555e7d6779a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0bcf10 tx=0x7ffb1c031fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38559be11783ef1f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb07fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.649+0000 7ffb07fff640 1 -- 172.21.15.42:0/4099304672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0ee560 con 0x555e7d66ec70 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb07fff640 1 -- 172.21.15.42:0/4099304672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ffb1c0db800 con 0x555e7d66ec70 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb1c0071c0 con 0x555e7d66ec70 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb07fff640 1 -- 172.21.15.42:0/4099304672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffb1c031b70 con 0x555e7d66ec70 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 10 client.16395 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:10.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555e7d2e73f0 con 0x555e7d66ec70 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb07fff640 1 -- 172.21.15.42:0/4099304672 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb1c0071c0 con 0x555e7d66ec70 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb07fff640 1 -- 172.21.15.42:0/4099304672 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7ffb1c0a3020 con 0x555e7d66ec70 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 10 client.16395 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 20 client.16395 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d68a8c0 0x555e7d68ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 4 client.16395 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e7d5e06c0 con 0x555e7d68a8c0 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.650+0000 7ffb27fff640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d68a8c0 0x555e7d68ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb27fff640 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d68a8c0 0x555e7d68ccb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c91e5b54ab95a75 server_cookie=1d08852dc09d68bb in_seq=0 out_seq=0 2024-03-31T23:20:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb07fff640 10 client.16395 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb07fff640 1 -- 172.21.15.42:0/4099304672 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555e7d5e06c0 con 0x555e7d68a8c0 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb07fff640 10 client.16395 handle_command_reply: tid=0 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 client.16395 shutdown 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 msgr2=0x555e7d6779a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 0x555e7d6779a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0bcf10 tx=0x7ffb1c031fd0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 shutdown_connections 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d68a8c0 0x555e7d68ccb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d67a9a0 0x555e7d678420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d677ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/4099304672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d66ec70 0x555e7d6779a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb07fff640 0 client.16395 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.651+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 >> 172.21.15.42:0/4099304672 conn(0x555e7d6699c0 msgr2=0x555e7d66b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.652+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 shutdown_connections 2024-03-31T23:20:10.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.652+0000 7ffb31a2e740 1 -- 172.21.15.42:0/4099304672 wait complete. 2024-03-31T23:20:10.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.652+0000 7ffb31a2e740 20 client.16395 trim_cache size 0 max 16384 2024-03-31T23:20:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.669+0000 7ffb31a2e740 1 Processor -- start 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.669+0000 7ffb31a2e740 1 -- start start 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d67a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d6862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d668aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281aca90 con 0x555e7d67a9a0 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ae690 con 0x555e7d66f620 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ad160 con 0x555e7d66ec70 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d668aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d668aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34594/0 (socket says 172.21.15.42:34594) 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 -- 172.21.15.42:0/2518843164 learned_addr learned my addr 172.21.15.42:0/2518843164 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb27fff640 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d6862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d67a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 -- 172.21.15.42:0/2518843164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 msgr2=0x555e7d67a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d67a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 -- 172.21.15.42:0/2518843164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 msgr2=0x555e7d6862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d6862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 -- 172.21.15.42:0/2518843164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e7d2a70f0 con 0x555e7d67a9a0 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb27fff640 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d6862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb2d309640 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d668aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000fdc0 tx=0x7ffb20009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4c3a49dbde7d15 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb127fc640 1 -- 172.21.15.42:0/2518843164 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000fdf0 con 0x555e7d67a9a0 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb127fc640 1 -- 172.21.15.42:0/2518843164 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb20004b20 con 0x555e7d67a9a0 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.670+0000 7ffb127fc640 1 -- 172.21.15.42:0/2518843164 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20029690 con 0x555e7d67a9a0 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 -- 172.21.15.42:0/2518843164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 msgr2=0x555e7d668aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d668aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000fdc0 tx=0x7ffb20009500 comp rx=0 tx=0).stop 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 -- 172.21.15.42:0/2518843164 shutdown_connections 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d668aa0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d6862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/2518843164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d67a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 -- 172.21.15.42:0/2518843164 >> 172.21.15.42:0/2518843164 conn(0x555e7d6699c0 msgr2=0x555e7d668390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 -- 172.21.15.42:0/2518843164 shutdown_connections 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 -- 172.21.15.42:0/2518843164 wait complete. 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 -- start start 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.671+0000 7ffb31a2e740 1 Processor -- start 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d682d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d67e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281adf00 con 0x555e7d67a9a0 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ad830 con 0x555e7d66f620 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281aaa50 con 0x555e7d66ec70 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb31a2e740 10 client.0 _ll_register_callbacks cb 0x7ffb20009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d67e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34600/0 (socket says 172.21.15.42:34600) 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2cb08640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d682d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 -- 172.21.15.42:0/1444385144 learned_addr learned my addr 172.21.15.42:0/1444385144 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 -- 172.21.15.42:0/1444385144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 msgr2=0x555e7d682d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d682d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 -- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 msgr2=0x555e7d67e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:10.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d67e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 -- 172.21.15.42:0/1444385144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e7d6efb70 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb27fff640 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d67e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb2d309640 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67e7c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb2002b040 tx=0x7ffb20005190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2231577f2246732 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.672+0000 7ffb07fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb07fff640 1 -- 172.21.15.42:0/1444385144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200059d0 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb07fff640 1 -- 172.21.15.42:0/1444385144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ffb20033430 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb20004b20 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb07fff640 1 -- 172.21.15.42:0/1444385144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffb20033630 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 10 client.16401 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555e7d6f0d20 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb07fff640 1 -- 172.21.15.42:0/1444385144 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb20004b20 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb07fff640 1 -- 172.21.15.42:0/1444385144 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7ffb20032070 con 0x555e7d67a9a0 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 10 client.16401 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:10.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 20 client.16401 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d6f14f0 0x555e7d6f3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 4 client.16401 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555e7d5daa10 con 0x555e7d6f14f0 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.673+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d6f14f0 0x555e7d6f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb2cb08640 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d6f14f0 0x555e7d6f3910 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffd0d62d4ffb0a31 server_cookie=fe1afb014242ad1 in_seq=0 out_seq=0 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb07fff640 10 client.16401 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb07fff640 1 -- 172.21.15.42:0/1444385144 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555e7d5daa10 con 0x555e7d6f14f0 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb07fff640 10 client.16401 handle_command_reply: tid=0 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 client.16401 shutdown 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 msgr2=0x555e7d67e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67e7c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb2002b040 tx=0x7ffb20005190 comp rx=0 tx=0).stop 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 shutdown_connections 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x555e7d6f14f0 0x555e7d6f3910 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e7d67a9a0 0x555e7d67e7c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x555e7d66f620 0x555e7d67e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb07fff640 0 client.16401 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 --2- 172.21.15.42:0/1444385144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555e7d66ec70 0x555e7d682d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 >> 172.21.15.42:0/1444385144 conn(0x555e7d6699c0 msgr2=0x555e7d6781d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 shutdown_connections 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 1 -- 172.21.15.42:0/1444385144 wait complete. 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.674+0000 7ffb31a2e740 20 client.16401 trim_cache size 0 max 16384 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:20:10.682 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-03-31T23:20:10.683 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-03-31T23:20:10.683 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:20:10.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ffb180a2610 msgr2=0x7ffb180a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ffb180a2610 0x7ffb180a4ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x555e7d66ade0 tx=0x7ffb20009bf0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 msgr2=0x7ffb28196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 0x7ffb28196ff0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009230 tx=0x7ffb1c02dbf0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 shutdown_connections 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb281066a0 0x7ffb2819b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb28100fc0 0x7ffb28197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ffb180a2610 0x7ffb180a4ad0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 --2- 172.21.15.42:0/2767035406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb28100600 0x7ffb28196ff0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 >> 172.21.15.42:0/2767035406 conn(0x7ffb280769d0 msgr2=0x7ffb280feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 shutdown_connections 2024-03-31T23:20:10.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.675+0000 7ffb2ed6c640 1 -- 172.21.15.42:0/2767035406 wait complete. 2024-03-31T23:20:10.686 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-31T23:20:10.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:20:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 -- 172.21.15.42:0/331070419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934106660 msgr2=0x7f2934106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 --2- 172.21.15.42:0/331070419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934106660 0x7f2934106a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2928009930 tx=0x7f292802bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 -- 172.21.15.42:0/331070419 shutdown_connections 2024-03-31T23:20:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 --2- 172.21.15.42:0/331070419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2934101010 0x7f293410d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 --2- 172.21.15.42:0/331070419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2934100650 0x7f2934100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 --2- 172.21.15.42:0/331070419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934106660 0x7f2934106a40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 -- 172.21.15.42:0/331070419 >> 172.21.15.42:0/331070419 conn(0x7f2934077750 msgr2=0x7f2934077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 -- 172.21.15.42:0/331070419 shutdown_connections 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.790+0000 7f293a82e640 1 -- 172.21.15.42:0/331070419 wait complete. 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 Processor -- start 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 -- start start 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 0x7f2934198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2934101010 0x7f2934198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2934106660 0x7f293419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2934110b40 con 0x7f2934100650 2024-03-31T23:20:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29341109c0 con 0x7f2934101010 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f293a82e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2934110cc0 con 0x7f2934106660 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f2933fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 0x7f2934198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f2933fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 0x7f2934198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34612/0 (socket says 172.21.15.42:34612) 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f2933fff640 1 -- 172.21.15.42:0/2328103605 learned_addr learned my addr 172.21.15.42:0/2328103605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f2938dcb640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2934106660 0x7f293419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.791+0000 7f29337fe640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2934101010 0x7f2934198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f2933fff640 1 -- 172.21.15.42:0/2328103605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2934106660 msgr2=0x7f293419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f2933fff640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2934106660 0x7f293419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f2933fff640 1 -- 172.21.15.42:0/2328103605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2934101010 msgr2=0x7f2934198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f2933fff640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2934101010 0x7f2934198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f2933fff640 1 -- 172.21.15.42:0/2328103605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293419d130 con 0x7f2934100650 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f2933fff640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 0x7f2934198140 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2928009230 tx=0x7f292802dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928043020 con 0x7f2934100650 2024-03-31T23:20:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293419d3c0 con 0x7f2934100650 2024-03-31T23:20:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2928004250 con 0x7f2934100650 2024-03-31T23:20:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928003970 con 0x7f2934100650 2024-03-31T23:20:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.792+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29341a4cb0 con 0x7f2934100650 2024-03-31T23:20:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.793+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2934068540 con 0x7f2934100650 2024-03-31T23:20:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.794+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f2928046020 con 0x7f2934100650 2024-03-31T23:20:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.795+0000 7f29317fa640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f291c0a2610 0x7f291c0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.795+0000 7f29337fe640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f291c0a2610 0x7f291c0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.795+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f29280f1140 con 0x7f2934100650 2024-03-31T23:20:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.795+0000 7f29337fe640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f291c0a2610 0x7f291c0a4ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2934069990 tx=0x7f2924005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:10.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:10.799+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f292804d020 con 0x7f2934100650 2024-03-31T23:20:11.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.025+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29341a4f40 con 0x7f2934100650 2024-03-31T23:20:11.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.026+0000 7f29317fa640 1 -- 172.21.15.42:0/2328103605 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11930 (secure 0 0 0) 0x7f29280bdd20 con 0x7f2934100650 2024-03-31T23:20:11.027 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:20:11.027 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:19:53.699108+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24454,24442,24464,24497,24472]},"id":1}]} 2024-03-31T23:20:11.027 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f291c0a2610 msgr2=0x7f291c0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f291c0a2610 0x7f291c0a4ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2934069990 tx=0x7f2924005f90 comp rx=0 tx=0).stop 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 msgr2=0x7f2934198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 0x7f2934198140 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2928009230 tx=0x7f292802dc90 comp rx=0 tx=0).stop 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 shutdown_connections 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2934106660 0x7f293419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2934101010 0x7f2934198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f291c0a2610 0x7f291c0a4ad0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 --2- 172.21.15.42:0/2328103605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2934100650 0x7f2934198140 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 >> 172.21.15.42:0/2328103605 conn(0x7f2934077750 msgr2=0x7f29340ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 shutdown_connections 2024-03-31T23:20:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.028+0000 7f293a82e640 1 -- 172.21.15.42:0/2328103605 wait complete. 2024-03-31T23:20:11.039 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-31T23:20:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 -- 172.21.15.42:0/1070336341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63181066a0 msgr2=0x7f6318106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 --2- 172.21.15.42:0/1070336341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63181066a0 0x7f6318106a80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6308009930 tx=0x7f630802bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 -- 172.21.15.42:0/1070336341 shutdown_connections 2024-03-31T23:20:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 --2- 172.21.15.42:0/1070336341 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100fc0 0x7f631810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 --2- 172.21.15.42:0/1070336341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6318100600 0x7f6318100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 --2- 172.21.15.42:0/1070336341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63181066a0 0x7f6318106a80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 -- 172.21.15.42:0/1070336341 >> 172.21.15.42:0/1070336341 conn(0x7f63180769d0 msgr2=0x7f6318076de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 -- 172.21.15.42:0/1070336341 shutdown_connections 2024-03-31T23:20:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.145+0000 7f631d43b640 1 -- 172.21.15.42:0/1070336341 wait complete. 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 Processor -- start 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 -- start start 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 0x7f6318198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 0x7f6318199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63181066a0 0x7f63181a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6318110af0 con 0x7f6318100fc0 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6318110970 con 0x7f6318100600 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f631d43b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6318110c70 con 0x7f63181066a0 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f63167fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 0x7f6318199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.146+0000 7f6316ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 0x7f6318198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63177fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63181066a0 0x7f63181a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f6316ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 0x7f6318198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41816/0 (socket says 172.21.15.42:41816) 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 0x7f6318199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34636/0 (socket says 172.21.15.42:34636) 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f6316ffd640 1 -- 172.21.15.42:0/568494799 learned_addr learned my addr 172.21.15.42:0/568494799 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 -- 172.21.15.42:0/568494799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63181066a0 msgr2=0x7f63181a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63181066a0 0x7f63181a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 -- 172.21.15.42:0/568494799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 msgr2=0x7f6318198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 0x7f6318198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 -- 172.21.15.42:0/568494799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63181a4490 con 0x7f6318100fc0 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f6316ffd640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 0x7f6318198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63177fe640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63181066a0 0x7f63181a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f63167fc640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 0x7f6318199410 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f630c00e9f0 tx=0x7f630c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f62fffff640 1 -- 172.21.15.42:0/568494799 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c00ccc0 con 0x7f6318100fc0 2024-03-31T23:20:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63181a4660 con 0x7f6318100fc0 2024-03-31T23:20:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f62fffff640 1 -- 172.21.15.42:0/568494799 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f630c005020 con 0x7f6318100fc0 2024-03-31T23:20:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f62fffff640 1 -- 172.21.15.42:0/568494799 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c004b40 con 0x7f6318100fc0 2024-03-31T23:20:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.147+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63181a4b60 con 0x7f6318100fc0 2024-03-31T23:20:11.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.149+0000 7f62fffff640 1 -- 172.21.15.42:0/568494799 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f630c004ce0 con 0x7f6318100fc0 2024-03-31T23:20:11.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 Processor -- start 2024-03-31T23:20:11.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f62fffff640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f63000a2610 0x7f63000a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 -- start start 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f62fffff640 1 -- 172.21.15.42:0/568494799 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f630c0cee40 con 0x7f6318100fc0 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f63177fe640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f63000a2610 0x7f63000a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 0x5606988e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3d90 0x5606988ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988eed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5606988471b0 con 0x5606988e3470 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5606987efc00 con 0x5606988e3d90 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6320017740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560698843250 con 0x5606988ec970 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 0x5606988e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 0x5606988e3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34650/0 (socket says 172.21.15.42:34650) 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 -- 172.21.15.42:0/1078432500 learned_addr learned my addr 172.21.15.42:0/1078432500 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f63167fc640 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3d90 0x5606988ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f63177fe640 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 -- 172.21.15.42:0/1078432500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 msgr2=0x5606988eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 -- 172.21.15.42:0/1078432500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3d90 msgr2=0x5606988ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3d90 0x5606988ec430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f6316ffd640 1 -- 172.21.15.42:0/1078432500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069880f3d0 con 0x5606988e3470 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.150+0000 7f63177fe640 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f63177fe640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f63000a2610 0x7f63000a4ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6310009fd0 tx=0x7f6310011b20 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 0x5606988e3850 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6308036040 tx=0x7f630802c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01ed506efef8efe server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f62fd7fa640 1 -- 172.21.15.42:0/1078432500 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308043070 con 0x5606988e3470 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f62fd7fa640 1 -- 172.21.15.42:0/1078432500 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f630802c790 con 0x5606988e3470 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f62fd7fa640 1 -- 172.21.15.42:0/1078432500 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308003af0 con 0x5606988e3470 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 -- 172.21.15.42:0/1078432500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 msgr2=0x5606988e3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 0x5606988e3850 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6308036040 tx=0x7f630802c5f0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 -- 172.21.15.42:0/1078432500 shutdown_connections 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3d90 0x5606988ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 --2- 172.21.15.42:0/1078432500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3470 0x5606988e3850 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.151+0000 7f6320017740 1 -- 172.21.15.42:0/1078432500 >> 172.21.15.42:0/1078432500 conn(0x5606988ddba0 msgr2=0x5606988ddf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 -- 172.21.15.42:0/1078432500 shutdown_connections 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 -- 172.21.15.42:0/1078432500 wait complete. 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 -- start start 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 Processor -- start 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3d90 0x5606988e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 0x5606988ea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5606988ef700 con 0x5606988ec970 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5606987e5470 con 0x5606988e3470 2024-03-31T23:20:11.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5606988ef880 con 0x5606988e3d90 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6320017740 10 client.0 _ll_register_callbacks cb 0x560698802cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 0x5606988ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f6316ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63167fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3d90 0x5606988e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 0x5606988ea440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34664/0 (socket says 172.21.15.42:34664) 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 -- 172.21.15.42:0/1873657693 learned_addr learned my addr 172.21.15.42:0/1873657693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 -- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3d90 msgr2=0x5606988e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3d90 0x5606988e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 -- 172.21.15.42:0/1873657693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 msgr2=0x5606988e99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.152+0000 7f63177fe640 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f63177fe640 1 -- 172.21.15.42:0/1873657693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069855b3f0 con 0x5606988ec970 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f63177fe640 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 0x5606988ea440 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6310003b60 tx=0x7f6310004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b184cb3c48016c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f62faff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f62faff5640 1 -- 172.21.15.42:0/1873657693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310024070 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f62faff5640 1 -- 172.21.15.42:0/1873657693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f6310020640 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630802c790 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f62faff5640 1 -- 172.21.15.42:0/1873657693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6310030050 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 10 client.16419 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5606986257d0 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f62faff5640 1 -- 172.21.15.42:0/1873657693 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f630802c790 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f62faff5640 1 -- 172.21.15.42:0/1873657693 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f6310028980 con 0x5606988ec970 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 10 client.16419 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 10 client.16419 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 20 client.16419 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x5606988fc890 0x5606988fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 4 client.16419 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.153+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606988546f0 con 0x5606988fc890 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.154+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x5606988fc890 0x5606988fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.154+0000 7f62faff5640 10 client.16419 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.154+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x5606988fc890 0x5606988fed00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=955c8d2208fb9694 server_cookie=a47c004a8000eaf2 in_seq=0 out_seq=0 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f62faff5640 1 -- 172.21.15.42:0/1873657693 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5606988546f0 con 0x5606988fc890 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f62faff5640 10 client.16419 handle_command_reply: tid=0 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 client.16419 shutdown 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 msgr2=0x5606988ea440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 0x5606988ea440 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6310003b60 tx=0x7f6310004ab0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 shutdown_connections 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x5606988fc890 0x5606988fed00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988ec970 0x5606988ea440 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3d90 0x5606988e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f62faff5640 0 client.16419 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 --2- 172.21.15.42:0/1873657693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 >> 172.21.15.42:0/1873657693 conn(0x5606988ddba0 msgr2=0x5606988df8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 shutdown_connections 2024-03-31T23:20:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 1 -- 172.21.15.42:0/1873657693 wait complete. 2024-03-31T23:20:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.155+0000 7f6320017740 20 client.16419 trim_cache size 0 max 16384 2024-03-31T23:20:11.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 Processor -- start 2024-03-31T23:20:11.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 -- start start 2024-03-31T23:20:11.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3470 0x5606988ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988ec970 0x5606989045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63181aebf0 con 0x5606988e3d90 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f63181b07f0 con 0x5606988ec970 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6320017740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63181af2c0 con 0x5606988e3470 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988f84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34680/0 (socket says 172.21.15.42:34680) 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 -- 172.21.15.42:0/3201488191 learned_addr learned my addr 172.21.15.42:0/3201488191 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63177fe640 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988ec970 0x5606989045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f6316ffd640 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3470 0x5606988ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 -- 172.21.15.42:0/3201488191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3470 msgr2=0x5606988ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3470 0x5606988ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 -- 172.21.15.42:0/3201488191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988ec970 msgr2=0x5606989045d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988ec970 0x5606989045d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.168+0000 7f63167fc640 1 -- 172.21.15.42:0/3201488191 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606988e3bc0 con 0x5606988e3d90 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f63167fc640 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988f84a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cc280 tx=0x7f630c0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4aaf901b7122b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f62fcff9640 1 -- 172.21.15.42:0/3201488191 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c01c040 con 0x5606988e3d90 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f62fcff9640 1 -- 172.21.15.42:0/3201488191 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f630c0bb0c0 con 0x5606988e3d90 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f62fcff9640 1 -- 172.21.15.42:0/3201488191 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0051d0 con 0x5606988e3d90 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 -- 172.21.15.42:0/3201488191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 msgr2=0x5606988f84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988f84a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cc280 tx=0x7f630c0096e0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 -- 172.21.15.42:0/3201488191 shutdown_connections 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988ec970 0x5606989045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988f84a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 --2- 172.21.15.42:0/3201488191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988e3470 0x5606988ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 -- 172.21.15.42:0/3201488191 >> 172.21.15.42:0/3201488191 conn(0x5606988ddba0 msgr2=0x5606988dcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 -- 172.21.15.42:0/3201488191 shutdown_connections 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.169+0000 7f6320017740 1 -- 172.21.15.42:0/3201488191 wait complete. 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 -- start start 2024-03-31T23:20:11.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 Processor -- start 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63181b0060 con 0x5606988e3d90 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f63181af990 con 0x5606988e3470 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63181acbb0 con 0x5606988ec970 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6320017740 10 client.0 _ll_register_callbacks cb 0x7f6310003a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6316ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988e69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34682/0 (socket says 172.21.15.42:34682) 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 -- 172.21.15.42:0/1091127551 learned_addr learned my addr 172.21.15.42:0/1091127551 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63177fe640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 -- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 msgr2=0x5606988e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 -- 172.21.15.42:0/1091127551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 msgr2=0x5606988e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f63167fc640 1 -- 172.21.15.42:0/1091127551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560698961c00 con 0x5606988e3d90 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.170+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f63167fc640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988e69a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f630c09af50 tx=0x7f630c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136390868dbcefeb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f62faff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f62faff5640 1 -- 172.21.15.42:0/1091127551 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c07d070 con 0x5606988e3d90 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f62faff5640 1 -- 172.21.15.42:0/1091127551 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f630c0053d0 con 0x5606988e3d90 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630c0bb0c0 con 0x5606988e3d90 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f62faff5640 1 -- 172.21.15.42:0/1091127551 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f630c01c040 con 0x5606988e3d90 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 10 client.16425 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560698962de0 con 0x5606988e3d90 2024-03-31T23:20:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f62faff5640 1 -- 172.21.15.42:0/1091127551 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f630c0bb0c0 con 0x5606988e3d90 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f62faff5640 1 -- 172.21.15.42:0/1091127551 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f630c09a7a0 con 0x5606988e3d90 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 10 client.16425 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 10 client.16425 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 20 client.16425 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x560698963440 0x560698965860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 4 client.16425 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56069884ea40 con 0x560698963440 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.171+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x560698963440 0x560698965860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f62faff5640 10 client.16425 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6316ffd640 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x560698963440 0x560698965860 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ac2de4314113787 server_cookie=e1b7882529bc035c in_seq=0 out_seq=0 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f62faff5640 1 -- 172.21.15.42:0/1091127551 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56069884ea40 con 0x560698963440 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f62faff5640 10 client.16425 handle_command_reply: tid=0 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 client.16425 shutdown 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 msgr2=0x5606988e69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988e69a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f630c09af50 tx=0x7f630c009f60 comp rx=0 tx=0).stop 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 shutdown_connections 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606988ec970 0x5606988e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x560698963440 0x560698965860 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606988e3d90 0x5606988e69a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 --2- 172.21.15.42:0/1091127551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5606988e3470 0x5606988e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f62faff5640 0 client.16425 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 >> 172.21.15.42:0/1091127551 conn(0x5606988ddba0 msgr2=0x5606988deea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 shutdown_connections 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 1 -- 172.21.15.42:0/1091127551 wait complete. 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.172+0000 7f6320017740 20 client.16425 trim_cache size 0 max 16384 2024-03-31T23:20:11.180 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:20:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f63000a2610 msgr2=0x7f63000a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f63000a2610 0x7f63000a4ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6310009fd0 tx=0x7f6310011b20 comp rx=0 tx=0).stop 2024-03-31T23:20:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 msgr2=0x7f6318199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 0x7f6318199410 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f630c00e9f0 tx=0x7f630c00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 shutdown_connections 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63181066a0 0x7f63181a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f63000a2610 0x7f63000a4ad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318100fc0 0x7f6318199410 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 --2- 172.21.15.42:0/568494799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6318100600 0x7f6318198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 >> 172.21.15.42:0/568494799 conn(0x7f63180769d0 msgr2=0x7f63180fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 shutdown_connections 2024-03-31T23:20:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.173+0000 7f631d43b640 1 -- 172.21.15.42:0/568494799 wait complete. 2024-03-31T23:20:11.184 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-31T23:20:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 -- 172.21.15.42:0/650355337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 msgr2=0x7f62c8100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 --2- 172.21.15.42:0/650355337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8100a40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009930 tx=0x7f62b802bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 -- 172.21.15.42:0/650355337 shutdown_connections 2024-03-31T23:20:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 --2- 172.21.15.42:0/650355337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62c8100f80 0x7f62c810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 --2- 172.21.15.42:0/650355337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8100a40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 --2- 172.21.15.42:0/650355337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62c8106660 0x7f62c8106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 -- 172.21.15.42:0/650355337 >> 172.21.15.42:0/650355337 conn(0x7f62c8077750 msgr2=0x7f62c8077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 -- 172.21.15.42:0/650355337 shutdown_connections 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.291+0000 7f62d04cd640 1 -- 172.21.15.42:0/650355337 wait complete. 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 Processor -- start 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 -- start start 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62c8100f80 0x7f62c8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62c8106660 0x7f62c819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62c8110ab0 con 0x7f62c81005c0 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62c8110930 con 0x7f62c8100f80 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62d04cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62c8110c30 con 0x7f62c8106660 2024-03-31T23:20:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34696/0 (socket says 172.21.15.42:34696) 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 -- 172.21.15.42:0/2431542538 learned_addr learned my addr 172.21.15.42:0/2431542538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62cea6a640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62c8106660 0x7f62c819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62cda68640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62c8100f80 0x7f62c8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 -- 172.21.15.42:0/2431542538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62c8106660 msgr2=0x7f62c819c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62c8106660 0x7f62c819c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 -- 172.21.15.42:0/2431542538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62c8100f80 msgr2=0x7f62c8198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62c8100f80 0x7f62c8198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 -- 172.21.15.42:0/2431542538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c819d010 con 0x7f62c81005c0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.292+0000 7f62ce269640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8198020 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f62c400ebc0 tx=0x7f62c400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.293+0000 7f62bf7fe640 1 -- 172.21.15.42:0/2431542538 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4003b70 con 0x7f62c81005c0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.293+0000 7f62bf7fe640 1 -- 172.21.15.42:0/2431542538 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62c4003d10 con 0x7f62c81005c0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.293+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c819d300 con 0x7f62c81005c0 2024-03-31T23:20:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.293+0000 7f62bf7fe640 1 -- 172.21.15.42:0/2431542538 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4019980 con 0x7f62c81005c0 2024-03-31T23:20:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.293+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c81a4b90 con 0x7f62c81005c0 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.295+0000 7f62bf7fe640 1 -- 172.21.15.42:0/2431542538 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f62c4019b20 con 0x7f62c81005c0 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.295+0000 7f62d3194740 1 Processor -- start 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 -- start start 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62bf7fe640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f62b40a2610 0x7f62b40a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62bf7fe640 1 -- 172.21.15.42:0/2431542538 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f62c40cf750 con 0x7f62c81005c0 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62cea6a640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f62b40a2610 0x7f62b40a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac805840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac805d80 0x55b9ac808170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9ac75c1b0 con 0x55b9ac7f81a0 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b9ac704c00 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62d3194740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b9ac758250 con 0x55b9ac805d80 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34704/0 (socket says 172.21.15.42:34704) 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 -- 172.21.15.42:0/968337864 learned_addr learned my addr 172.21.15.42:0/968337864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62cea6a640 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac805d80 0x55b9ac808170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62cda68640 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac805840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 -- 172.21.15.42:0/968337864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac805d80 msgr2=0x55b9ac808170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac805d80 0x55b9ac808170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 -- 172.21.15.42:0/968337864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 msgr2=0x55b9ac805840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac805840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62ce269640 1 -- 172.21.15.42:0/968337864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ac7243d0 con 0x55b9ac7f81a0 2024-03-31T23:20:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.296+0000 7f62cea6a640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f62b40a2610 0x7f62b40a4ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62c0011440 tx=0x7f62c0011840 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62ce269640 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7f8580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f62c4098530 tx=0x7f62c409b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e3d7a97f3b816f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62bcbfe640 1 -- 172.21.15.42:0/968337864 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c409fcb0 con 0x55b9ac7f81a0 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62bcbfe640 1 -- 172.21.15.42:0/968337864 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62c40a4570 con 0x55b9ac7f81a0 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62bcbfe640 1 -- 172.21.15.42:0/968337864 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c40cf3a0 con 0x55b9ac7f81a0 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 -- 172.21.15.42:0/968337864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 msgr2=0x55b9ac7f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7f8580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f62c4098530 tx=0x7f62c409b580 comp rx=0 tx=0).stop 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 -- 172.21.15.42:0/968337864 shutdown_connections 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac805d80 0x55b9ac808170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac805840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 --2- 172.21.15.42:0/968337864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7f8580 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.297+0000 7f62d3194740 1 -- 172.21.15.42:0/968337864 >> 172.21.15.42:0/968337864 conn(0x55b9ac7f2ba0 msgr2=0x55b9ac7f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 -- 172.21.15.42:0/968337864 shutdown_connections 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 -- 172.21.15.42:0/968337864 wait complete. 2024-03-31T23:20:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 -- start start 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 Processor -- start 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f81a0 0x55b9ac802ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac8033e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac803920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9ac808b40 con 0x55b9ac805d80 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b9ac6fa470 con 0x55b9ac7f81a0 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b9ac808cc0 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62d3194740 10 client.0 _ll_register_callbacks cb 0x55b9ac717cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62cea6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac803920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62cda68640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac8033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62cea6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac803920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34710/0 (socket says 172.21.15.42:34710) 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62cea6a640 1 -- 172.21.15.42:0/2454349960 learned_addr learned my addr 172.21.15.42:0/2454349960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.298+0000 7f62ce269640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f81a0 0x55b9ac802ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cea6a640 1 -- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f8ac0 msgr2=0x55b9ac8033e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cea6a640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac8033e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cea6a640 1 -- 172.21.15.42:0/2454349960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f81a0 msgr2=0x55b9ac802ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cea6a640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f81a0 0x55b9ac802ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cea6a640 1 -- 172.21.15.42:0/2454349960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ac4703f0 con 0x55b9ac805d80 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cda68640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac8033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62cea6a640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac803920 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009b10 tx=0x7f62c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1925d09e1eafc4c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62b1ffb640 1 -- 172.21.15.42:0/2454349960 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c001a040 con 0x55b9ac805d80 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62b1ffb640 1 -- 172.21.15.42:0/2454349960 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f62c000fa70 con 0x55b9ac805d80 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62c40a4570 con 0x55b9ac805d80 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62b1ffb640 1 -- 172.21.15.42:0/2454349960 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f62c000fc70 con 0x55b9ac805d80 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 10 client.16437 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b9ac53a7d0 con 0x55b9ac805d80 2024-03-31T23:20:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62b1ffb640 1 -- 172.21.15.42:0/2454349960 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62c40a4570 con 0x55b9ac805d80 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62b1ffb640 1 -- 172.21.15.42:0/2454349960 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f62c001d030 con 0x55b9ac805d80 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 10 client.16437 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 10 client.16437 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 20 client.16437 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.299+0000 7f62d3194740 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac815f30 0x55b9ac818340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.300+0000 7f62d3194740 4 client.16437 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.300+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ac7696f0 con 0x55b9ac815f30 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.300+0000 7f62ce269640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac815f30 0x55b9ac818340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.300+0000 7f62ce269640 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac815f30 0x55b9ac818340 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4307802fb6c4a795 server_cookie=d455d0da4ab198f4 in_seq=0 out_seq=0 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.300+0000 7f62b1ffb640 10 client.16437 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62b1ffb640 1 -- 172.21.15.42:0/2454349960 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b9ac7696f0 con 0x55b9ac815f30 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62b1ffb640 10 client.16437 handle_command_reply: tid=0 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 client.16437 shutdown 2024-03-31T23:20:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 msgr2=0x55b9ac803920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac803920 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009b10 tx=0x7f62c0004730 comp rx=0 tx=0).stop 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 shutdown_connections 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac815f30 0x55b9ac818340 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac803920 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac8033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62b1ffb640 0 client.16437 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 --2- 172.21.15.42:0/2454349960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f81a0 0x55b9ac802ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 >> 172.21.15.42:0/2454349960 conn(0x55b9ac7f2ba0 msgr2=0x55b9ac7f48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 shutdown_connections 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 1 -- 172.21.15.42:0/2454349960 wait complete. 2024-03-31T23:20:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.301+0000 7f62d3194740 20 client.16437 trim_cache size 0 max 16384 2024-03-31T23:20:11.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 Processor -- start 2024-03-31T23:20:11.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 -- start start 2024-03-31T23:20:11.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac811920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac805d80 0x55b9ac81dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81aca20 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81ae620 con 0x55b9ac805d80 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.314+0000 7f62d3194740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81ad0f0 con 0x55b9ac7f81a0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62ce269640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac811920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34722/0 (socket says 172.21.15.42:34722) 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 -- 172.21.15.42:0/1560560065 learned_addr learned my addr 172.21.15.42:0/1560560065 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cea6a640 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac805d80 0x55b9ac81dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 -- 172.21.15.42:0/1560560065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 msgr2=0x55b9ac811920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac811920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 -- 172.21.15.42:0/1560560065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac805d80 msgr2=0x55b9ac81dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac805d80 0x55b9ac81dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 -- 172.21.15.42:0/1560560065 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ac811e60 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62cda68640 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7f46e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009930 tx=0x7f62b802da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200351d573d64ab4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62b3fff640 1 -- 172.21.15.42:0/1560560065 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b802dc00 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62b3fff640 1 -- 172.21.15.42:0/1560560065 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62b802dda0 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.315+0000 7f62b3fff640 1 -- 172.21.15.42:0/1560560065 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8004b80 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- 172.21.15.42:0/1560560065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 msgr2=0x55b9ac7f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7f46e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009930 tx=0x7f62b802da90 comp rx=0 tx=0).stop 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- 172.21.15.42:0/1560560065 shutdown_connections 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac805d80 0x55b9ac81dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7f46e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- 172.21.15.42:0/1560560065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac811920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- 172.21.15.42:0/1560560065 >> 172.21.15.42:0/1560560065 conn(0x55b9ac7f2ba0 msgr2=0x55b9ac7f3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- 172.21.15.42:0/1560560065 shutdown_connections 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- 172.21.15.42:0/1560560065 wait complete. 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- start start 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 Processor -- start 2024-03-31T23:20:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7ff970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac8003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81ade90 con 0x55b9ac805d80 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81ad7c0 con 0x55b9ac7f8ac0 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81aa9e0 con 0x55b9ac7f81a0 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.316+0000 7f62d3194740 10 client.0 _ll_register_callbacks cb 0x7f62c0004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cda68640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62ce269640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac8003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cda68640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7ffeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41900/0 (socket says 172.21.15.42:41900) 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cda68640 1 -- 172.21.15.42:0/301834168 learned_addr learned my addr 172.21.15.42:0/301834168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 -- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 msgr2=0x55b9ac7ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 -- 172.21.15.42:0/301834168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 msgr2=0x55b9ac7ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 -- 172.21.15.42:0/301834168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ac87b240 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cda68640 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62cea6a640 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac8003f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f62c0028400 tx=0x7f62c001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8834f9d67b2b52c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62b1ffb640 1 -- 172.21.15.42:0/301834168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c001a040 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62b1ffb640 1 -- 172.21.15.42:0/301834168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f62c0028c10 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b802dda0 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62b1ffb640 1 -- 172.21.15.42:0/301834168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f62c0044050 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62d3194740 10 client.16443 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.317+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b9ac87c4c0 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62b1ffb640 1 -- 172.21.15.42:0/301834168 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62b802dda0 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62b1ffb640 1 -- 172.21.15.42:0/301834168 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f62c001d050 con 0x55b9ac805d80 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62d3194740 10 client.16443 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62d3194740 10 client.16443 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62d3194740 20 client.16443 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62d3194740 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac87cc90 0x55b9ac87f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62d3194740 4 client.16443 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9ac763a40 con 0x55b9ac87cc90 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62ce269640 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac87cc90 0x55b9ac87f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62ce269640 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac87cc90 0x55b9ac87f0b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d80735a2a28b5833 server_cookie=2549c5870767d792 in_seq=0 out_seq=0 2024-03-31T23:20:11.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.318+0000 7f62b1ffb640 10 client.16443 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62b1ffb640 1 -- 172.21.15.42:0/301834168 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9ac763a40 con 0x55b9ac87cc90 2024-03-31T23:20:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62b1ffb640 10 client.16443 handle_command_reply: tid=0 2024-03-31T23:20:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 client.16443 shutdown 2024-03-31T23:20:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 msgr2=0x55b9ac8003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac8003f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f62c0028400 tx=0x7f62c001b000 comp rx=0 tx=0).stop 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 shutdown_connections 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x55b9ac87cc90 0x55b9ac87f0b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9ac805d80 0x55b9ac8003f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b9ac7f8ac0 0x55b9ac7ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62b1ffb640 0 client.16443 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 --2- 172.21.15.42:0/301834168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b9ac7f81a0 0x55b9ac7ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 >> 172.21.15.42:0/301834168 conn(0x55b9ac7f2ba0 msgr2=0x55b9ac801340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 shutdown_connections 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.322+0000 7f62d3194740 1 -- 172.21.15.42:0/301834168 wait complete. 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d3194740 20 client.16443 trim_cache size 0 max 16384 2024-03-31T23:20:11.326 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:20:11.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f62b40a2610 msgr2=0x7f62b40a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f62b40a2610 0x7f62b40a4ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62c0011440 tx=0x7f62c0011840 comp rx=0 tx=0).stop 2024-03-31T23:20:11.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 msgr2=0x7f62c8198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8198020 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f62c400ebc0 tx=0x7f62c400c6a0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 shutdown_connections 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62c8106660 0x7f62c819c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62c8100f80 0x7f62c8198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f62b40a2610 0x7f62b40a4ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 --2- 172.21.15.42:0/2431542538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62c81005c0 0x7f62c8198020 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 >> 172.21.15.42:0/2431542538 conn(0x7f62c8077750 msgr2=0x7f62c8104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 shutdown_connections 2024-03-31T23:20:11.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.323+0000 7f62d04cd640 1 -- 172.21.15.42:0/2431542538 wait complete. 2024-03-31T23:20:11.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-31T23:20:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 -- 172.21.15.42:0/523013069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef8006a8e0 msgr2=0x7fef80104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 --2- 172.21.15.42:0/523013069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef8006a8e0 0x7fef80104150 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef78009ca0 tx=0x7fef7802c100 comp rx=0 tx=0).stop 2024-03-31T23:20:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 -- 172.21.15.42:0/523013069 shutdown_connections 2024-03-31T23:20:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 --2- 172.21.15.42:0/523013069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef8006a8e0 0x7fef80104150 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 --2- 172.21.15.42:0/523013069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106ac0 0x7fef8006a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 --2- 172.21.15.42:0/523013069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef80106650 0x7fef80069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 -- 172.21.15.42:0/523013069 >> 172.21.15.42:0/523013069 conn(0x7fef80077630 msgr2=0x7fef80077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 -- 172.21.15.42:0/523013069 shutdown_connections 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.484+0000 7fef85ca4640 1 -- 172.21.15.42:0/523013069 wait complete. 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 Processor -- start 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 -- start start 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 0x7fef8019e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80106ac0 0x7fef8019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef801a2f20 0x7fef801a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef80118200 con 0x7fef80106ac0 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef80118080 con 0x7fef80106650 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.485+0000 7fef85ca4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef80118380 con 0x7fef801a2f20 2024-03-31T23:20:11.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 0x7fef8019e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 0x7fef8019e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41916/0 (socket says 172.21.15.42:41916) 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7f7fe640 1 -- 172.21.15.42:0/3631585883 learned_addr learned my addr 172.21.15.42:0/3631585883 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7effd640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80106ac0 0x7fef8019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7ffff640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef801a2f20 0x7fef801a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7effd640 1 -- 172.21.15.42:0/3631585883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef801a2f20 msgr2=0x7fef801a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7effd640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef801a2f20 0x7fef801a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7effd640 1 -- 172.21.15.42:0/3631585883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 msgr2=0x7fef8019e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7effd640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 0x7fef8019e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7effd640 1 -- 172.21.15.42:0/3631585883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef801a3a10 con 0x7fef80106ac0 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.486+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 0x7fef8019e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.487+0000 7fef7effd640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80106ac0 0x7fef8019eba0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fef7400e9f0 tx=0x7fef7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.487+0000 7fef7cff9640 1 -- 172.21.15.42:0/3631585883 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7400ccc0 con 0x7fef80106ac0 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.487+0000 7fef7cff9640 1 -- 172.21.15.42:0/3631585883 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef74010930 con 0x7fef80106ac0 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.487+0000 7fef7cff9640 1 -- 172.21.15.42:0/3631585883 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef740189f0 con 0x7fef80106ac0 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.487+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef801a3d00 con 0x7fef80106ac0 2024-03-31T23:20:11.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.487+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801ab4a0 con 0x7fef80106ac0 2024-03-31T23:20:11.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.491+0000 7fef7cff9640 1 -- 172.21.15.42:0/3631585883 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fef74018b90 con 0x7fef80106ac0 2024-03-31T23:20:11.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.491+0000 7fef7cff9640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef680a2760 0x7fef680a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.492+0000 7fef7cff9640 1 -- 172.21.15.42:0/3631585883 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fef740d00d0 con 0x7fef80106ac0 2024-03-31T23:20:11.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.492+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef680a2760 0x7fef680a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.492+0000 7fef88964740 1 Processor -- start 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 -- start start 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164c470 0x556c4164c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41655430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c41657d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556c415b01b0 con 0x556c4164cd90 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556c41558c00 con 0x556c41655970 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef88964740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556c415ac250 con 0x556c4164c470 2024-03-31T23:20:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef7ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c41657d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef7ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c41657d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41922/0 (socket says 172.21.15.42:41922) 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef7ffff640 1 -- 172.21.15.42:0/2920749534 learned_addr learned my addr 172.21.15.42:0/2920749534 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef7effd640 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41655430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef680a2760 0x7fef680a4c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fef700095f0 tx=0x7fef70005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.493+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164c470 0x556c4164c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.494+0000 7fef7effd640 1 -- 172.21.15.42:0/2920749534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164c470 msgr2=0x556c4164c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.494+0000 7fef7effd640 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164c470 0x556c4164c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.494+0000 7fef7effd640 1 -- 172.21.15.42:0/2920749534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 msgr2=0x556c41657d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.494+0000 7fef7effd640 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c41657d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.494+0000 7fef7effd640 1 -- 172.21.15.42:0/2920749534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c415783d0 con 0x556c4164cd90 2024-03-31T23:20:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.494+0000 7fef7effd640 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41655430 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fef740cd4b0 tx=0x7fef7409c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6dbb802aaaf3091 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.495+0000 7fef65ffb640 1 -- 172.21.15.42:0/2920749534 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef740a4ef0 con 0x556c4164cd90 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.495+0000 7fef65ffb640 1 -- 172.21.15.42:0/2920749534 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef740cd730 con 0x556c4164cd90 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.495+0000 7fef65ffb640 1 -- 172.21.15.42:0/2920749534 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef740bc2d0 con 0x556c4164cd90 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 -- 172.21.15.42:0/2920749534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 msgr2=0x556c41655430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41655430 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fef740cd4b0 tx=0x7fef7409c490 comp rx=0 tx=0).stop 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 -- 172.21.15.42:0/2920749534 shutdown_connections 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c41657d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41655430 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 --2- 172.21.15.42:0/2920749534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164c470 0x556c4164c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 -- 172.21.15.42:0/2920749534 >> 172.21.15.42:0/2920749534 conn(0x556c41646ba0 msgr2=0x556c41646f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 -- 172.21.15.42:0/2920749534 shutdown_connections 2024-03-31T23:20:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 -- 172.21.15.42:0/2920749534 wait complete. 2024-03-31T23:20:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.496+0000 7fef88964740 1 -- start start 2024-03-31T23:20:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 Processor -- start 2024-03-31T23:20:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41652a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41652f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c41655970 0x556c416534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556c41658760 con 0x556c4164cd90 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556c4154e470 con 0x556c4164c470 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556c416588e0 con 0x556c41655970 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41652a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef88964740 10 client.0 _ll_register_callbacks cb 0x556c4156bcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41652a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41938/0 (socket says 172.21.15.42:41938) 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef7f7fe640 1 -- 172.21.15.42:0/237487320 learned_addr learned my addr 172.21.15.42:0/237487320 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef7ffff640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c41655970 0x556c416534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef7effd640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41652f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.497+0000 7fef7f7fe640 1 -- 172.21.15.42:0/237487320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c41655970 msgr2=0x556c416534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c41655970 0x556c416534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef7f7fe640 1 -- 172.21.15.42:0/237487320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 msgr2=0x556c41652f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41652f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef7f7fe640 1 -- 172.21.15.42:0/237487320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c412c43f0 con 0x556c4164c470 2024-03-31T23:20:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41652a30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fef7000fbc0 tx=0x7fef70004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c924590dbe316f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef5effd640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef5effd640 1 -- 172.21.15.42:0/237487320 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70004030 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef5effd640 1 -- 172.21.15.42:0/237487320 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fef700041d0 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.498+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef740cd730 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef5effd640 1 -- 172.21.15.42:0/237487320 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fef70004410 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 10 client.26279 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556c4138e7d0 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef5effd640 1 -- 172.21.15.42:0/237487320 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef740cd730 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef5effd640 1 -- 172.21.15.42:0/237487320 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fef70003ce0 con 0x556c4164c470 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 10 client.26279 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 10 client.26279 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 20 client.26279 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c41665a70 0x556c41667ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 4 client.26279 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:11.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c415bd6f0 con 0x556c41665a70 2024-03-31T23:20:11.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.499+0000 7fef7effd640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c41665a70 0x556c41667ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.500+0000 7fef7effd640 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c41665a70 0x556c41667ea0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=610d4dd25caca07f server_cookie=13511a7c95ffb2f4 in_seq=0 out_seq=0 2024-03-31T23:20:11.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.500+0000 7fef5effd640 10 client.26279 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.500+0000 7fef5effd640 1 -- 172.21.15.42:0/237487320 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556c415bd6f0 con 0x556c41665a70 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.500+0000 7fef5effd640 10 client.26279 handle_command_reply: tid=0 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.500+0000 7fef88964740 1 client.26279 shutdown 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 msgr2=0x556c41652a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41652a30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fef7000fbc0 tx=0x7fef70004730 comp rx=0 tx=0).stop 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 shutdown_connections 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c41665a70 0x556c41667ea0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c41655970 0x556c416534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164cd90 0x556c41652f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 --2- 172.21.15.42:0/237487320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41652a30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef5effd640 0 client.26279 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 >> 172.21.15.42:0/237487320 conn(0x556c41646ba0 msgr2=0x556c416488f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 shutdown_connections 2024-03-31T23:20:11.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 1 -- 172.21.15.42:0/237487320 wait complete. 2024-03-31T23:20:11.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.501+0000 7fef88964740 20 client.26279 trim_cache size 0 max 16384 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 Processor -- start 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 -- start start 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41655160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c41661530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c41655970 0x556c41645bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c00ff60 con 0x556c41655970 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c011b60 con 0x556c4164c470 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef88964740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c010630 con 0x556c4164cd90 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41655160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41655160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:41950/0 (socket says 172.21.15.42:41950) 2024-03-31T23:20:11.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef7f7fe640 1 -- 172.21.15.42:0/2936384208 learned_addr learned my addr 172.21.15.42:0/2936384208 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef7ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c41655970 0x556c41645bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.514+0000 7fef7effd640 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c41661530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef7f7fe640 1 -- 172.21.15.42:0/2936384208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 msgr2=0x556c41661530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c41661530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef7f7fe640 1 -- 172.21.15.42:0/2936384208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c41655970 msgr2=0x556c41645bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c41655970 0x556c41645bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef7f7fe640 1 -- 172.21.15.42:0/2936384208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c41650fa0 con 0x556c4164c470 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41655160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fef70000c00 tx=0x7fef70009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4041a139287a0dfc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef657fa640 1 -- 172.21.15.42:0/2936384208 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7001c7e0 con 0x556c4164c470 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef657fa640 1 -- 172.21.15.42:0/2936384208 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef700256a0 con 0x556c4164c470 2024-03-31T23:20:11.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.515+0000 7fef657fa640 1 -- 172.21.15.42:0/2936384208 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7002f420 con 0x556c4164c470 2024-03-31T23:20:11.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 -- 172.21.15.42:0/2936384208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 msgr2=0x556c41655160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41655160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fef70000c00 tx=0x7fef70009540 comp rx=0 tx=0).stop 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 -- 172.21.15.42:0/2936384208 shutdown_connections 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c41655970 0x556c41645bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c41661530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 --2- 172.21.15.42:0/2936384208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c4164c470 0x556c41655160 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 -- 172.21.15.42:0/2936384208 >> 172.21.15.42:0/2936384208 conn(0x556c41646ba0 msgr2=0x556c416454b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 -- 172.21.15.42:0/2936384208 shutdown_connections 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 -- 172.21.15.42:0/2936384208 wait complete. 2024-03-31T23:20:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 -- start start 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.516+0000 7fef88964740 1 Processor -- start 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 0x556c4165db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c4165ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 0x556c4165db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 0x556c4165db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34776/0 (socket says 172.21.15.42:34776) 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 -- 172.21.15.42:0/612054776 learned_addr learned my addr 172.21.15.42:0/612054776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c4165b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c0113d0 con 0x556c4164c470 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c010d00 con 0x556c41655970 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c00df20 con 0x556c4164cd90 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 10 client.0 _ll_register_callbacks cb 0x7fef7000fa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7effd640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c4165ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7ffff640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c4165b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 -- 172.21.15.42:0/612054776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 msgr2=0x556c4165ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c4165ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 -- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 msgr2=0x556c4165b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c4165b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c4165e200 con 0x556c4164c470 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef7f7fe640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 0x556c4165db60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fef70025670 tx=0x7fef70014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72f1e46301fef09 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef5effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef5effd640 1 -- 172.21.15.42:0/612054776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70025d90 con 0x556c4164c470 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.517+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef700256a0 con 0x556c4164c470 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef5effd640 1 -- 172.21.15.42:0/612054776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fef70034070 con 0x556c4164c470 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef5effd640 1 -- 172.21.15.42:0/612054776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fef7001c7e0 con 0x556c4164c470 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 10 client.16461 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556c416cc830 con 0x556c4164c470 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef5effd640 1 -- 172.21.15.42:0/612054776 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef700256a0 con 0x556c4164c470 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef5effd640 1 -- 172.21.15.42:0/612054776 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fef70036070 con 0x556c4164c470 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 10 client.16461 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 10 client.16461 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 20 client.16461 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c416cced0 0x556c416cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 4 client.16461 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c415b7a40 con 0x556c416cced0 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.518+0000 7fef7effd640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c416cced0 0x556c416cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef5effd640 10 client.16461 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef7effd640 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c416cced0 0x556c416cf2f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d68357f5380152c server_cookie=3b7efbdaad969ea2 in_seq=0 out_seq=0 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef5effd640 1 -- 172.21.15.42:0/612054776 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c415b7a40 con 0x556c416cced0 2024-03-31T23:20:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef5effd640 10 client.16461 handle_command_reply: tid=0 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 client.16461 shutdown 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 msgr2=0x556c4165db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 0x556c4165db60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fef70025670 tx=0x7fef70014000 comp rx=0 tx=0).stop 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 shutdown_connections 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x556c416cced0 0x556c416cf2f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556c41655970 0x556c4165b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c4164cd90 0x556c4165ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 --2- 172.21.15.42:0/612054776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c4164c470 0x556c4165db60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 >> 172.21.15.42:0/612054776 conn(0x556c41646ba0 msgr2=0x556c41645d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef5effd640 0 client.16461 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 shutdown_connections 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 1 -- 172.21.15.42:0/612054776 wait complete. 2024-03-31T23:20:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.519+0000 7fef88964740 20 client.16461 trim_cache size 0 max 16384 2024-03-31T23:20:11.527 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef680a2760 msgr2=0x7fef680a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef680a2760 0x7fef680a4c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fef700095f0 tx=0x7fef70005f90 comp rx=0 tx=0).stop 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80106ac0 msgr2=0x7fef8019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80106ac0 0x7fef8019eba0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fef7400e9f0 tx=0x7fef7400eeb0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 shutdown_connections 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef801a2f20 0x7fef801a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef680a2760 0x7fef680a4c20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80106ac0 0x7fef8019eba0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 --2- 172.21.15.42:0/3631585883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef80106650 0x7fef8019e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 >> 172.21.15.42:0/3631585883 conn(0x7fef80077630 msgr2=0x7fef80103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 shutdown_connections 2024-03-31T23:20:11.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.520+0000 7fef85ca4640 1 -- 172.21.15.42:0/3631585883 wait complete. 2024-03-31T23:20:11.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-31T23:20:11.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 -- 172.21.15.42:0/3397659528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8000100fc0 msgr2=0x7f800010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 --2- 172.21.15.42:0/3397659528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8000100fc0 0x7f800010d4d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009cd0 tx=0x7f7ff802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 -- 172.21.15.42:0/3397659528 shutdown_connections 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 --2- 172.21.15.42:0/3397659528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8000100fc0 0x7f800010d4d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 --2- 172.21.15.42:0/3397659528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8000100600 0x7f8000100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 --2- 172.21.15.42:0/3397659528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80001066a0 0x7f8000106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.638+0000 7f80063dd640 1 -- 172.21.15.42:0/3397659528 >> 172.21.15.42:0/3397659528 conn(0x7f80000769d0 msgr2=0x7f8000076de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.639+0000 7f80063dd640 1 -- 172.21.15.42:0/3397659528 shutdown_connections 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.639+0000 7f80063dd640 1 -- 172.21.15.42:0/3397659528 wait complete. 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.639+0000 7f80063dd640 1 Processor -- start 2024-03-31T23:20:11.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.639+0000 7f80063dd640 1 -- start start 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.639+0000 7f80063dd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8000100600 0x7f80001980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8000100fc0 0x7f8000198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 0x7f800019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8000111c40 con 0x7f80001066a0 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8000111ac0 con 0x7f8000100fc0 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8000111dc0 con 0x7f8000100600 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 0x7f800019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f7ffffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8000100600 0x7f80001980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 0x7f800019c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34792/0 (socket says 172.21.15.42:34792) 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 -- 172.21.15.42:0/2258736141 learned_addr learned my addr 172.21.15.42:0/2258736141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f7fff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8000100fc0 0x7f8000198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 -- 172.21.15.42:0/2258736141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8000100600 msgr2=0x7f80001980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8000100600 0x7f80001980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 -- 172.21.15.42:0/2258736141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8000100fc0 msgr2=0x7f8000198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8000100fc0 0x7f8000198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 -- 172.21.15.42:0/2258736141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800019d0d0 con 0x7f80001066a0 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f800497a640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 0x7f800019c9a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8005e30 tx=0x7f7ff8032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f7ffd7fa640 1 -- 172.21.15.42:0/2258736141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8039040 con 0x7f80001066a0 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800019d360 con 0x7f80001066a0 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f7ffd7fa640 1 -- 172.21.15.42:0/2258736141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ff8044070 con 0x7f80001066a0 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f7ffd7fa640 1 -- 172.21.15.42:0/2258736141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8004330 con 0x7f80001066a0 2024-03-31T23:20:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.640+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80001a4c50 con 0x7f80001066a0 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f7ffd7fa640 1 -- 172.21.15.42:0/2258736141 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f7ff8003a00 con 0x7f80001066a0 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 Processor -- start 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f7ffd7fa640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7fe80a2610 0x7f7fe80a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 -- start start 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7fe80a2610 0x7f7fe80a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f7ffd7fa640 1 -- 172.21.15.42:0/2258736141 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f7ff80f11d0 con 0x7f80001066a0 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 0x55a6fee31500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee3e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee3ed80 0x55a6fee41170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a6fed951b0 con 0x55a6fee31120 2024-03-31T23:20:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a6fed3dc00 con 0x55a6fee31a40 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.643+0000 7f8008fb6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a6fed91250 con 0x55a6fee3ed80 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 0x55a6fee31500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 0x55a6fee31500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34808/0 (socket says 172.21.15.42:34808) 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 -- 172.21.15.42:0/1771915710 learned_addr learned my addr 172.21.15.42:0/1771915710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f800497a640 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee3ed80 0x55a6fee41170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee3e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 -- 172.21.15.42:0/1771915710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee3ed80 msgr2=0x55a6fee41170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee3ed80 0x55a6fee41170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 -- 172.21.15.42:0/1771915710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 msgr2=0x55a6fee3e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee3e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 -- 172.21.15.42:0/1771915710 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fed5d3d0 con 0x55a6fee31120 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee3e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7fe80a2610 0x7f7fe80a4ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8000105c60 tx=0x7f7ff4011440 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7ffffff640 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 0x55a6fee31500 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009c20 tx=0x7f7ff0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d6ecebb35dfed9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7fe67fc640 1 -- 172.21.15.42:0/1771915710 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0004220 con 0x55a6fee31120 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7fe67fc640 1 -- 172.21.15.42:0/1771915710 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ff00043c0 con 0x55a6fee31120 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.644+0000 7f7fe67fc640 1 -- 172.21.15.42:0/1771915710 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0019800 con 0x55a6fee31120 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 -- 172.21.15.42:0/1771915710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 msgr2=0x55a6fee31500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 0x55a6fee31500 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009c20 tx=0x7f7ff0011810 comp rx=0 tx=0).stop 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 -- 172.21.15.42:0/1771915710 shutdown_connections 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee3ed80 0x55a6fee41170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee3e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 --2- 172.21.15.42:0/1771915710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31120 0x55a6fee31500 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 -- 172.21.15.42:0/1771915710 >> 172.21.15.42:0/1771915710 conn(0x55a6fee2bba0 msgr2=0x55a6fee2bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 -- 172.21.15.42:0/1771915710 shutdown_connections 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 -- 172.21.15.42:0/1771915710 wait complete. 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 -- start start 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.645+0000 7f8008fb6740 1 Processor -- start 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31120 0x55a6fee3bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 0x55a6fee3c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee3c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a6fee41bc0 con 0x55a6fee3ed80 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a6fed33470 con 0x55a6fee31120 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a6fee41d40 con 0x55a6fee31a40 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f8008fb6740 10 client.0 _ll_register_callbacks cb 0x55a6fed50cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f800497a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee3c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7ffffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31120 0x55a6fee3bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 0x55a6fee3c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 0x55a6fee3c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:41392/0 (socket says 172.21.15.42:41392) 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7ffffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31120 0x55a6fee3bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:42006/0 (socket says 172.21.15.42:42006) 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3485175334 learned_addr learned my addr 172.21.15.42:0/3485175334 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f800497a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee3c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34810/0 (socket says 172.21.15.42:34810) 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3485175334 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31120 msgr2=0x55a6fee3bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31120 0x55a6fee3bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3485175334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 msgr2=0x55a6fee3c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee3c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3485175334 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6feaa93f0 con 0x55a6fee31a40 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 0x55a6fee3c290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400faa0 tx=0x7f7ff4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68c21fcc1e6448ab server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.646+0000 7f7fdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/3485175334 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4017040 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ff00043c0 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/3485175334 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f7ff401eb60 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/3485175334 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7ff4033050 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 10 client.26242 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6feb737d0 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/3485175334 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ff00043c0 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/3485175334 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7ff400e3b0 con 0x55a6fee31a40 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 10 client.26242 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 10 client.26242 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 20 client.26242 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6fee4ef70 0x55a6fee51360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 4 client.26242 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6feda26f0 con 0x55a6fee4ef70 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.647+0000 7f7ffffff640 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6fee4ef70 0x55a6fee51360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.648+0000 7f7fdf7fe640 10 client.26242 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.648+0000 7f7ffffff640 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6fee4ef70 0x55a6fee51360 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fbe307e3fcadc86a server_cookie=825158ddcbff59be in_seq=0 out_seq=0 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/3485175334 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a6feda26f0 con 0x55a6fee4ef70 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f7fdf7fe640 10 client.26242 handle_command_reply: tid=0 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 client.26242 shutdown 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 msgr2=0x55a6fee3c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 0x55a6fee3c290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400faa0 tx=0x7f7ff4004730 comp rx=0 tx=0).stop 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 shutdown_connections 2024-03-31T23:20:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee3c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6fee4ef70 0x55a6fee51360 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31a40 0x55a6fee3c290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3485175334 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31120 0x55a6fee3bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f7fdf7fe640 0 client.26242 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 >> 172.21.15.42:0/3485175334 conn(0x55a6fee2bba0 msgr2=0x55a6fee2d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 shutdown_connections 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 1 -- 172.21.15.42:0/3485175334 wait complete. 2024-03-31T23:20:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.649+0000 7f8008fb6740 20 client.26242 trim_cache size 0 max 16384 2024-03-31T23:20:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.662+0000 7f8008fb6740 1 Processor -- start 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.662+0000 7f8008fb6740 1 -- start start 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.662+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee26bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 0x55a6fee4a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee3ed80 0x55a6fee56b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f8008fb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f80001acaa0 con 0x55a6fee31a40 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f8008fb6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f80001ae6a0 con 0x55a6fee3ed80 2024-03-31T23:20:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f8008fb6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80001ad170 con 0x55a6fee31120 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 0x55a6fee4a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 0x55a6fee4a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34820/0 (socket says 172.21.15.42:34820) 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3906643653 learned_addr learned my addr 172.21.15.42:0/3906643653 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f800497a640 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee3ed80 0x55a6fee56b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7ffffff640 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee26bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3906643653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 msgr2=0x55a6fee26bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee26bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3906643653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee3ed80 msgr2=0x55a6fee56b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee3ed80 0x55a6fee56b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 -- 172.21.15.42:0/3906643653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fee3ad00 con 0x55a6fee31a40 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 0x55a6fee4a9d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400ff80 tx=0x7f7ff40057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9285c56c4eb3f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fe5ffb640 1 -- 172.21.15.42:0/3906643653 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4017040 con 0x55a6fee31a40 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fe5ffb640 1 -- 172.21.15.42:0/3906643653 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ff4019050 con 0x55a6fee31a40 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.663+0000 7f7fe5ffb640 1 -- 172.21.15.42:0/3906643653 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff401ebc0 con 0x55a6fee31a40 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 -- 172.21.15.42:0/3906643653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 msgr2=0x55a6fee4a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 0x55a6fee4a9d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400ff80 tx=0x7f7ff40057d0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 -- 172.21.15.42:0/3906643653 shutdown_connections 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee3ed80 0x55a6fee56b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee31a40 0x55a6fee4a9d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 --2- 172.21.15.42:0/3906643653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee26bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 -- 172.21.15.42:0/3906643653 >> 172.21.15.42:0/3906643653 conn(0x55a6fee2bba0 msgr2=0x55a6fee2ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 -- 172.21.15.42:0/3906643653 shutdown_connections 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 -- 172.21.15.42:0/3906643653 wait complete. 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 -- start start 2024-03-31T23:20:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.664+0000 7f8008fb6740 1 Processor -- start 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee42ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee43420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f80001adf10 con 0x55a6fee3ed80 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f80001ad840 con 0x55a6fee31a40 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80001aaa60 con 0x55a6fee31120 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 10 client.0 _ll_register_callbacks cb 0x7f7ff400f9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee43420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f7ffffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f7fff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee42ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee43420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34836/0 (socket says 172.21.15.42:34836) 2024-03-31T23:20:11.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 -- 172.21.15.42:0/2274148082 learned_addr learned my addr 172.21.15.42:0/2274148082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 -- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 msgr2=0x55a6fee429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 -- 172.21.15.42:0/2274148082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 msgr2=0x55a6fee42ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee42ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 -- 172.21.15.42:0/2274148082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6feeb4210 con 0x55a6fee3ed80 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f7fff7fe640 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee42ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f800497a640 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee43420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7ff802c630 tx=0x7f7ff802c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67da4c9a3a4ea549 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f7fdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/2274148082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8034740 con 0x55a6fee3ed80 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/2274148082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f7ff80b9df0 con 0x55a6fee3ed80 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.665+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ff4019050 con 0x55a6fee3ed80 2024-03-31T23:20:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/2274148082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7ff80bde80 con 0x55a6fee3ed80 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 10 client.16479 fetch_fsmap learned FSMap version 31 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6feeb5570 con 0x55a6fee3ed80 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/2274148082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ff4019050 con 0x55a6fee3ed80 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/2274148082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7ff803c030 con 0x55a6fee3ed80 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 10 client.16479 fetch_fsmap finished waiting for FSMap version 31 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 10 client.16479 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 20 client.16479 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6feeb5cc0 0x55a6feeb80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 4 client.16479 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6fed9ca40 con 0x55a6feeb5cc0 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.666+0000 7f7ffffff640 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6feeb5cc0 0x55a6feeb80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f7fdf7fe640 10 client.16479 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f7ffffff640 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6feeb5cc0 0x55a6feeb80e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=799e87ed47639826 server_cookie=29fa85a8d4d08a90 in_seq=0 out_seq=0 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f7fdf7fe640 1 -- 172.21.15.42:0/2274148082 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6fed9ca40 con 0x55a6feeb5cc0 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f7fdf7fe640 10 client.16479 handle_command_reply: tid=0 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 client.16479 shutdown 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 msgr2=0x55a6fee43420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee43420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7ff802c630 tx=0x7f7ff802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 shutdown_connections 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6fee3ed80 0x55a6fee43420 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a6fee31a40 0x55a6fee42ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x55a6feeb5cc0 0x55a6feeb80e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 --2- 172.21.15.42:0/2274148082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a6fee31120 0x55a6fee429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 >> 172.21.15.42:0/2274148082 conn(0x55a6fee2bba0 msgr2=0x55a6fee3d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f7fdf7fe640 0 client.16479 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 shutdown_connections 2024-03-31T23:20:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 1 -- 172.21.15.42:0/2274148082 wait complete. 2024-03-31T23:20:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.667+0000 7f8008fb6740 20 client.16479 trim_cache size 0 max 16384 2024-03-31T23:20:11.677 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7fe80a2610 msgr2=0x7f7fe80a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7fe80a2610 0x7f7fe80a4ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8000105c60 tx=0x7f7ff4011440 comp rx=0 tx=0).stop 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 msgr2=0x7f800019c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 0x7f800019c9a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8005e30 tx=0x7f7ff8032570 comp rx=0 tx=0).stop 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 shutdown_connections 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7fe80a2610 0x7f7fe80a4ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80001066a0 0x7f800019c9a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8000100fc0 0x7f8000198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 --2- 172.21.15.42:0/2258736141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8000100600 0x7f80001980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 >> 172.21.15.42:0/2258736141 conn(0x7f80000769d0 msgr2=0x7f80000fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 shutdown_connections 2024-03-31T23:20:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.668+0000 7f80063dd640 1 -- 172.21.15.42:0/2258736141 wait complete. 2024-03-31T23:20:11.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 -- 172.21.15.42:0/1693935504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 msgr2=0x7ff498100af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/1693935504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498100af0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009930 tx=0x7ff48c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 -- 172.21.15.42:0/1693935504 shutdown_connections 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/1693935504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498101030 0x7ff49810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/1693935504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498100af0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/1693935504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff498106680 0x7ff498106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 -- 172.21.15.42:0/1693935504 >> 172.21.15.42:0/1693935504 conn(0x7ff4980777b0 msgr2=0x7ff498077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 -- 172.21.15.42:0/1693935504 shutdown_connections 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 -- 172.21.15.42:0/1693935504 wait complete. 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 Processor -- start 2024-03-31T23:20:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.788+0000 7ff49e3c2640 1 -- start start 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49e3c2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49e3c2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff498101030 0x7ff4981994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49e3c2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498106680 0x7ff4981a4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49e3c2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff498110b60 con 0x7ff498100670 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49e3c2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981109e0 con 0x7ff498106680 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49e3c2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff498110ce0 con 0x7ff498101030 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff497fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff497fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34854/0 (socket says 172.21.15.42:34854) 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff497fff640 1 -- 172.21.15.42:0/546256678 learned_addr learned my addr 172.21.15.42:0/546256678 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49c95f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498106680 0x7ff4981a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff4977fe640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff498101030 0x7ff4981994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49c95f640 1 -- 172.21.15.42:0/546256678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff498101030 msgr2=0x7ff4981994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49c95f640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff498101030 0x7ff4981994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49c95f640 1 -- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 msgr2=0x7ff498198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49c95f640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff49c95f640 1 -- 172.21.15.42:0/546256678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4981a4560 con 0x7ff498106680 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.789+0000 7ff497fff640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.790+0000 7ff49c95f640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498106680 0x7ff4981a4020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff490009fd0 tx=0x7ff49000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.790+0000 7ff4957fa640 1 -- 172.21.15.42:0/546256678 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49000ce20 con 0x7ff498106680 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.790+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4981a4730 con 0x7ff498106680 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.790+0000 7ff4957fa640 1 -- 172.21.15.42:0/546256678 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff490004b20 con 0x7ff498106680 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.790+0000 7ff4957fa640 1 -- 172.21.15.42:0/546256678 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490010790 con 0x7ff498106680 2024-03-31T23:20:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.790+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4981a4bf0 con 0x7ff498106680 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.792+0000 7ff4a0f9c740 1 Processor -- start 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4957fa640 1 -- 172.21.15.42:0/546256678 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7ff490010970 con 0x7ff498106680 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 -- start start 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f816636850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81663f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f81663f970 0x55f816641d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f81659a1b0 con 0x55f816636d90 2024-03-31T23:20:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f816542c00 con 0x55f816636470 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f816596250 con 0x55f81663f970 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff497fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81663f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f816636850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff497fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81663f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34862/0 (socket says 172.21.15.42:34862) 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.793+0000 7ff497fff640 1 -- 172.21.15.42:0/1768449013 learned_addr learned my addr 172.21.15.42:0/1768449013 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff4977fe640 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f81663f970 0x55f816641d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff497fff640 1 -- 172.21.15.42:0/1768449013 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f81663f970 msgr2=0x55f816641d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff497fff640 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f81663f970 0x55f816641d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff497fff640 1 -- 172.21.15.42:0/1768449013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 msgr2=0x55f816636850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff497fff640 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f816636850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff497fff640 1 -- 172.21.15.42:0/1768449013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8165623d0 con 0x55f816636d90 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff4977fe640 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f81663f970 0x55f816641d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff4957fa640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4800a2610 0x7ff4800a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff4977fe640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4800a2610 0x7ff4800a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff497fff640 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81663f430 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff4880115c0 tx=0x7ff488011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb1eacdf6970149 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff4957fa640 1 -- 172.21.15.42:0/546256678 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff4900cf610 con 0x7ff498106680 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff47e7fc640 1 -- 172.21.15.42:0/1768449013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48800f660 con 0x55f816636d90 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff47e7fc640 1 -- 172.21.15.42:0/1768449013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff48800fd00 con 0x55f816636d90 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.794+0000 7ff47e7fc640 1 -- 172.21.15.42:0/1768449013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488019e00 con 0x55f816636d90 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/1768449013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 msgr2=0x55f81663f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81663f430 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff4880115c0 tx=0x7ff488011a80 comp rx=0 tx=0).stop 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4977fe640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4800a2610 0x7ff4800a4ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff48c005ab0 tx=0x7ff48c005d90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/1768449013 shutdown_connections 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f81663f970 0x55f816641d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81663f430 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/1768449013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f816636850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/1768449013 >> 172.21.15.42:0/1768449013 conn(0x55f816630ba0 msgr2=0x55f816630f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/1768449013 shutdown_connections 2024-03-31T23:20:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/1768449013 wait complete. 2024-03-31T23:20:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.795+0000 7ff4a0f9c740 1 -- start start 2024-03-31T23:20:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 Processor -- start 2024-03-31T23:20:11.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f81663ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f81663cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 0x55f81663d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f816642760 con 0x55f81663f970 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f816538470 con 0x55f816636470 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f8166428e0 con 0x55f816636d90 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4a0f9c740 10 client.0 _ll_register_callbacks cb 0x55f816555cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 0x55f81663d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 0x55f81663d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34876/0 (socket says 172.21.15.42:34876) 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 -- 172.21.15.42:0/3654042242 learned_addr learned my addr 172.21.15.42:0/3654042242 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff4977fe640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f81663cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff497fff640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f81663ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 -- 172.21.15.42:0/3654042242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 msgr2=0x55f81663cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f81663cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 -- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 msgr2=0x55f81663ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f81663ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff49c95f640 1 -- 172.21.15.42:0/3654042242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8162ae3f0 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.796+0000 7ff497fff640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f81663ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff49c95f640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 0x55f81663d490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff490009600 tx=0x7ff49009ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa67a2daca4d9ea4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4777fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4777fe640 1 -- 172.21.15.42:0/3654042242 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900b4060 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4777fe640 1 -- 172.21.15.42:0/3654042242 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff490098090 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff48800fd00 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4777fe640 1 -- 172.21.15.42:0/3654042242 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff4900ba170 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 10 client.16491 fetch_fsmap learned FSMap version 32 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f8163787d0 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4777fe640 1 -- 172.21.15.42:0/3654042242 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff48800fd00 con 0x55f81663f970 2024-03-31T23:20:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4777fe640 1 -- 172.21.15.42:0/3654042242 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7ff4900afce0 con 0x55f81663f970 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 10 client.16491 fetch_fsmap finished waiting for FSMap version 32 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 20 client.16491 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f81664f970 0x55f816651e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 4 client.16491 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.797+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8165a76f0 con 0x55f81664f970 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.798+0000 7ff497fff640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f81664f970 0x55f816651e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.798+0000 7ff4777fe640 10 client.16491 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.798+0000 7ff497fff640 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f81664f970 0x55f816651e30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c109fe19ea2914 server_cookie=f070f3994d51bfa4 in_seq=0 out_seq=0 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4777fe640 1 -- 172.21.15.42:0/3654042242 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f8165a76f0 con 0x55f81664f970 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4777fe640 10 client.16491 handle_command_reply: tid=0 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 client.16491 shutdown 2024-03-31T23:20:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 msgr2=0x55f81663d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 0x55f81663d490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff490009600 tx=0x7ff49009ba20 comp rx=0 tx=0).stop 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 shutdown_connections 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f81664f970 0x55f816651e30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f81663f970 0x55f81663d490 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f81663cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4777fe640 0 client.16491 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/3654042242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f816636470 0x55f81663ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 >> 172.21.15.42:0/3654042242 conn(0x55f816630ba0 msgr2=0x55f8166328f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 shutdown_connections 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/3654042242 wait complete. 2024-03-31T23:20:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.799+0000 7ff4a0f9c740 20 client.16491 trim_cache size 0 max 16384 2024-03-31T23:20:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 Processor -- start 2024-03-31T23:20:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 -- start start 2024-03-31T23:20:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636470 0x55f81663c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81664b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f81662fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981aca20 con 0x55f816636d90 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981ae650 con 0x55f81663f970 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.812+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981ad120 con 0x55f816636470 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81664b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81664b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34886/0 (socket says 172.21.15.42:34886) 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff497fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636470 0x55f81663c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 -- 172.21.15.42:0/4718168 learned_addr learned my addr 172.21.15.42:0/4718168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff49c95f640 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f81662fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 -- 172.21.15.42:0/4718168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636470 msgr2=0x55f81663c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636470 0x55f81663c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 -- 172.21.15.42:0/4718168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 msgr2=0x55f81662fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f81662fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 -- 172.21.15.42:0/4718168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f816636bc0 con 0x55f816636d90 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff497fff640 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636470 0x55f81663c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff49c95f640 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f81662fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff4977fe640 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81664b500 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009930 tx=0x7ff48c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306c6fd3fc928440 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff47dffb640 1 -- 172.21.15.42:0/4718168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0051c0 con 0x55f816636d90 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff47dffb640 1 -- 172.21.15.42:0/4718168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff48c004bc0 con 0x55f816636d90 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.813+0000 7ff47dffb640 1 -- 172.21.15.42:0/4718168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c03e840 con 0x55f816636d90 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/4718168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 msgr2=0x55f81664b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81664b500 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009930 tx=0x7ff48c009260 comp rx=0 tx=0).stop 2024-03-31T23:20:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/4718168 shutdown_connections 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f81662fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636d90 0x55f81664b500 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/4718168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636470 0x55f81663c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/4718168 >> 172.21.15.42:0/4718168 conn(0x55f816630ba0 msgr2=0x55f81662f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/4718168 shutdown_connections 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/4718168 wait complete. 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.814+0000 7ff4a0f9c740 1 -- start start 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 Processor -- start 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 0x55f816647f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f816643280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f8166439c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981adec0 con 0x55f816636470 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981ad7f0 con 0x55f81663f970 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff4981aa9e0 con 0x55f816636d90 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4a0f9c740 10 client.0 _ll_register_callbacks cb 0x7ff49009b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 0x55f816647f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 0x55f816647f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34888/0 (socket says 172.21.15.42:34888) 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 -- 172.21.15.42:0/2257783559 learned_addr learned my addr 172.21.15.42:0/2257783559 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff49c95f640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f8166439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff4977fe640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f816643280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 -- 172.21.15.42:0/2257783559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 msgr2=0x55f816643280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f816643280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 -- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 msgr2=0x55f8166439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f8166439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff497fff640 1 -- 172.21.15.42:0/2257783559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8166b4d30 con 0x55f816636470 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.815+0000 7ff49c95f640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f8166439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff497fff640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 0x55f816647f10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff488009ee0 tx=0x7ff4880199a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca83bdd8f43e4bf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4777fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4777fe640 1 -- 172.21.15.42:0/2257783559 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488019410 con 0x55f816636470 2024-03-31T23:20:11.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4777fe640 1 -- 172.21.15.42:0/2257783559 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff488019b10 con 0x55f816636470 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff48c004bc0 con 0x55f816636470 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4777fe640 1 -- 172.21.15.42:0/2257783559 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff488037050 con 0x55f816636470 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 10 client.16497 fetch_fsmap learned FSMap version 32 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f8166b5e60 con 0x55f816636470 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4777fe640 1 -- 172.21.15.42:0/2257783559 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff48c004bc0 con 0x55f816636470 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4777fe640 1 -- 172.21.15.42:0/2257783559 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7ff488028400 con 0x55f816636470 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 10 client.16497 fetch_fsmap finished waiting for FSMap version 32 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 20 client.16497 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.816+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8166b64f0 0x55f8166b8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4a0f9c740 4 client.16497 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:11.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8165a1a40 con 0x55f8166b64f0 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4977fe640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8166b64f0 0x55f8166b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4777fe640 10 client.16497 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4977fe640 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8166b64f0 0x55f8166b8910 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3edf33a8642a849 server_cookie=efc412a4243b177b in_seq=0 out_seq=0 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4777fe640 1 -- 172.21.15.42:0/2257783559 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f8165a1a40 con 0x55f8166b64f0 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.817+0000 7ff4777fe640 10 client.16497 handle_command_reply: tid=0 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 client.16497 shutdown 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 msgr2=0x55f816647f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 0x55f816647f10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff488009ee0 tx=0x7ff4880199a0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 shutdown_connections 2024-03-31T23:20:11.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55f8166b64f0 0x55f8166b8910 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f81663f970 0x55f8166439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f816636d90 0x55f816643280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 --2- 172.21.15.42:0/2257783559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f816636470 0x55f816647f10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 >> 172.21.15.42:0/2257783559 conn(0x55f816630ba0 msgr2=0x55f81663d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4777fe640 0 client.16497 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 shutdown_connections 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 1 -- 172.21.15.42:0/2257783559 wait complete. 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.818+0000 7ff4a0f9c740 20 client.16497 trim_cache size 0 max 16384 2024-03-31T23:20:11.827 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:20:11.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4800a2610 msgr2=0x7ff4800a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4800a2610 0x7ff4800a4ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff48c005ab0 tx=0x7ff48c005d90 comp rx=0 tx=0).stop 2024-03-31T23:20:11.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498106680 msgr2=0x7ff4981a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:11.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498106680 0x7ff4981a4020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff490009fd0 tx=0x7ff49000ef10 comp rx=0 tx=0).stop 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 shutdown_connections 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff498106680 0x7ff4981a4020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff498101030 0x7ff4981994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4800a2610 0x7ff4800a4ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 --2- 172.21.15.42:0/546256678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff498100670 0x7ff498198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 >> 172.21.15.42:0/546256678 conn(0x7ff4980777b0 msgr2=0x7ff498103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 shutdown_connections 2024-03-31T23:20:11.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:11.819+0000 7ff49e3c2640 1 -- 172.21.15.42:0/546256678 wait complete. 2024-03-31T23:20:12.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:11 smithi042 ceph-mon[32380]: pgmap v63: 129 pgs: 129 active+clean; 157 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-03-31T23:20:12.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:11 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2328103605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:20:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:11 smithi094 ceph-mon[36167]: pgmap v63: 129 pgs: 129 active+clean; 157 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-03-31T23:20:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:11 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2328103605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:20:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:11 smithi188 ceph-mon[36068]: pgmap v63: 129 pgs: 129 active+clean; 157 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-03-31T23:20:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:11 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2328103605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:20:12.832 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-31T23:20:12.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:20:12.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-31T23:20:12.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.944+0000 7f4cd58eb640 1 -- 172.21.15.42:0/541943453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0100930 msgr2=0x7f4cd0100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.944+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/541943453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0100930 0x7f4cd0100db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009860 tx=0x7f4cb802bb70 comp rx=0 tx=0).stop 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- 172.21.15.42:0/541943453 shutdown_connections 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/541943453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd01012f0 0x7f4cd010d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/541943453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0100930 0x7f4cd0100db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/541943453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cd0106680 0x7f4cd0106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- 172.21.15.42:0/541943453 >> 172.21.15.42:0/541943453 conn(0x7f4cd0077630 msgr2=0x7f4cd0077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- 172.21.15.42:0/541943453 shutdown_connections 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- 172.21.15.42:0/541943453 wait complete. 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 Processor -- start 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- start start 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 0x7f4cd0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cd01012f0 0x7f4cd0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0106680 0x7f4cd01a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0110af0 con 0x7f4cd0100930 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0110970 con 0x7f4cd0106680 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cd58eb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0110c70 con 0x7f4cd01012f0 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 0x7f4cd0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 0x7f4cd0198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34908/0 (socket says 172.21.15.42:34908) 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.945+0000 7f4cceffd640 1 -- 172.21.15.42:0/3945097847 learned_addr learned my addr 172.21.15.42:0/3945097847 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4ccf7fe640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0106680 0x7f4cd01a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cd01012f0 0x7f4cd0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cceffd640 1 -- 172.21.15.42:0/3945097847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cd01012f0 msgr2=0x7f4cd0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cd01012f0 0x7f4cd0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cceffd640 1 -- 172.21.15.42:0/3945097847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0106680 msgr2=0x7f4cd01a3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0106680 0x7f4cd01a3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cceffd640 1 -- 172.21.15.42:0/3945097847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd01a4410 con 0x7f4cd0100930 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 0x7f4cd0198e50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9f0 tx=0x7f4cc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cd48e9640 1 -- 172.21.15.42:0/3945097847 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000cd80 con 0x7f4cd0100930 2024-03-31T23:20:12.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd01a45e0 con 0x7f4cd0100930 2024-03-31T23:20:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cd48e9640 1 -- 172.21.15.42:0/3945097847 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4cc0005520 con 0x7f4cd0100930 2024-03-31T23:20:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cd48e9640 1 -- 172.21.15.42:0/3945097847 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0010690 con 0x7f4cd0100930 2024-03-31T23:20:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.946+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd01a4ab0 con 0x7f4cd0100930 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.948+0000 7f4cd48e9640 1 -- 172.21.15.42:0/3945097847 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f4cc00046c0 con 0x7f4cd0100930 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd48e9640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4cbc0a2610 0x7f4cbc0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 Processor -- start 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 -- start start 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4cbc0a2610 0x7f4cbc0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd48e9640 1 -- 172.21.15.42:0/3945097847 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f4cc00cf260 con 0x7f4cd0100930 2024-03-31T23:20:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 0x5611bba5cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba65ef0 0x5611bba682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5611bb95d0b0 con 0x5611bba65ef0 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5611bb9bfea0 con 0x5611bba5c9f0 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5611bb968c00 con 0x5611bba5d310 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 0x5611bba5cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4ccf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba65ef0 0x5611bba682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 0x5611bba5cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:42086/0 (socket says 172.21.15.42:42086) 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 -- 172.21.15.42:0/2288789025 learned_addr learned my addr 172.21.15.42:0/2288789025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 -- 172.21.15.42:0/2288789025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 msgr2=0x5611bba659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 -- 172.21.15.42:0/2288789025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba65ef0 msgr2=0x5611bba682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba65ef0 0x5611bba682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cceffd640 1 -- 172.21.15.42:0/2288789025 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611bb79c7e0 con 0x5611bba5c9f0 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.949+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4cbc0a2610 0x7f4cbc0a4ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4cb802c180 tx=0x7f4cb8032440 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cceffd640 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 0x5611bba5cdd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00a3b50 tx=0x7f4cc0097a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9f7d74b74de65b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cc5ffb640 1 -- 172.21.15.42:0/2288789025 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc009bd70 con 0x5611bba5c9f0 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cc5ffb640 1 -- 172.21.15.42:0/2288789025 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4cc009b670 con 0x5611bba5c9f0 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cc5ffb640 1 -- 172.21.15.42:0/2288789025 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00cca10 con 0x5611bba5c9f0 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2288789025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 msgr2=0x5611bba5cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 0x5611bba5cdd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00a3b50 tx=0x7f4cc0097a10 comp rx=0 tx=0).stop 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2288789025 shutdown_connections 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba65ef0 0x5611bba682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2288789025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba5c9f0 0x5611bba5cdd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2288789025 >> 172.21.15.42:0/2288789025 conn(0x5611bba57120 msgr2=0x5611bba57500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2288789025 shutdown_connections 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.950+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2288789025 wait complete. 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 -- start start 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 Processor -- start 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5c9f0 0x5611bba62fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 0x5611bba634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba63a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5611bb95e3d0 con 0x5611bba5d310 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5611bb9bbf40 con 0x5611bba65ef0 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5611bba68ce0 con 0x5611bba5c9f0 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cd85a7740 10 client.0 _ll_register_callbacks cb 0x5611bb97bb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 0x5611bba634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 0x5611bba634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34930/0 (socket says 172.21.15.42:34930) 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cc7fff640 1 -- 172.21.15.42:0/3778630871 learned_addr learned my addr 172.21.15.42:0/3778630871 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4ccf7fe640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba63a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.951+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5c9f0 0x5611bba62fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cc7fff640 1 -- 172.21.15.42:0/3778630871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5c9f0 msgr2=0x5611bba62fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5c9f0 0x5611bba62fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cc7fff640 1 -- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 msgr2=0x5611bba63a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba63a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cc7fff640 1 -- 172.21.15.42:0/3778630871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611bb7fcf70 con 0x5611bba5d310 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 0x5611bba634f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8036000 tx=0x7f4cb802bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab192ad45633db9f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4caeffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4caeffd640 1 -- 172.21.15.42:0/3778630871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb804e020 con 0x5611bba5d310 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4caeffd640 1 -- 172.21.15.42:0/3778630871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f4cb802c510 con 0x5611bba5d310 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cc009b670 con 0x5611bba5d310 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4caeffd640 1 -- 172.21.15.42:0/3778630871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4cb8059050 con 0x5611bba5d310 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cd85a7740 10 client.16509 fetch_fsmap learned FSMap version 32 2024-03-31T23:20:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5611bb694170 con 0x5611bba5d310 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4caeffd640 1 -- 172.21.15.42:0/3778630871 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4cc009b670 con 0x5611bba5d310 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.952+0000 7f4caeffd640 1 -- 172.21.15.42:0/3778630871 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7f4cb803f040 con 0x5611bba5d310 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cd85a7740 10 client.16509 fetch_fsmap finished waiting for FSMap version 32 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cd85a7740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cd85a7740 20 client.16509 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bba75f10 0x5611bba78390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cd85a7740 4 client.16509 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611bb9cd3e0 con 0x5611bba75f10 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bba75f10 0x5611bba78390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bba75f10 0x5611bba78390 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23eabe2401280a8c server_cookie=43176f48e2b98fdf in_seq=0 out_seq=0 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.953+0000 7f4caeffd640 10 client.16509 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4caeffd640 1 -- 172.21.15.42:0/3778630871 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5611bb9cd3e0 con 0x5611bba75f10 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4caeffd640 10 client.16509 handle_command_reply: tid=0 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 client.16509 shutdown 2024-03-31T23:20:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 msgr2=0x5611bba634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 0x5611bba634f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8036000 tx=0x7f4cb802bb70 comp rx=0 tx=0).stop 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 shutdown_connections 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bba75f10 0x5611bba78390 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba63a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4caeffd640 0 client.16509 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5d310 0x5611bba634f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3778630871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5c9f0 0x5611bba62fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 >> 172.21.15.42:0/3778630871 conn(0x5611bba57120 msgr2=0x5611bba58e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 shutdown_connections 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3778630871 wait complete. 2024-03-31T23:20:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.954+0000 7f4cd85a7740 20 client.16509 trim_cache size 0 max 16384 2024-03-31T23:20:12.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 Processor -- start 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 -- start start 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba71900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba7dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01aec60 con 0x5611bba5c9f0 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01b0890 con 0x5611bba65ef0 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01af360 con 0x5611bba5d310 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34938/0 (socket says 172.21.15.42:34938) 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 -- 172.21.15.42:0/3636143923 learned_addr learned my addr 172.21.15.42:0/3636143923 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba71900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4ccf7fe640 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba7dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 -- 172.21.15.42:0/3636143923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 msgr2=0x5611bba71900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba71900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 -- 172.21.15.42:0/3636143923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 msgr2=0x5611bba7dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba7dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 -- 172.21.15.42:0/3636143923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611bba61ef0 con 0x5611bba5c9f0 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.972+0000 7f4cceffd640 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba656e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9c0 tx=0x7f4cc0004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0b54e13bb7b738 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cc57fa640 1 -- 172.21.15.42:0/3636143923 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00b9070 con 0x5611bba5c9f0 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cc57fa640 1 -- 172.21.15.42:0/3636143923 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4cc009f7c0 con 0x5611bba5c9f0 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cc57fa640 1 -- 172.21.15.42:0/3636143923 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00b4210 con 0x5611bba5c9f0 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3636143923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 msgr2=0x5611bba656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba656e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9c0 tx=0x7f4cc0004c10 comp rx=0 tx=0).stop 2024-03-31T23:20:12.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3636143923 shutdown_connections 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba7dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba71900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/3636143923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba656e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3636143923 >> 172.21.15.42:0/3636143923 conn(0x5611bba57120 msgr2=0x5611bba58d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3636143923 shutdown_connections 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.973+0000 7f4cd85a7740 1 -- 172.21.15.42:0/3636143923 wait complete. 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 -- start start 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 Processor -- start 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba6af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba6b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba6b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01b0100 con 0x5611bba5c9f0 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01afa30 con 0x5611bba65ef0 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01acc20 con 0x5611bba5d310 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cd85a7740 10 client.0 _ll_register_callbacks cb 0x7f4cb80096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba6af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba6af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34950/0 (socket says 172.21.15.42:34950) 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 -- 172.21.15.42:0/2569871865 learned_addr learned my addr 172.21.15.42:0/2569871865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba6b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4ccf7fe640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba6b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 -- 172.21.15.42:0/2569871865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 msgr2=0x5611bba6b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba6b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 -- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 msgr2=0x5611bba6b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:12.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba6b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.974+0000 7f4cceffd640 1 -- 172.21.15.42:0/2569871865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611bbadc580 con 0x5611bba5c9f0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cceffd640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba6af00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0097350 tx=0x7f4cc000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e815b4a331b96050 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4caeffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4caeffd640 1 -- 172.21.15.42:0/2569871865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00b9040 con 0x5611bba5c9f0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4caeffd640 1 -- 172.21.15.42:0/2569871865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f4cc00b4210 con 0x5611bba5c9f0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cc009f7c0 con 0x5611bba5c9f0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4caeffd640 1 -- 172.21.15.42:0/2569871865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4cc009afd0 con 0x5611bba5c9f0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 10 client.16515 fetch_fsmap learned FSMap version 32 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5611bbadd8a0 con 0x5611bba5c9f0 2024-03-31T23:20:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4caeffd640 1 -- 172.21.15.42:0/2569871865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4cc009f7c0 con 0x5611bba5c9f0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4caeffd640 1 -- 172.21.15.42:0/2569871865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7f4cc00a3c80 con 0x5611bba5c9f0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 10 client.16515 fetch_fsmap finished waiting for FSMap version 32 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 20 client.16515 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bbaddbe0 0x5611bbadffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 4 client.16515 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5611bb9c7730 con 0x5611bbaddbe0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.975+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bbaddbe0 0x5611bbadffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.976+0000 7f4caeffd640 10 client.16515 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.976+0000 7f4cc7fff640 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bbaddbe0 0x5611bbadffd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=691ad33c9bdab90b server_cookie=ce96bdb25aa8917f in_seq=0 out_seq=0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4caeffd640 1 -- 172.21.15.42:0/2569871865 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5611bb9c7730 con 0x5611bbaddbe0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4caeffd640 10 client.16515 handle_command_reply: tid=0 2024-03-31T23:20:12.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 client.16515 shutdown 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 msgr2=0x5611bba6af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba6af00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0097350 tx=0x7f4cc000c840 comp rx=0 tx=0).stop 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 shutdown_connections 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5611bbaddbe0 0x5611bbadffd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4caeffd640 0 client.16515 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611bba65ef0 0x5611bba6b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611bba5d310 0x5611bba6b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 --2- 172.21.15.42:0/2569871865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5611bba5c9f0 0x5611bba6af00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 >> 172.21.15.42:0/2569871865 conn(0x5611bba57120 msgr2=0x5611bba62f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 shutdown_connections 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 1 -- 172.21.15.42:0/2569871865 wait complete. 2024-03-31T23:20:12.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.977+0000 7f4cd85a7740 20 client.16515 trim_cache size 0 max 16384 2024-03-31T23:20:12.986 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:20:12.986 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-03-31T23:20:12.986 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "ccdf6745-ce8d-465a-b703-508815353171", 2024-03-31T23:20:12.986 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-03-31T23:20:12.986 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4cbc0a2610 msgr2=0x7f4cbc0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4cbc0a2610 0x7f4cbc0a4ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4cb802c180 tx=0x7f4cb8032440 comp rx=0 tx=0).stop 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 msgr2=0x7f4cd0198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 0x7f4cd0198e50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9f0 tx=0x7f4cc000edf0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 shutdown_connections 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cd0106680 0x7f4cd01a3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cd01012f0 0x7f4cd0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4cbc0a2610 0x7f4cbc0a4ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 --2- 172.21.15.42:0/3945097847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cd0100930 0x7f4cd0198e50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:12.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 >> 172.21.15.42:0/3945097847 conn(0x7f4cd0077630 msgr2=0x7f4cd00ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:12.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 shutdown_connections 2024-03-31T23:20:12.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:12.978+0000 7f4cd58eb640 1 -- 172.21.15.42:0/3945097847 wait complete. 2024-03-31T23:20:12.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:20:12.990 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:20:13.010 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:13.010 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.988+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/ auth{0=1,1=1,3=1,4=1} v3685 ap=1 f(v0 m2024-03-31T23:19:58.718128+0000 7=7+0) n(v0 rc2024-03-31T23:19:58.722128+0000 b33079 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304c8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000042e:[<0x10000000203/accounting v238>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000042e:[<0x10000000203/accounting v3685>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.718128+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.722128+0000 b33079 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.718128+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.722128+0000 b33079 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.010 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.990+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001178 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/wimax/ auth{0=1,1=1,3=1,4=1} v3683 ap=1 f(v0 m2024-03-31T23:19:59.293123+0000 2=2+0) n(v0 rc2024-03-31T23:19:59.295123+0000 b12957 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304c8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001178:[<0x10000000203/wimax v1951>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001178:[<0x10000000203/wimax v3683>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.293123+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.294123+0000 b12957 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.293123+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.295123+0000 b12957 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.010 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.990+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fff [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/security/ auth{0=1,1=1,3=1} v3681 ap=1 f(v0 m2024-03-31T23:19:59.363123+0000 13=13+0) n(v0 rc2024-03-31T23:19:59.365123+0000 b138701 14=13+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@31},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304c8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fff:[<0x10000000203/security v1953>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000fff:[<0x10000000203/security v3681>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.363123+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.365123+0000 b138701 14=13+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.363123+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.365123+0000 b138701 14=13+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.011 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.990+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001093 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/ auth{0=1,1=1,3=1,4=1} v3679 ap=1 f(v0 m2024-03-31T23:19:59.428122+0000 15=14+1) n(v2 rc2024-03-31T23:19:59.429122+0000 b143729 18=16+2) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@33},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001093:[<0x10000000203/trace v1990>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001093:[<0x10000000203/trace v3679>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.428122+0000 15=14+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.429122+0000 b143729 18=16+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.428122+0000 15=14+1)","memory_value.rstat":"n(v2 rc2024-03-31T23:19:59.429122+0000 b143729 18=16+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.011 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.992+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/rapidio/ auth{0=1,1=1,3=1,4=1} v3675 ap=1 f(v0 m2024-03-31T23:19:59.481122+0000 3=3+0) n(v0 rc2024-03-31T23:19:59.483122+0000 b27592 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f9e:[<0x10000000203/rapidio v1959>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f9e:[<0x10000000203/rapidio v3675>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.481122+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.483122+0000 b27592 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.481122+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.483122+0000 b27592 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.011 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.992+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f94 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pti/ auth{0=1,1=1,3=1} v3673 ap=1 f(v0 m2024-03-31T23:19:59.488122+0000 1=1+0) n(v0 rc2024-03-31T23:19:59.490122+0000 b3679 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f94:[<0x10000000203/pti v1961>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f94:[<0x10000000203/pti v3673>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.488122+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.490122+0000 b3679 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.488122+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.490122+0000 b3679 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.011 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.992+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7a [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/powerpc/ auth{0=1,1=1,3=1,4=1} v3671 ap=1 f(v0 m2024-03-31T23:19:59.559121+0000 13=13+0) n(v0 rc2024-03-31T23:19:59.562121+0000 b116548 14=13+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@31},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f7a:[<0x10000000203/powerpc v1963>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f7a:[<0x10000000203/powerpc v3671>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.559121+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.562121+0000 b116548 14=13+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.559121+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.562121+0000 b116548 14=13+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.011 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.993+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001195 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/xtensa/ auth{0=1,1=1,3=1,4=1} v3669 ap=1 f(v0 m2024-03-31T23:19:59.573121+0000 2=2+0) n(v0 rc2024-03-31T23:19:59.575121+0000 b4571 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001195:[<0x10000000203/xtensa v1965>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001195:[<0x10000000203/xtensa v3669>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.573121+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.575121+0000 b4571 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.573121+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.575121+0000 b4571 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.011 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.996+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e72 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/memory-devices/ auth{0=1,1=1,3=1} v3667 ap=1 f(v0 m2024-03-31T23:19:59.578121+0000 1=1+0) n(v0 rc2024-03-31T23:19:59.581121+0000 b1794 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e72:[<0x10000000203/memory-devices v1967>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e72:[<0x10000000203/memory-devices v3667>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.578121+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.581121+0000 b1794 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.578121+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.581121+0000 b1794 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.997+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c65 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/ auth{0=1,1=1,3=1,4=1} fragtree_t(*^3) v3688 ap=1 f(v0 m2024-03-31T23:20:00.000117+0000 82=77+5) n(v2 rc2024-03-31T23:20:00.001117+0000 b1110305 116=110+6) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@159},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304cb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c65:[<0x10000000203/filesystems v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c65:[<0x10000000203/filesystems v3688>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.000117+0000 82=77+5)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.001117+0000 b1110305 116=110+6)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.000117+0000 82=77+5)","memory_value.rstat":"n(v2 rc2024-03-31T23:20:00.001117+0000 b1110305 116=110+6)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:12.999+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/namespaces/ auth{0=1,1=1,3=1,4=1} v3653 ap=1 f(v0 m2024-03-31T23:20:00.023117+0000 2=2+0) n(v0 rc2024-03-31T23:20:00.025117+0000 b2109 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ea8:[<0x10000000203/namespaces v1981>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ea8:[<0x10000000203/namespaces v3653>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.023117+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.025117+0000 b2109 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.023117+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.025117+0000 b2109 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.000+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cd [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vDSO/ auth{0=1,1=1,3=1} v3651 ap=1 f(v0 m2024-03-31T23:20:00.036117+0000 5=5+0) n(v0 rc2024-03-31T23:20:00.038117+0000 b11824 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000010cd:[<0x10000000203/vDSO v1983>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000010cd:[<0x10000000203/vDSO v3651>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.036117+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.038117+0000 b11824 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.036117+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.038117+0000 b11824 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.000+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ba [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blackfin/ auth{0=1,1=1,3=1,4=1} v3649 ap=1 f(v0 m2024-03-31T23:20:00.051117+0000 5=5+0) n(v0 rc2024-03-31T23:20:00.052117+0000 b5602 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004ba:[<0x10000000203/blackfin v398>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004ba:[<0x10000000203/blackfin v3649>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.051117+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.052117+0000 b5602 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.051117+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.052117+0000 b5602 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.001+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1f [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ja_JP/ auth{0=1,1=1,3=1} v3647 ap=1 f(v0 m2024-03-31T23:20:00.067117+0000 5=5+0) n(v0 rc2024-03-31T23:20:00.068117+0000 b111609 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e1f:[<0x10000000203/ja_JP v1987>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e1f:[<0x10000000203/ja_JP v3647>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.067117+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.068117+0000 b111609 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.067117+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.068117+0000 b111609 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.002+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/spi/ auth{0=1,1=1,3=1,4=1} v5376 ap=1 f(v0 m2024-03-31T23:19:57.116141+0000 12=12+0) n(v0 rc2024-03-31T23:19:57.117141+0000 b60755 13=12+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@29},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000105c:[<0x10000000203/spi v1965>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000105c:[<0x10000000203/spi v5376>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:57.116141+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:57.117141+0000 b60755 13=12+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:57.116141+0000 12=12+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:57.117141+0000 b60755 13=12+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.002+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c19 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/driver-model/ auth{0=1,1=1,3=1} v5374 ap=1 f(v0 m2024-03-31T23:19:57.140141+0000 10=10+0) n(v0 rc2024-03-31T23:19:57.141141+0000 b63241 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@25},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c19:[<0x10000000203/driver-model v1967>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c19:[<0x10000000203/driver-model v5374>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:57.140141+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:57.141141+0000 b63241 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:57.140141+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:57.141141+0000 b63241 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.009+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d08 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/hwmon/ auth{0=1,1=1,3=1,4=1} fragtree_t(*^3) v5311 ap=1 f(v1 m2024-03-31T23:19:57.779136+0000 136=136+0) n(v1 rc2024-03-31T23:19:57.782136+0000 b492323 137=136+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@288},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000d08:[<0x10000000203/hwmon v1969>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000d08:[<0x10000000203/hwmon v5311>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:57.779136+0000 136=136+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:57.782136+0000 b492323 137=136+1)","memory_value.dirstat":"f(v1 m2024-03-31T23:19:57.779136+0000 136=136+0)","memory_value.rstat":"n(v1 rc2024-03-31T23:19:57.782136+0000 b492323 137=136+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.012 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.010+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa9 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/s390/ auth{0=1,1=1,3=1,4=1} v5372 ap=1 f(v0 m2024-03-31T23:19:57.941134+0000 14=14+0) n(v0 rc2024-03-31T23:19:57.943134+0000 b178045 15=14+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@33},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fa9:[<0x10000000203/s390 v1971>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000fa9:[<0x10000000203/s390 v5372>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:57.941134+0000 14=14+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:57.943134+0000 b178045 15=14+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:57.941134+0000 14=14+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:57.943134+0000 b178045 15=14+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.013 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:13.013 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.987+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052b [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/development-process/ auth{0=1,1=1,2=1} v2851 ap=1 f(v0 m2024-03-31T23:20:00.416114+0000 8=8+0) n(v0 rc2024-03-31T23:20:00.785111+0000 b110600 9=8+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@21},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef30c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000052b:[<0x10000000203/development-process v614>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000052b:[<0x10000000203/development-process v2851>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.416114+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.785111+0000 b110600 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.416114+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.785111+0000 b110600 9=8+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.013 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.989+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ide/ auth{0=1,1=1,2=1} v2849 ap=1 f(v0 m2024-03-31T23:20:00.840110+0000 7=7+0) n(v0 rc2024-03-31T23:20:00.841110+0000 b50332 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef31180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000dc8:[<0x10000000203/ide v1859>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000dc8:[<0x10000000203/ide v2849>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.840110+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.841110+0000 b50332 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.840110+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.841110+0000 b50332 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.990+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b4 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/backlight/ auth{0=1,1=1,2=1} v2847 ap=1 f(v0 m2024-03-31T23:20:00.843110+0000 1=1+0) n(v0 rc2024-03-31T23:20:00.844110+0000 b1783 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef31700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004b4:[<0x10000000203/backlight v378>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004b4:[<0x10000000203/backlight v2847>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.843110+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.844110+0000 b1783 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.843110+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.844110+0000 b1783 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.991+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e5a [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/locking/ auth{0=1,1=1,2=1} v2845 ap=1 f(v0 m2024-03-31T23:20:00.873110+0000 10=10+0) n(v0 rc2024-03-31T23:20:00.874110+0000 b99271 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@25},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef14000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e5a:[<0x10000000203/locking v1863>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e5a:[<0x10000000203/locking v2845>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.873110+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.874110+0000 b99271 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.873110+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.874110+0000 b99271 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.991+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eab [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/netlabel/ auth{0=1,1=1,2=1} v2843 ap=1 f(v0 m2024-03-31T23:20:00.894110+0000 5=5+0) n(v0 rc2024-03-31T23:20:00.896110+0000 b35714 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000eab:[<0x10000000203/netlabel v1865>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000eab:[<0x10000000203/netlabel v2843>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.894110+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.896110+0000 b35714 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.894110+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.896110+0000 b35714 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.992+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000436 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/ auth{0=1,1=1,2=1} v2841 ap=1 f(v0 m2024-03-31T23:20:00.938110+0000 11=10+1) n(v2 rc2024-03-31T23:20:00.939110+0000 b63745 14=12+2) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@25},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000436:[<0x10000000203/acpi v262>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000436:[<0x10000000203/acpi v2841>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.938110+0000 11=10+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.939110+0000 b63745 14=12+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.938110+0000 11=10+1)","memory_value.rstat":"n(v2 rc2024-03-31T23:20:00.939110+0000 b63745 14=12+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.992+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000444 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/ auth{0=1,1=1,2=1} v2839 ap=1 f(v0 m2024-03-31T23:20:00.963109+0000 6=6+0) n(v0 rc2024-03-31T23:20:00.965109+0000 b9648 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@17},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000444:[<0x10000000203/aoe v276>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000444:[<0x10000000203/aoe v2839>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.963109+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.965109+0000 b9648 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.963109+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.965109+0000 b9648 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.996+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8a [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/prctl/ auth{0=1,1=1,2=1} v2837 ap=1 f(v0 m2024-03-31T23:20:01.004109+0000 7=7+0) n(v0 rc2024-03-31T23:20:01.006109+0000 b18627 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f8a:[<0x10000000203/prctl v1873>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f8a:[<0x10000000203/prctl v2837>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.004109+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.006109+0000 b18627 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.004109+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.006109+0000 b18627 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.997+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e05 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/isdn/ auth{0=1,1=1,2=1} v2835 ap=1 f(v0 m2024-03-31T23:20:01.100108+0000 25=25+0) n(v0 rc2024-03-31T23:20:01.101108+0000 b206038 26=25+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@55},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef16100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e05:[<0x10000000203/isdn v1875>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e05:[<0x10000000203/isdn v2835>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.100108+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.101108+0000 b206038 26=25+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.100108+0000 25=25+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.101108+0000 b206038 26=25+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.014 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.998+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f9 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/ auth{0=1,1=1,2=1} v2833 ap=1 f(v0 m2024-03-31T23:20:01.148108+0000 10=10+0) n(v0 rc2024-03-31T23:20:01.150108+0000 b20559 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@25},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000003f9:[<0x10000000203/EDID v138>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000003f9:[<0x10000000203/EDID v2833>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.148108+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.150108+0000 b20559 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.148108+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.150108+0000 b20559 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.015 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:12.990+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f69 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/regulator/ auth{0=1,1=1,2=1,3=1} v259 ap=1 f(v0 m2024-03-31T23:19:51.242190+0000 5=5+0) n(v0 rc2024-03-31T23:19:51.245190+0000 b20430 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5609be9f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f69:[<0x10000000f59/regulator v66>,<0x10000000203/power v2176>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f69:[<0x10000000f59/regulator v259>,<0x10000000203/power v2713>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.242190+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.245190+0000 b20430 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.242190+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.245190+0000 b20430 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.015 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:12.990+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f67 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/powercap/ auth{0=1,1=1,2=1,3=1} v257 ap=1 f(v0 m2024-03-31T23:19:51.268189+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.271189+0000 b9353 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5609be9f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f67:[<0x10000000f59/powercap v68>,<0x10000000203/power v2176>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f67:[<0x10000000f59/powercap v257>,<0x10000000203/power v2713>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.268189+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.271189+0000 b9353 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.268189+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.271189+0000 b9353 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.015 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.000+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d5 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blockdev/drbd/ auth{0=1,1=1,2=1,3=1} v155 ap=1 f(v0 m2024-03-31T23:19:51.475188+0000 8=8+0) n(v0 rc2024-03-31T23:19:51.479188+0000 b47061 9=8+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5609be9f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004d5:[<0x100000004d0/drbd v26>,<0x10000000203/blockdev v454>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004d5:[<0x100000004d0/drbd v155>,<0x10000000203/blockdev v2714>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.475188+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.479188+0000 b47061 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.475188+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.479188+0000 b47061 9=8+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.015 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.011+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001355 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt auth v254 ap=1 s=3898 n(v0 rc2024-03-31T23:19:43.434254+0000 b3898 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf094680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001355:[<0x1000000086c/ti-omap-hsmmc.txt v94>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001355:[<0x1000000086c/ti-omap-hsmmc.txt v254>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.015 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.989+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e75 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/metag/ auth{0=1,2=1,3=1} v4679 ap=1 f(v0 m2024-03-31T23:20:03.272090+0000 2=2+0) n(v0 rc2024-03-31T23:20:03.273090+0000 b9339 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53801700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e75:[<0x10000000203/metag v2099>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e75:[<0x10000000203/metag v4679>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.272090+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.273090+0000 b9339 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.272090+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.273090+0000 b9339 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.991+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c24 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dvb/ auth{0=1,2=1,3=1} v4677 ap=1 f(v0 m2024-03-31T23:20:03.339090+0000 14=14+0) n(v0 rc2024-03-31T23:20:03.340090+0000 b84313 15=14+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@33},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c24:[<0x10000000203/dvb v2101>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c24:[<0x10000000203/dvb v4677>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.339090+0000 14=14+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.340090+0000 b84313 15=14+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.339090+0000 14=14+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.340090+0000 b84313 15=14+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.991+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/ auth{0=1,2=1,3=1} v4685 ap=1 f(v0 m2024-03-31T23:20:04.349081+0000 5=1+4) n(v3 rc2024-03-31T23:20:04.483080+0000 b636851 259=254+5) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000205:[<0x10000000203/ABI v22>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000205:[<0x10000000203/ABI v4685>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.349081+0000 5=1+4)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.483080+0000 b636851 259=254+5)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.349081+0000 5=1+4)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:04.483080+0000 b636851 259=254+5)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.992+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c41 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fb/ auth{0=1,2=1,3=1} v4665 ap=1 f(v0 m2024-03-31T23:20:04.619079+0000 35=35+0) n(v0 rc2024-03-31T23:20:04.621079+0000 b200222 36=35+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@75},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c41:[<0x10000000203/fb v2113>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c41:[<0x10000000203/fb v4665>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.619079+0000 35=35+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.621079+0000 b200222 36=35+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.619079+0000 35=35+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.621079+0000 b200222 36=35+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.993+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000502 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/connector/ auth{0=1,2=1,3=1} v4663 ap=1 f(v0 m2024-03-31T23:20:04.656079+0000 5=5+0) n(v0 rc2024-03-31T23:20:04.658079+0000 b17328 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000502:[<0x10000000203/connector v526>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000502:[<0x10000000203/connector v4663>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.656079+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.658079+0000 b17328 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.656079+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.658079+0000 b17328 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.996+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4d [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/leds/ auth{0=1,2=1,3=1} v4661 ap=1 f(v0 m2024-03-31T23:20:04.732078+0000 11=11+0) n(v0 rc2024-03-31T23:20:04.735078+0000 b36987 12=11+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@27},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e4d:[<0x10000000203/leds v2117>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e4d:[<0x10000000203/leds v4661>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.732078+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.735078+0000 b36987 12=11+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.732078+0000 11=11+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.735078+0000 b36987 12=11+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.997+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc3 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/ auth{0=1,2=1,3=1} fragtree_t(*^3) v4687 ap=1 f(v0 m2024-03-31T23:20:04.967076+0000 57=56+1) n(v3 rc2024-03-31T23:20:04.968076+0000 b805421 60=58+2) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@124},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fc3:[<0x10000000203/scsi v2164>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000fc3:[<0x10000000203/scsi v4687>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.967076+0000 57=56+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.968076+0000 b805421 60=58+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.967076+0000 57=56+1)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:04.968076+0000 b805421 60=58+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:12.998+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f56 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/platform/ auth{0=1,2=1,3=1} v4655 ap=1 f(v0 m2024-03-31T23:20:04.971076+0000 1=1+0) n(v0 rc2024-03-31T23:20:04.972076+0000 b358 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f56:[<0x10000000203/platform v2123>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f56:[<0x10000000203/platform v4655>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.971076+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.972076+0000 b358 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.971076+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.972076+0000 b358 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.999+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dfb [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ioctl/ auth{0=1,1=1,2=1} v2831 ap=1 f(v0 m2024-03-31T23:20:01.168108+0000 6=6+0) n(v0 rc2024-03-31T23:20:01.169108+0000 b68936 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@17},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef16c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000dfb:[<0x10000000203/ioctl v1879>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000dfb:[<0x10000000203/ioctl v2831>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.168108+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.169108+0000 b68936 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.168108+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.169108+0000 b68936 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.016 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:12.999+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e69 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/m68k/ auth{0=1,1=1,2=1} v2829 ap=1 f(v0 m2024-03-31T23:20:01.184108+0000 3=3+0) n(v0 rc2024-03-31T23:20:01.185108+0000 b40924 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e69:[<0x10000000203/m68k v1881>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e69:[<0x10000000203/m68k v2829>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.184108+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.185108+0000 b40924 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.184108+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.185108+0000 b40924 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.000+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f42 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/parisc/ auth{0=1,1=1,2=1} v2827 ap=1 f(v0 m2024-03-31T23:20:01.202107+0000 3=3+0) n(v0 rc2024-03-31T23:20:01.203107+0000 b6360 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f42:[<0x10000000203/parisc v1883>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f42:[<0x10000000203/parisc v2827>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.202107+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.203107+0000 b6360 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.202107+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.203107+0000 b6360 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.008+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a7 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm64/ auth{0=1,1=1,2=1} v2818 ap=1 f(v0 m2024-03-31T23:20:00.117116+0000 4=4+0) n(v0 rc2024-03-31T23:20:00.118116+0000 b16817 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@13},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef26c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004a7:[<0x10000000203/arm64 v358>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004a7:[<0x10000000203/arm64 v2818>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.117116+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.118116+0000 b16817 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.117116+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.118116+0000 b16817 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.008+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113f [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vm/ auth{0=1,1=1,2=1} v2816 ap=1 f(v0 m2024-03-31T23:20:00.189116+0000 23=23+0) n(v0 rc2024-03-31T23:20:00.190116+0000 b195380 24=23+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@51},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef27180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000113f:[<0x10000000203/vm v1913>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000113f:[<0x10000000203/vm v2816>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.189116+0000 23=23+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.190116+0000 b195380 24=23+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.189116+0000 23=23+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.190116+0000 b195380 24=23+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.010+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001091 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/tpm/ auth{0=1,1=1,2=1} v2814 ap=1 f(v0 m2024-03-31T23:20:00.197116+0000 1=1+0) n(v0 rc2024-03-31T23:20:00.198116+0000 b4388 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef27700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001091:[<0x10000000203/tpm v1915>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001091:[<0x10000000203/tpm v2814>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.197116+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.198116+0000 b4388 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.197116+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.198116+0000 b4388 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.003+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000521 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/crypto/ auth{0=1,2=1,3=1} v4653 ap=1 f(v0 m2024-03-31T23:20:04.992076+0000 5=5+0) n(v0 rc2024-03-31T23:20:04.993076+0000 b52654 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000521:[<0x10000000203/crypto v588>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000521:[<0x10000000203/crypto v4653>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.992076+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.993076+0000 b52654 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.992076+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.993076+0000 b52654 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.003+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dba [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ia64/ auth{0=1,2=1,3=1} v4651 ap=1 f(v0 m2024-03-31T23:20:05.048076+0000 12=12+0) n(v0 rc2024-03-31T23:20:05.050076+0000 b82160 13=12+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@29},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000dba:[<0x10000000203/ia64 v2127>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000dba:[<0x10000000203/ia64 v4651>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.048076+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.050076+0000 b82160 13=12+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.048076+0000 12=12+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.050076+0000 b82160 13=12+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.004+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d6 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/ auth{0=1,2=1,3=1} v4649 ap=1 f(v0 m2024-03-31T23:20:05.409073+0000 51=48+3) n(v2 rc2024-03-31T23:20:05.411073+0000 b563087 79=75+4) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@101},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000010d6:[<0x10000000203/video4linux v2166>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000010d6:[<0x10000000203/video4linux v4649>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.409073+0000 51=48+3)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.411073+0000 b563087 79=75+4)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.409073+0000 51=48+3)","memory_value.rstat":"n(v2 rc2024-03-31T23:20:05.411073+0000 b563087 79=75+4)","error_str":""},"return_code":0} 2024-03-31T23:20:13.017 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.004+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f96 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ptp/ auth{0=1,2=1,3=1} v4641 ap=1 f(v0 m2024-03-31T23:20:05.435072+0000 5=5+0) n(v0 rc2024-03-31T23:20:05.438072+0000 b17229 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f96:[<0x10000000203/ptp v2137>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f96:[<0x10000000203/ptp v4641>,<0x10000000202/Documentation v1094>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.435072+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.438072+0000 b17229 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.435072+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.438072+0000 b17229 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.007+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001125 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/ auth{0=1,2=1,3=1} v4683 ap=1 f(v0 m2024-03-31T23:20:05.551072+0000 4=2+2) n(v4 rc2024-03-31T23:20:05.556071+0000 b336318 26=22+4) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001125:[<0x10000000203/virtual v2168>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001125:[<0x10000000203/virtual v4683>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.551072+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.556071+0000 b336318 26=22+4)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.551072+0000 4=2+2)","memory_value.rstat":"n(v4 rc2024-03-31T23:20:05.556071+0000 b336318 26=22+4)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.008+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000534 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/device-mapper/ auth{0=1,2=1,3=1} v4633 ap=1 f(v0 m2024-03-31T23:20:05.659071+0000 22=22+0) n(v0 rc2024-03-31T23:20:05.661071+0000 b96256 23=22+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@49},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53826580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000534:[<0x10000000203/device-mapper v660>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000534:[<0x10000000203/device-mapper v4633>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.659071+0000 22=22+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.661071+0000 b96256 23=22+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.659071+0000 22=22+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.661071+0000 b96256 23=22+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.009+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000414 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/ auth{0=1,2=1,3=1} v4631 ap=1 f(v0 m2024-03-31T23:20:05.751070+0000 18=18+0) n(v0 rc2024-03-31T23:20:05.755070+0000 b269186 19=18+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@41},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53826b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000414:[<0x10000000203/RCU v208>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000414:[<0x10000000203/RCU v4631>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.751070+0000 18=18+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.755070+0000 b269186 19=18+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.751070+0000 18=18+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.755070+0000 b269186 19=18+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.010+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e86 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/ auth{0=1,2=1,3=1} v4629 ap=1 f(v0 m2024-03-31T23:20:06.867061+0000 12=11+1) n(v2 rc2024-03-31T23:20:06.868061+0000 b55549 19=17+2) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@27},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53827080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e86:[<0x10000000203/misc-devices v2162>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e86:[<0x10000000203/misc-devices v4629>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:06.867061+0000 12=11+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:06.868061+0000 b55549 19=17+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:06.867061+0000 12=11+1)","memory_value.rstat":"n(v2 rc2024-03-31T23:20:06.868061+0000 b55549 19=17+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.011+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/ auth{0=1,2=1,3=1} v4625 ap=1 f(v0 m2024-03-31T23:20:06.886060+0000 7=7+0) n(v0 rc2024-03-31T23:20:06.887060+0000 b92652 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53827b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000040c:[<0x10000000203/PCI v170>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000040c:[<0x10000000203/PCI v4625>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:06.886060+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:06.887060+0000 b92652 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:06.886060+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:06.887060+0000 b92652 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.011+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f39 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nfc/ auth{0=1,2=1,3=1} v4623 ap=1 f(v0 m2024-03-31T23:20:06.891060+0000 2=2+0) n(v0 rc2024-03-31T23:20:06.892060+0000 b14054 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53828100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f39:[<0x10000000203/nfc v2155>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f39:[<0x10000000203/nfc v4623>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:06.891060+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:06.892060+0000 b14054 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:06.891060+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:06.892060+0000 b14054 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.012+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce9 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/frv/ auth{0=1,2=1,3=1} v4621 ap=1 f(v0 m2024-03-31T23:20:06.957060+0000 10=10+0) n(v0 rc2024-03-31T23:20:06.959060+0000 b69347 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@25},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53828680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ce9:[<0x10000000203/frv v2157>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ce9:[<0x10000000203/frv v4621>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:06.957060+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:06.959060+0000 b69347 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:06.957060+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:06.959060+0000 b69347 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.018 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:12 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 -- 172.21.15.42:0/1066076831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 msgr2=0x7fcc78107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/1066076831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc78107ae0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009930 tx=0x7fcc6c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 -- 172.21.15.42:0/1066076831 shutdown_connections 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/1066076831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781020b0 0x7fcc7810e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/1066076831 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781016f0 0x7fcc78101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/1066076831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc78107ae0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 -- 172.21.15.42:0/1066076831 >> 172.21.15.42:0/1066076831 conn(0x7fcc780fd180 msgr2=0x7fcc780ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 -- 172.21.15.42:0/1066076831 shutdown_connections 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.113+0000 7fcc7ec49640 1 -- 172.21.15.42:0/1066076831 wait complete. 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 Processor -- start 2024-03-31T23:20:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 -- start start 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781016f0 0x7fcc78198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781020b0 0x7fcc78198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc7819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78111c00 con 0x7fcc78107700 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78111a80 con 0x7fcc781020b0 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7ec49640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78111d80 con 0x7fcc781016f0 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781020b0 0x7fcc78198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781016f0 0x7fcc78198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7d1e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc7819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781016f0 0x7fcc78198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:41562/0 (socket says 172.21.15.42:41562) 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781020b0 0x7fcc78198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:42120/0 (socket says 172.21.15.42:42120) 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.114+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/3852457852 learned_addr learned my addr 172.21.15.42:0/3852457852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:13.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7d1e6640 1 -- 172.21.15.42:0/3852457852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781016f0 msgr2=0x7fcc78198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7d1e6640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781016f0 0x7fcc78198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7d1e6640 1 -- 172.21.15.42:0/3852457852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781020b0 msgr2=0x7fcc78198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7d1e6640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781020b0 0x7fcc78198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7d1e6640 1 -- 172.21.15.42:0/3852457852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7819d130 con 0x7fcc78107700 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7d1e6640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc7819ca00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000be20 tx=0x7fcc70009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc75ffb640 1 -- 172.21.15.42:0/3852457852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70019070 con 0x7fcc78107700 2024-03-31T23:20:13.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7819d420 con 0x7fcc78107700 2024-03-31T23:20:13.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.115+0000 7fcc75ffb640 1 -- 172.21.15.42:0/3852457852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc7000cd70 con 0x7fcc78107700 2024-03-31T23:20:13.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.116+0000 7fcc75ffb640 1 -- 172.21.15.42:0/3852457852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70012860 con 0x7fcc78107700 2024-03-31T23:20:13.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.116+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc781a4cb0 con 0x7fcc78107700 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.118+0000 7fcc75ffb640 1 -- 172.21.15.42:0/3852457852 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fcc7001c070 con 0x7fcc78107700 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.118+0000 7fcc8181f740 1 Processor -- start 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.118+0000 7fcc8181f740 1 -- start start 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a668290 0x55d82a668670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a671250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a671790 0x55d82a673b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc8181f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d82a5cc180 con 0x55d82a668bb0 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc8181f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55d82a574b70 con 0x55d82a671790 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc8181f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d82a5c8220 con 0x55d82a668290 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc75ffb640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fcc680a2690 0x7fcc680a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a668290 0x55d82a668670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a671250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a668290 0x55d82a668670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:41576/0 (socket says 172.21.15.42:41576) 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a671250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34970/0 (socket says 172.21.15.42:34970) 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc77fff640 1 -- 172.21.15.42:0/3637059123 learned_addr learned my addr 172.21.15.42:0/3637059123 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc77fff640 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a671790 0x55d82a673b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7d1e6640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fcc680a2690 0x7fcc680a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc75ffb640 1 -- 172.21.15.42:0/3852457852 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fcc700ce550 con 0x7fcc78107700 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/3637059123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a668290 msgr2=0x55d82a668670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a668290 0x55d82a668670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/3637059123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a671790 msgr2=0x55d82a673b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a671790 0x55d82a673b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/3637059123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82a5887c0 con 0x55d82a668bb0 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.119+0000 7fcc77fff640 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a671790 0x55d82a673b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.120+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a671250 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c005ec0 tx=0x7fcc6c02c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c742322e7c222c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.120+0000 7fcc7d1e6640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fcc680a2690 0x7fcc680a4b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc7009a7e0 tx=0x7fcc70004b50 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.120+0000 7fcc62ffd640 1 -- 172.21.15.42:0/3637059123 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c02da60 con 0x55d82a668bb0 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.120+0000 7fcc62ffd640 1 -- 172.21.15.42:0/3637059123 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c02dc00 con 0x55d82a668bb0 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.120+0000 7fcc62ffd640 1 -- 172.21.15.42:0/3637059123 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004920 con 0x55d82a668bb0 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 -- 172.21.15.42:0/3637059123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 msgr2=0x55d82a671250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a671250 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c005ec0 tx=0x7fcc6c02c7d0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 -- 172.21.15.42:0/3637059123 shutdown_connections 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a671790 0x55d82a673b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a671250 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 --2- 172.21.15.42:0/3637059123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a668290 0x55d82a668670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 -- 172.21.15.42:0/3637059123 >> 172.21.15.42:0/3637059123 conn(0x55d82a6629c0 msgr2=0x55d82a662da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 -- 172.21.15.42:0/3637059123 shutdown_connections 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.121+0000 7fcc8181f740 1 -- 172.21.15.42:0/3637059123 wait complete. 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 -- start start 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 Processor -- start 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a671030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a66a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a66a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d82a678930 con 0x55d82a668bb0 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55d82a56a4a0 con 0x55d82a668290 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d82a678ab0 con 0x55d82a671790 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc8181f740 10 client.0 _ll_register_callbacks cb 0x55d82a56dd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a66a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a66a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34978/0 (socket says 172.21.15.42:34978) 2024-03-31T23:20:13.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/1151193651 learned_addr learned my addr 172.21.15.42:0/1151193651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.122+0000 7fcc77fff640 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a66a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/1151193651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 msgr2=0x55d82a66a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a66a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 msgr2=0x55d82a671030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a671030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/1151193651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82a3aa7d0 con 0x55d82a668bb0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a66a380 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c004640 tx=0x7fcc6c0053f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ff7511b4c17c6d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc57fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc57fff640 1 -- 172.21.15.42:0/1151193651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c04f070 con 0x55d82a668bb0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc6c02dc00 con 0x55d82a668bb0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc57fff640 1 -- 172.21.15.42:0/1151193651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fcc6c003a00 con 0x55d82a668bb0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc57fff640 1 -- 172.21.15.42:0/1151193651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcc6c003c00 con 0x55d82a668bb0 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc8181f740 10 client.16527 fetch_fsmap learned FSMap version 32 2024-03-31T23:20:13.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.123+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d82a2e03f0 con 0x55d82a668bb0 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc57fff640 1 -- 172.21.15.42:0/1151193651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c02dc00 con 0x55d82a668bb0 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc57fff640 1 -- 172.21.15.42:0/1151193651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7fcc6c052020 con 0x55d82a668bb0 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc8181f740 10 client.16527 fetch_fsmap finished waiting for FSMap version 32 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc8181f740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc8181f740 20 client.16527 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc8181f740 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a68c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc8181f740 4 client.16527 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d82a5d96c0 con 0x55d82a68a1a0 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.124+0000 7fcc77fff640 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a68c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.125+0000 7fcc57fff640 10 client.16527 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:13.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.125+0000 7fcc77fff640 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a68c590 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7820b28574cfae8e server_cookie=6f841b4ed62b0c78 in_seq=0 out_seq=0 2024-03-31T23:20:13.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc57fff640 1 -- 172.21.15.42:0/1151193651 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d82a5d96c0 con 0x55d82a68a1a0 2024-03-31T23:20:13.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc57fff640 10 client.16527 handle_command_reply: tid=0 2024-03-31T23:20:13.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 client.16527 shutdown 2024-03-31T23:20:13.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 msgr2=0x55d82a66a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a66a380 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c004640 tx=0x7fcc6c0053f0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 shutdown_connections 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a68c590 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc57fff640 0 client.16527 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a66a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a66a380 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 --2- 172.21.15.42:0/1151193651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a671030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 >> 172.21.15.42:0/1151193651 conn(0x55d82a6629c0 msgr2=0x55d82a664710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 shutdown_connections 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.126+0000 7fcc8181f740 1 -- 172.21.15.42:0/1151193651 wait complete. 2024-03-31T23:20:13.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.127+0000 7fcc8181f740 20 client.16527 trim_cache size 0 max 16384 2024-03-31T23:20:13.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 Processor -- start 2024-03-31T23:20:13.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 -- start start 2024-03-31T23:20:13.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a691bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a670b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781ac960 con 0x55d82a668bb0 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781ae590 con 0x55d82a668290 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc8181f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781ad060 con 0x55d82a671790 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a670b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc7c9e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a670b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34994/0 (socket says 172.21.15.42:34994) 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/2183300281 learned_addr learned my addr 172.21.15.42:0/2183300281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc77fff640 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a691bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.150+0000 7fcc77fff640 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/2183300281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 msgr2=0x55d82a676a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/2183300281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 msgr2=0x55d82a691bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a691bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc7c9e5640 1 -- 172.21.15.42:0/2183300281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82a6689e0 con 0x55d82a668bb0 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a670b60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c041610 tx=0x7fcc6c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e13d7889909322c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc627fc640 1 -- 172.21.15.42:0/2183300281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c04f040 con 0x55d82a668bb0 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc627fc640 1 -- 172.21.15.42:0/2183300281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c009520 con 0x55d82a668bb0 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.151+0000 7fcc627fc640 1 -- 172.21.15.42:0/2183300281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c041800 con 0x55d82a668bb0 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 -- 172.21.15.42:0/2183300281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 msgr2=0x55d82a670b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a670b60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c041610 tx=0x7fcc6c005a20 comp rx=0 tx=0).stop 2024-03-31T23:20:13.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 -- 172.21.15.42:0/2183300281 shutdown_connections 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668bb0 0x55d82a670b60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 --2- 172.21.15.42:0/2183300281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668290 0x55d82a691bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 -- 172.21.15.42:0/2183300281 >> 172.21.15.42:0/2183300281 conn(0x55d82a6629c0 msgr2=0x55d82a6690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 -- 172.21.15.42:0/2183300281 shutdown_connections 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 -- 172.21.15.42:0/2183300281 wait complete. 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 -- start start 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.152+0000 7fcc8181f740 1 Processor -- start 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 0x55d82a686e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668bb0 0x55d82a676700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781ade00 con 0x55d82a668290 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781ad730 con 0x55d82a668bb0 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781aa920 con 0x55d82a671790 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc8181f740 10 client.0 _ll_register_callbacks cb 0x7fcc6400aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 0x55d82a686e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 0x55d82a686e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35004/0 (socket says 172.21.15.42:35004) 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 -- 172.21.15.42:0/4164897980 learned_addr learned my addr 172.21.15.42:0/4164897980 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668bb0 0x55d82a676700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 -- 172.21.15.42:0/4164897980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 msgr2=0x55d82a676c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 -- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668bb0 msgr2=0x55d82a676700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668bb0 0x55d82a676700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 -- 172.21.15.42:0/4164897980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82a2a00f0 con 0x55d82a668290 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc77fff640 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 0x55d82a686e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400ad40 tx=0x7fcc64011410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f89b81c770d0be server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.153+0000 7fcc57fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc57fff640 1 -- 172.21.15.42:0/4164897980 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64005220 con 0x55d82a668290 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc57fff640 1 -- 172.21.15.42:0/4164897980 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fcc640053c0 con 0x55d82a668290 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc6c009520 con 0x55d82a668290 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc57fff640 1 -- 172.21.15.42:0/4164897980 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcc64032050 con 0x55d82a668290 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 10 client.16533 fetch_fsmap learned FSMap version 32 2024-03-31T23:20:13.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d82a6f00e0 con 0x55d82a668290 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc57fff640 1 -- 172.21.15.42:0/4164897980 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c009520 con 0x55d82a668290 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc57fff640 1 -- 172.21.15.42:0/4164897980 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7fcc64010870 con 0x55d82a668290 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 10 client.16533 fetch_fsmap finished waiting for FSMap version 32 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 20 client.16533 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a6f2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:13.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 4 client.16533 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:20:13.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d82a5d3a10 con 0x55d82a68a1a0 2024-03-31T23:20:13.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.154+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a6f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:13.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.155+0000 7fcc7c9e5640 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a6f2910 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed478f06352e53 server_cookie=b4db84039c04ba37 in_seq=0 out_seq=0 2024-03-31T23:20:13.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.155+0000 7fcc57fff640 10 client.16533 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:13.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc57fff640 1 -- 172.21.15.42:0/4164897980 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55d82a5d3a10 con 0x55d82a68a1a0 2024-03-31T23:20:13.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc57fff640 10 client.16533 handle_command_reply: tid=0 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 client.16533 shutdown 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 msgr2=0x55d82a686e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 0x55d82a686e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400ad40 tx=0x7fcc64011410 comp rx=0 tx=0).stop 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 shutdown_connections 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55d82a68a1a0 0x55d82a6f2910 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d82a671790 0x55d82a676c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d82a668bb0 0x55d82a676700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 --2- 172.21.15.42:0/4164897980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d82a668290 0x55d82a686e70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 >> 172.21.15.42:0/4164897980 conn(0x55d82a6629c0 msgr2=0x55d82a661390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:13.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc57fff640 0 client.16533 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:13.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 shutdown_connections 2024-03-31T23:20:13.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 1 -- 172.21.15.42:0/4164897980 wait complete. 2024-03-31T23:20:13.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.156+0000 7fcc8181f740 20 client.16533 trim_cache size 0 max 16384 2024-03-31T23:20:13.168 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:20:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (286 inodes in the stack)", 2024-03-31T23:20:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-03-31T23:20:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "ccdf6745-ce8d-465a-b703-508815353171": { 2024-03-31T23:20:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-03-31T23:20:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "ccdf6745-ce8d-465a-b703-508815353171", 2024-03-31T23:20:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-03-31T23:20:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:20:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:20:13.170 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:20:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fcc680a2690 msgr2=0x7fcc680a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fcc680a2690 0x7fcc680a4b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc7009a7e0 tx=0x7fcc70004b50 comp rx=0 tx=0).stop 2024-03-31T23:20:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 msgr2=0x7fcc7819ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc7819ca00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000be20 tx=0x7fcc70009ed0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 shutdown_connections 2024-03-31T23:20:13.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fcc680a2690 0x7fcc680a4b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc78107700 0x7fcc7819ca00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc781020b0 0x7fcc78198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 --2- 172.21.15.42:0/3852457852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc781016f0 0x7fcc78198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:13.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 >> 172.21.15.42:0/3852457852 conn(0x7fcc780fd180 msgr2=0x7fcc780fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:13.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 shutdown_connections 2024-03-31T23:20:13.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:13.157+0000 7fcc7ec49640 1 -- 172.21.15.42:0/3852457852 wait complete. 2024-03-31T23:20:13.175 INFO:tasks.cephfs.filesystem:scrub status for tag:ccdf6745-ce8d-465a-b703-508815353171 - {'path': '/', 'tag': 'ccdf6745-ce8d-465a-b703-508815353171', 'options': 'recursive,force'} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.014+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3d [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fault-injection/ auth{0=1,1=1,2=1} v2812 ap=1 f(v0 m2024-03-31T23:20:00.212116+0000 3=3+0) n(v0 rc2024-03-31T23:20:00.213116+0000 b12646 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef2e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c3d:[<0x10000000203/fault-injection v1917>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c3d:[<0x10000000203/fault-injection v2812>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.212116+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.213116+0000 b12646 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.212116+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.213116+0000 b12646 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.016+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cpuidle/ auth{0=1,1=1,2=1} v2810 ap=1 f(v0 m2024-03-31T23:20:00.227115+0000 4=4+0) n(v0 rc2024-03-31T23:20:00.228115+0000 b6633 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@13},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef2e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000518:[<0x10000000203/cpuidle v568>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000518:[<0x10000000203/cpuidle v2810>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.227115+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.228115+0000 b6633 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.227115+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.228115+0000 b6633 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.018+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001199 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/ auth{0=1,1=1,2=1} v2808 ap=1 f(v0 m2024-03-31T23:20:00.302115+0000 20=16+4) n(v2 rc2024-03-31T23:20:00.303115+0000 b276606 29=24+5) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@37},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef2eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001199:[<0x10000000203/zh_CN v1934>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001199:[<0x10000000203/zh_CN v2808>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.302115+0000 20=16+4)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.303115+0000 b276606 29=24+5)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.302115+0000 20=16+4)","memory_value.rstat":"n(v2 rc2024-03-31T23:20:00.303115+0000 b276606 29=24+5)","error_str":""},"return_code":0} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.019+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c0 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/block/ auth{0=1,1=1,2=1} v2798 ap=1 f(v0 m2024-03-31T23:20:00.348114+0000 15=15+0) n(v0 rc2024-03-31T23:20:00.349114+0000 b114009 16=15+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@35},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef30680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004c0:[<0x10000000203/block v430>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004c0:[<0x10000000203/block v2798>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.348114+0000 15=15+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.349114+0000 b114009 16=15+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.348114+0000 15=15+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.349114+0000 b114009 16=15+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.080+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000437 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/ auth{0=1,1=1,2=1} v128 ap=1 f(v0 m2024-03-31T23:20:00.928110+0000 2=2+0) n(v0 rc2024-03-31T23:20:00.929110+0000 b10319 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@8},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000437:[<0x10000000436/apei v6>,<0x10000000203/acpi v262>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000437:[<0x10000000436/apei v128>,<0x10000000203/acpi v2841>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.928110+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.929110+0000 b10319 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.928110+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.929110+0000 b10319 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.132+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000493 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/ auth{0=1,1=1,2=1} v725 ap=1 f(v0 m2024-03-31T23:19:51.611187+0000 4=4+0) n(v0 rc2024-03-31T23:19:51.613187+0000 b14784 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feeda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000493:[<0x1000000044c/nwfpe v150>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000493:[<0x1000000044c/nwfpe v725>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.611187+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.613187+0000 b14784 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.611187+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.613187+0000 b14784 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.273 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.133+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000498 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/ auth{0=1,1=1,2=1,4=1} v723 ap=1 f(v0 m2024-03-31T23:19:51.615187+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.617187+0000 b10957 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feeda580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000498:[<0x1000000044c/pxa v154>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000498:[<0x1000000044c/pxa v723>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.615187+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.617187+0000 b10957 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.615187+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.617187+0000 b10957 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.138+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045d [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ auth{0=1,1=1,2=1} v721 ap=1 f(v0 m2024-03-31T23:19:51.709186+0000 18=18+0) n(v0 rc2024-03-31T23:19:51.711186+0000 b26371 19=18+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000045d:[<0x1000000044c/SA1100 v70>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000045d:[<0x1000000044c/SA1100 v721>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.709186+0000 18=18+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.711186+0000 b26371 19=18+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.709186+0000 18=18+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.711186+0000 b26371 19=18+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.011+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001354 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt auth v264 ap=1 s=4296 n(v0 rc2024-03-31T23:19:43.428254+0000 b4296 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf094100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001354:[<0x1000000086c/synopsys-dw-mshc.txt v90>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001354:[<0x1000000086c/synopsys-dw-mshc.txt v264>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.012+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001353 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt auth v306 ap=1 s=5571 n(v0 rc2024-03-31T23:19:43.424254+0000 b5571 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf093b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001353:[<0x1000000086c/mmc.txt v86>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001353:[<0x1000000086c/mmc.txt v306>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.012+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001356 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt auth v300 ap=1 s=1322 n(v0 rc2024-03-31T23:19:43.440254+0000 b1322 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf094c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001356:[<0x1000000086c/nvidia,tegra20-sdhci.txt v98>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001356:[<0x1000000086c/nvidia,tegra20-sdhci.txt v300>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.012+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001352 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt auth v240 ap=1 s=759 n(v0 rc2024-03-31T23:19:43.419254+0000 b759 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf093600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001352:[<0x1000000086c/socfpga-dw-mshc.txt v82>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001352:[<0x1000000086c/socfpga-dw-mshc.txt v240>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.013+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001357 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt auth v296 ap=1 s=1269 n(v0 rc2024-03-31T23:19:43.444254+0000 b1269 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf095180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001357:[<0x1000000086c/fsl-imx-esdhc.txt v102>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001357:[<0x1000000086c/fsl-imx-esdhc.txt v296>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.274 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.013+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001358 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt auth v294 ap=1 s=333 n(v0 rc2024-03-31T23:19:43.450254+0000 b333 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf095700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001358:[<0x1000000086c/sdhci-dove.txt v106>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001358:[<0x1000000086c/sdhci-dove.txt v294>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.013+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135a [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt auth v246 ap=1 s=1343 n(v0 rc2024-03-31T23:19:43.459254+0000 b1343 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf072580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000135a:[<0x1000000086c/tmio_mmc.txt v114>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000135a:[<0x1000000086c/tmio_mmc.txt v246>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.013+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001359 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt auth v244 ap=1 s=417 n(v0 rc2024-03-31T23:19:43.455254+0000 b417 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf072000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001359:[<0x1000000086c/sdhci-sirf.txt v110>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001359:[<0x1000000086c/sdhci-sirf.txt v244>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.014+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135d [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt auth v238 ap=1 s=1009 n(v0 rc2024-03-31T23:19:43.476254+0000 b1009 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf073600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000135d:[<0x1000000086c/arasan,sdhci.txt v126>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000135d:[<0x1000000086c/arasan,sdhci.txt v238>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.020+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000508 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/console/ auth{0=1,2=1,3=1} v4619 ap=1 f(v0 m2024-03-31T23:20:06.983060+0000 1=1+0) n(v0 rc2024-03-31T23:20:06.984060+0000 b5892 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53828c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000508:[<0x10000000203/console v530>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000508:[<0x10000000203/console v4619>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:06.983060+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:06.984060+0000 b5892 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:06.983060+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:06.984060+0000 b5892 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.021+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb1 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/ auth{0=1,2=1,3=1} fragtree_t(*^3) v4126 ap=1 f(v1 m2024-03-31T23:20:01.878102+0000 124=121+3) n(v3 rc2024-03-31T23:20:01.879102+0000 b1307136 136=132+4) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@384},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000eb1:[<0x10000000203/networking v2156>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000eb1:[<0x10000000203/networking v4126>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.878102+0000 124=121+3)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.879102+0000 b1307136 136=132+4)","memory_value.dirstat":"f(v1 m2024-03-31T23:20:01.878102+0000 124=121+3)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:01.879102+0000 b1307136 136=132+4)","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.023+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c34 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/early-userspace/ auth{0=1,2=1,3=1} v4112 ap=1 f(v0 m2024-03-31T23:20:01.911102+0000 2=2+0) n(v0 rc2024-03-31T23:20:01.914102+0000 b11417 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c34:[<0x10000000203/early-userspace v2117>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c34:[<0x10000000203/early-userspace v4112>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.911102+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.913102+0000 b11417 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.911102+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.914102+0000 b11417 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.024+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c13 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dmaengine/ auth{0=1,2=1,3=1} v4114 ap=1 f(v0 m2024-03-31T23:20:01.901102+0000 4=4+0) n(v0 rc2024-03-31T23:20:01.902102+0000 b27112 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@13},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c13:[<0x10000000203/dmaengine v2115>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c13:[<0x10000000203/dmaengine v4114>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.901102+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.902102+0000 b27112 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.901102+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.902102+0000 b27112 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.025+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000310 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/ auth{0=1,2=1,3=1} v4128 ap=1 f(v0 m2024-03-31T23:20:02.906093+0000 37=36+1) n(v4 rc2024-03-31T23:20:02.907093+0000 b3385599 233=229+4) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@77},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000310:[<0x10000000203/DocBook v116>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000310:[<0x10000000203/DocBook v4128>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.906093+0000 37=36+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.907093+0000 b3385599 233=229+4)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.906093+0000 37=36+1)","memory_value.rstat":"n(v4 rc2024-03-31T23:20:02.907093+0000 b3385599 233=229+4)","error_str":""},"return_code":0} 2024-03-31T23:20:13.275 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.027+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004eb [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cdrom/ auth{0=1,2=1,3=1} v4106 ap=1 f(v0 m2024-03-31T23:20:02.926093+0000 5=5+0) n(v0 rc2024-03-31T23:20:02.927093+0000 b75365 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004eb:[<0x10000000203/cdrom v480>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004eb:[<0x10000000203/cdrom v4106>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.926093+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.927093+0000 b75365 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.926093+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:02.927093+0000 b75365 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.029+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cdd [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fmc/ auth{0=1,2=1,3=1} v4104 ap=1 f(v0 m2024-03-31T23:20:02.958093+0000 11=11+0) n(v0 rc2024-03-31T23:20:02.959093+0000 b47486 12=11+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@27},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000cdd:[<0x10000000203/fmc v2125>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000cdd:[<0x10000000203/fmc v4104>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.958093+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.959093+0000 b47486 12=11+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.958093+0000 11=11+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:02.959093+0000 b47486 12=11+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.030+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d92 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/ auth{0=1,2=1,3=1} v4130 ap=1 f(v0 m2024-03-31T23:20:03.095092+0000 14=12+2) n(v3 rc2024-03-31T23:20:03.096092+0000 b118540 37=34+3) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@29},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000d92:[<0x10000000203/i2c v2131>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000d92:[<0x10000000203/i2c v4130>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.095092+0000 14=12+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.096092+0000 b118540 37=34+3)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.095092+0000 14=12+2)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:03.096092+0000 b118540 37=34+3)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.141+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000458 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/ auth{0=1,1=1,2=1,4=1} v719 ap=1 f(v0 m2024-03-31T23:19:51.723186+0000 2=2+0) n(v0 rc2024-03-31T23:19:51.725186+0000 b18502 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000458:[<0x1000000044c/OMAP v28>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000458:[<0x1000000044c/OMAP v719>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.723186+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.725186+0000 b18502 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.723186+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.725186+0000 b18502 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.141+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000476 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/ auth{0=1,1=1,2=1,4=1} v717 ap=1 f(v0 m2024-03-31T23:19:51.732186+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.735186+0000 b1982 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000476:[<0x1000000044c/SPEAr v86>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000476:[<0x1000000044c/SPEAr v717>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.732186+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.735186+0000 b1982 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.732186+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.735186+0000 b1982 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.142+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/ auth{0=1,1=1,2=1} v715 ap=1 f(v0 m2024-03-31T23:19:51.736186+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.739185+0000 b4519 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000044e:[<0x1000000044c/Atmel v6>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000044e:[<0x1000000044c/Atmel v715>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.736186+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.739185+0000 b4519 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.736186+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.739185+0000 b4519 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.151+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049a [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/ auth{0=1,1=1,2=1,4=1} v713 ap=1 f(v0 m2024-03-31T23:19:51.764185+0000 5=5+0) n(v0 rc2024-03-31T23:19:51.766185+0000 b2497 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000049a:[<0x1000000044c/sti v166>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000049a:[<0x1000000044c/sti v713>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.764185+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.766185+0000 b2497 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.764185+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.766185+0000 b2497 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.152+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000478 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ auth{0=1,1=1,2=1,4=1} v711 ap=1 f(v0 m2024-03-31T23:19:51.835185+0000 11=11+0) n(v0 rc2024-03-31T23:19:51.837185+0000 b29869 12=11+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000478:[<0x1000000044c/Samsung-S3C24XX v110>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000478:[<0x1000000044c/Samsung-S3C24XX v711>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.835185+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.836185+0000 b29869 12=11+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.835185+0000 11=11+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.837185+0000 b29869 12=11+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.276 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.156+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a0 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/ auth{0=1,1=1,2=1,4=1} v709 ap=1 f(v0 m2024-03-31T23:19:51.846185+0000 2=2+0) n(v0 rc2024-03-31T23:19:51.848185+0000 b3867 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004a0:[<0x1000000044c/sunxi v172>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004a0:[<0x1000000044c/sunxi v709>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.846185+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.848185+0000 b3867 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.846185+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.848185+0000 b3867 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.157+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000455 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/ auth{0=1,1=1,2=1} v707 ap=1 f(v0 m2024-03-31T23:19:51.857185+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.859185+0000 b13718 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000455:[<0x1000000044c/Marvell v20>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000455:[<0x1000000044c/Marvell v707>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.857185+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.859185+0000 b13718 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.857185+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.859185+0000 b13718 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.157+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000484 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/ auth{0=1,1=1,2=1,4=1} v705 ap=1 f(v0 m2024-03-31T23:19:51.868184+0000 3=3+0) n(v0 rc2024-03-31T23:19:51.871184+0000 b7078 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feedd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000484:[<0x1000000044c/Samsung v118>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000484:[<0x1000000044c/Samsung v705>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.868184+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.871184+0000 b7078 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.868184+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.871184+0000 b7078 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.014+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135b [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt auth v304 ap=1 s=1082 n(v0 rc2024-03-31T23:19:43.465254+0000 b1082 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf072b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000135b:[<0x1000000086c/mmc-pwrseq-emmc.txt v118>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000135b:[<0x1000000086c/mmc-pwrseq-emmc.txt v304>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.014+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135c [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt auth v308 ap=1 s=448 n(v0 rc2024-03-31T23:19:43.470254+0000 b448 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf073080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000135c:[<0x1000000086c/brcm,bcm2835-sdhci.txt v122>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000135c:[<0x1000000086c/brcm,bcm2835-sdhci.txt v308>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.014+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135e [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt auth v298 ap=1 s=1065 n(v0 rc2024-03-31T23:19:43.483254+0000 b1065 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf073b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000135e:[<0x1000000086c/sdhci-st.txt v130>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000135e:[<0x1000000086c/sdhci-st.txt v298>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.014+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135f [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt auth v250 ap=1 s=3491 n(v0 rc2024-03-31T23:19:43.489254+0000 b3491 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf074100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000135f:[<0x1000000086c/exynos-dw-mshc.txt v134>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000135f:[<0x1000000086c/exynos-dw-mshc.txt v250>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.015+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001360 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt auth v248 ap=1 s=614 n(v0 rc2024-03-31T23:19:43.496254+0000 b614 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf074680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001360:[<0x1000000086c/pxa-mmc.txt v138>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001360:[<0x1000000086c/pxa-mmc.txt v248>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.015+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001362 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt auth v274 ap=1 s=424 n(v0 rc2024-03-31T23:19:43.507254+0000 b424 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf075180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001362:[<0x1000000086c/orion-sdio.txt v146>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001362:[<0x1000000086c/orion-sdio.txt v274>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.277 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.015+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001361 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt auth v312 ap=1 s=1584 n(v0 rc2024-03-31T23:19:43.501254+0000 b1584 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf074c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001361:[<0x1000000086c/ti-omap.txt v142>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001361:[<0x1000000086c/ti-omap.txt v312>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.015+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001363 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt auth v302 ap=1 s=955 n(v0 rc2024-03-31T23:19:43.511254+0000 b955 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf075700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001363:[<0x1000000086c/sdhci-fujitsu.txt v150>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001363:[<0x1000000086c/sdhci-fujitsu.txt v302>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.015+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001364 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt auth v280 ap=1 s=1357 n(v0 rc2024-03-31T23:19:43.515254+0000 b1357 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec34000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001364:[<0x1000000086c/sunxi-mmc.txt v154>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001364:[<0x1000000086c/sunxi-mmc.txt v280>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.030+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001159 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/ auth{0=1,2=1,3=1} v4132 ap=1 f(v0 m2024-03-31T23:20:03.123092+0000 5=3+2) n(v3 rc2024-03-31T23:20:03.137091+0000 b26998 17=14+3) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001159:[<0x10000000203/w1 v2158>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001159:[<0x10000000203/w1 v4132>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.123092+0000 5=3+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.137091+0000 b26998 17=14+3)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.123092+0000 5=3+2)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:03.137091+0000 b26998 17=14+3)","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.030+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mn10300/ auth{0=1,2=1,3=1} v4090 ap=1 f(v0 m2024-03-31T23:20:03.141091+0000 2=2+0) n(v0 rc2024-03-31T23:20:03.142091+0000 b5951 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537ff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e9e:[<0x10000000203/mn10300 v2139>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e9e:[<0x10000000203/mn10300 v4090>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.141091+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.142091+0000 b5951 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.141091+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.142091+0000 b5951 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.032+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea3 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/ auth{0=1,2=1,3=1} v4134 ap=1 f(v0 m2024-03-31T23:20:03.168091+0000 3=2+1) n(v3 rc2024-03-31T23:20:03.170091+0000 b32873 5=3+2) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ea3:[<0x10000000203/mtd v2154>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ea3:[<0x10000000203/mtd v4134>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.168091+0000 3=2+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.170091+0000 b32873 5=3+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.168091+0000 3=2+1)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:03.170091+0000 b32873 5=3+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.033+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e7 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/bus-devices/ auth{0=1,2=1,3=1} v4084 ap=1 f(v0 m2024-03-31T23:20:03.175091+0000 1=1+0) n(v0 rc2024-03-31T23:20:03.176091+0000 b4267 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53800100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004e7:[<0x10000000203/bus-devices v464>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004e7:[<0x10000000203/bus-devices v4084>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.175091+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.176091+0000 b4267 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.175091+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.176091+0000 b4267 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.034+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e38 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ko_KR/ auth{0=1,2=1,3=1} v4082 ap=1 f(v0 m2024-03-31T23:20:03.206091+0000 2=2+0) n(v0 rc2024-03-31T23:20:03.207091+0000 b47813 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53800680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e38:[<0x10000000203/ko_KR v2147>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e38:[<0x10000000203/ko_KR v4082>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.206091+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.207091+0000 b47813 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.206091+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.207091+0000 b47813 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.278 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.036+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f88 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pps/ auth{0=1,2=1,3=1} v4080 ap=1 f(v0 m2024-03-31T23:20:03.219091+0000 1=1+0) n(v0 rc2024-03-31T23:20:03.220091+0000 b8249 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53800c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f88:[<0x10000000203/pps v2149>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f88:[<0x10000000203/pps v4080>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.219091+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.220091+0000 b8249 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.219091+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.220091+0000 b8249 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.038+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e27 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/kbuild/ auth{0=1,2=1,3=1} v4078 ap=1 f(v0 m2024-03-31T23:20:03.252090+0000 7=7+0) n(v0 rc2024-03-31T23:20:03.254090+0000 b98415 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53801180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e27:[<0x10000000203/kbuild v2151>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e27:[<0x10000000203/kbuild v4078>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.252090+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.254090+0000 b98415 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.252090+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.254090+0000 b98415 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.064+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000231 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ auth{0=1,2=1,3=1} fragtree_t(*^3) v2690 ap=1 f(v0 m2024-03-31T23:20:04.304082+0000 214=214+0) n(v0 rc2024-03-31T23:20:04.307082+0000 b549349 215=214+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@441},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000231:[<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000231:[<0x10000000205/testing v2690>,<0x10000000203/ABI v4685>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.304082+0000 214=214+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.307082+0000 b549349 215=214+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.304082+0000 214=214+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.307082+0000 b549349 215=214+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.160+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000489 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/ auth{0=1,1=1,2=1,4=1} v703 ap=1 f(v0 m2024-03-31T23:19:51.878184+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.880184+0000 b1270 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feeec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000489:[<0x1000000044c/VFP v124>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000489:[<0x1000000044c/VFP v703>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.878184+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.880184+0000 b1270 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.878184+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.880184+0000 b1270 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.160+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000491 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/ auth{0=1,1=1,2=1} v701 ap=1 f(v0 m2024-03-31T23:19:51.882184+0000 1=1+0) n(v0 rc2024-03-31T23:19:51.885184+0000 b7678 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feeec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000491:[<0x1000000044c/msm v140>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000491:[<0x1000000044c/msm v701>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.882184+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.885184+0000 b7678 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.882184+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.885184+0000 b7678 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.163+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000470 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/ auth{0=1,1=1,2=1,4=1} v699 ap=1 f(v0 m2024-03-31T23:19:51.912184+0000 5=5+0) n(v0 rc2024-03-31T23:19:51.914184+0000 b6950 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feeecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000470:[<0x1000000044c/SH-Mobile v82>,<0x10000000203/arm v348>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000470:[<0x1000000044c/SH-Mobile v699>,<0x10000000203/arm v2784>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.912184+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.914184+0000 b6950 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.912184+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.914184+0000 b6950 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.174+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a0 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm/ auth{0=1,1=1,2=1} v322 ap=1 f(v0 m2024-03-31T23:20:00.247115+0000 2=2+0) n(v0 rc2024-03-31T23:20:00.248115+0000 b14983 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@8},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef2f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000011a0:[<0x10000001199/arm v58>,<0x10000000203/zh_CN v1934>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000011a0:[<0x10000001199/arm v322>,<0x10000000203/zh_CN v2808>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.247115+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.248115+0000 b14983 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.247115+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.248115+0000 b14983 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.177+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a9 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/filesystems/ auth{0=1,1=1,2=1} v320 ap=1 f(v0 m2024-03-31T23:20:00.265115+0000 1=1+0) n(v0 rc2024-03-31T23:20:00.266115+0000 b12353 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@6},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef2f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000011a9:[<0x10000001199/filesystems v60>,<0x10000000203/zh_CN v1934>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000011a9:[<0x10000001199/filesystems v320>,<0x10000000203/zh_CN v2808>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.265115+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.266115+0000 b12353 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.265115+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.266115+0000 b12353 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.279 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.179+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a3 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm64/ auth{0=1,1=1,2=1} v318 ap=1 f(v0 m2024-03-31T23:20:00.282115+0000 3=3+0) n(v0 rc2024-03-31T23:20:00.283115+0000 b15626 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@10},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef2fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000011a3:[<0x10000001199/arm64 v62>,<0x10000000203/zh_CN v1934>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000011a3:[<0x10000001199/arm64 v318>,<0x10000000203/zh_CN v2808>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.282115+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.283115+0000 b15626 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.282115+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.283115+0000 b15626 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.180+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b2 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/video4linux/ auth{0=1,1=1,2=1} v316 ap=1 f(v0 m2024-03-31T23:20:00.294115+0000 2=2+0) n(v0 rc2024-03-31T23:20:00.295115+0000 b50695 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@8},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fef30100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000011b2:[<0x10000001199/video4linux v64>,<0x10000000203/zh_CN v1934>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000011b2:[<0x10000001199/video4linux v316>,<0x10000000203/zh_CN v2808>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:00.294115+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:00.295115+0000 b50695 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:00.294115+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:00.295115+0000 b50695 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.239+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e0 [...4,head] ~mds3/stray3/100000008e0/ auth{0=1,1=1,2=1,4=1} v859 pv860 ap=4 f(v0 m2024-03-31T23:20:13.171009+0000)->f(v0 m2024-03-31T23:20:13.171009+0000) n(v0 rc2024-03-31T23:20:13.171009+0000 1=0+1)->n(v0 rc2024-03-31T23:20:13.173009+0000 1=0+1) old_inodes=1 (ilink xlockdone x=1) (isnap xlockdone x=1) (inest mix) (ifile excl) (iversion lock w=1 last_client=25315) (iquiesce lock w=1 last_client=25315) caps={25315=pAsLsXsFsx/pAsLsXsFsx@12},l=25315 | ptrwaiter=0 request=1 lock=4 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee2c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000008e0:[<0x100000008b2/ieee802154 v96>,<0x1000000054e/net v1558>,<0x1000000054c/bindings v164>,<0x10000000203/devicetree v672>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000008e0:[<0x100000008b2/ieee802154 v859>,<0x1000000054e/net v12455>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:13.171009+0000)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:13.171009+0000 1=0+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:13.171009+0000)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:13.171009+0000 1=0+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.016+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001366 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt auth v258 ap=1 s=556 n(v0 rc2024-03-31T23:19:43.523253+0000 b556 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec34b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001366:[<0x1000000086c/kona-sdhci.txt v162>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001366:[<0x1000000086c/kona-sdhci.txt v258>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.016+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001367 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt auth v288 ap=1 s=864 n(v0 rc2024-03-31T23:19:43.527253+0000 b864 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec35080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001367:[<0x1000000086c/img-dw-mshc.txt v166>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001367:[<0x1000000086c/img-dw-mshc.txt v288>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.017+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136a [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt auth v266 ap=1 s=1780 n(v0 rc2024-03-31T23:19:43.539253+0000 b1780 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec36100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000136a:[<0x1000000086c/sdhci-msm.txt v178>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000136a:[<0x1000000086c/sdhci-msm.txt v266>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.017+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136b [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt auth v276 ap=1 s=1031 n(v0 rc2024-03-31T23:19:43.543253+0000 b1031 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec36680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000136b:[<0x1000000086c/renesas,mmcif.txt v182>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000136b:[<0x1000000086c/renesas,mmcif.txt v276>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.017+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001368 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt auth v262 ap=1 s=1289 n(v0 rc2024-03-31T23:19:43.531253+0000 b1289 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec35600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001368:[<0x1000000086c/k3-dw-mshc.txt v170>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001368:[<0x1000000086c/k3-dw-mshc.txt v262>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.018+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001365 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt auth v242 ap=1 s=1282 n(v0 rc2024-03-31T23:19:43.519253+0000 b1282 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec34580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001365:[<0x1000000086c/fsl-esdhc.txt v158>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001365:[<0x1000000086c/fsl-esdhc.txt v242>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.280 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.018+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001369 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt auth v310 ap=1 s=562 n(v0 rc2024-03-31T23:19:43.535253+0000 b562 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec35b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001369:[<0x1000000086c/vt8500-sdmmc.txt v174>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001369:[<0x1000000086c/vt8500-sdmmc.txt v310>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.019+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136c [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt auth v272 ap=1 s=797 n(v0 rc2024-03-31T23:19:43.547253+0000 b797 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec36c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000136c:[<0x1000000086c/mxs-mmc.txt v186>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000136c:[<0x1000000086c/mxs-mmc.txt v272>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.019+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136d [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt auth v236 ap=1 s=1202 n(v0 rc2024-03-31T23:19:43.551253+0000 b1202 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec37180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000136d:[<0x1000000086c/samsung-sdhci.txt v190>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000136d:[<0x1000000086c/samsung-sdhci.txt v236>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.067+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ auth{0=1,2=1,3=1} v2688 ap=1 f(v0 m2024-03-31T23:20:04.343081+0000 7=7+0) n(v0 rc2024-03-31T23:20:04.345081+0000 b3647 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@18},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000020e:[<0x10000000205/removed v740>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000020e:[<0x10000000205/removed v2688>,<0x10000000203/ABI v4685>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.343081+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.345081+0000 b3647 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.343081+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.345081+0000 b3647 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.071+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000216 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/ auth{0=1,2=1,3=1} v2686 ap=1 f(v0 m2024-03-31T23:20:04.448081+0000 26=26+0) n(v0 rc2024-03-31T23:20:04.450081+0000 b67191 27=26+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@56},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000216:[<0x10000000205/stable v716>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000216:[<0x10000000205/stable v2686>,<0x10000000203/ABI v4685>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.448081+0000 26=26+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.450081+0000 b67191 27=26+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.448081+0000 26=26+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.450081+0000 b67191 27=26+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.072+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/ auth{0=1,2=1,3=1} v2684 ap=1 f(v0 m2024-03-31T23:20:04.481080+0000 6=6+0) n(v0 rc2024-03-31T23:20:04.483080+0000 b12851 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@16},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000207:[<0x10000000205/obsolete v664>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000207:[<0x10000000205/obsolete v2684>,<0x10000000203/ABI v4685>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.481080+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.483080+0000 b12851 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.481080+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.483080+0000 b12851 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.089+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff6 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/scsi_transport_srp/ auth{0=1,2=1,3=1} v588 ap=1 f(v0 m2024-03-31T23:20:04.770078+0000 2=2+0) n(v0 rc2024-03-31T23:20:04.771078+0000 b1494 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@8},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5380d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ff6:[<0x10000000fc3/scsi_transport_srp v120>,<0x10000000203/scsi v2164>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ff6:[<0x10000000fc3/scsi_transport_srp v588>,<0x10000000203/scsi v4687>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:04.770078+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:04.771078+0000 b1494 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:04.770078+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:04.771078+0000 b1494 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.108+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx88/ auth{0=1,2=1,3=1} v770 ap=1 f(v0 m2024-03-31T23:20:05.082075+0000 1=1+0) n(v0 rc2024-03-31T23:20:05.083075+0000 b1944 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@6},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000110c:[<0x100000010d6/cx88 v158>,<0x10000000203/video4linux v2166>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000110c:[<0x100000010d6/cx88 v770>,<0x10000000203/video4linux v4649>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.082075+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.083075+0000 b1944 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.082075+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.083075+0000 b1944 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.117+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001101 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx2341x/ auth{0=1,2=1,3=1} v768 ap=1 f(v0 m2024-03-31T23:20:05.263074+0000 10=10+0) n(v0 rc2024-03-31T23:20:05.265074+0000 b78422 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@24},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001101:[<0x100000010d6/cx2341x v160>,<0x10000000203/video4linux v2166>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001101:[<0x100000010d6/cx2341x v768>,<0x10000000203/video4linux v4649>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.263074+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.265074+0000 b78422 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.263074+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.265074+0000 b78422 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.118+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ed [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/bttv/ auth{0=1,2=1,3=1} v766 ap=1 f(v0 m2024-03-31T23:20:05.371073+0000 16=16+0) n(v0 rc2024-03-31T23:20:05.374073+0000 b59335 17=16+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@36},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000010ed:[<0x100000010d6/bttv v162>,<0x10000000203/video4linux v2166>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000010ed:[<0x100000010d6/bttv v766>,<0x10000000203/video4linux v4649>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.371073+0000 16=16+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.374073+0000 b59335 17=16+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.371073+0000 16=16+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.374073+0000 b59335 17=16+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.281 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.122+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001127 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/ auth{0=1,2=1,3=1} v176 ap=1 f(v0 m2024-03-31T23:20:05.541072+0000 13=12+1) n(v2 rc2024-03-31T23:20:05.544072+0000 b214523 21=19+2) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@28},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001127:[<0x10000001125/kvm v45>,<0x10000000203/virtual v2168>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001127:[<0x10000001125/kvm v176>,<0x10000000203/virtual v4683>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.541072+0000 13=12+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.544072+0000 b214523 21=19+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.541072+0000 13=12+1)","memory_value.rstat":"n(v2 rc2024-03-31T23:20:05.544072+0000 b214523 21=19+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.282 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.239+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134c [4,head] ~mds3/stray3/1000000134c auth v534 pv862 ap=4 s=1203 n(v0 rc2024-03-31T23:19:43.380255+0000 b1203 1=1+0)->n(v0 rc2024-03-31T23:20:13.214008+0000 b1203 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25315) (iquiesce lock w=1 last_client=25315) caps={25315=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c7ff2e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000134c:[<0x100000008b2/cavium-mix.txt v493>,<0x1000000054e/net v4417>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000134c:[<0x100000008b2/cavium-mix.txt v534>,<0x1000000054e/net v12455>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.282 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.239+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f4 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ auth{0=1,1=1,2=1,4=1} v691 pv871 ap=7 f(v0 m2024-03-31T23:19:43.403254+0000 4=4+0)->f(v0 m2024-03-31T23:20:13.228008+0000) n(v0 rc2024-03-31T23:19:43.406254+0000 b4299 5=4+1)->n(v0 rc2024-03-31T23:20:13.228008+0000 1=0+1) old_inodes=1 (isnap sync->lock r=4) (inest mix w=4) (ifile excl w=4) (iversion lock w=4 last_client=25315) (iquiesce lock w=5 last_client=25315) caps={25315=pAsXsFsx/pAsLsXsFsx@10},l=25315 | ptrwaiter=0 request=0 lock=5 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=1 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee2cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000008f4:[<0x100000008b2/nfc v140>,<0x1000000054e/net v1558>,<0x1000000054c/bindings v164>,<0x10000000203/devicetree v672>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000008f4:[<0x100000008b2/nfc v691>,<0x1000000054e/net v12455>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:43.403254+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:43.406254+0000 b4299 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:43.403254+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:43.406254+0000 b4299 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.282 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.240+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001351 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt auth v670 ap=1 s=933 n(v0 rc2024-03-31T23:19:43.413254+0000 b933 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c7ff2e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001351:[<0x100000008b2/marvell-orion-mdio.txt v513>,<0x1000000054e/net v4417>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001351:[<0x100000008b2/marvell-orion-mdio.txt v670>,<0x1000000054e/net v12455>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.282 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.268+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009be [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ auth{0=1,1=1,2=1,4=1} v416 ap=1 f(v0 m2024-03-31T23:19:46.534229+0000 29=28+1) n(v4 rc2024-03-31T23:19:46.536229+0000 b123031 46=42+4) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000009be:[<0x100000009b5/fsl v277>,<0x1000000054e/powerpc v6571>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000009be:[<0x100000009b5/fsl v416>,<0x1000000054e/powerpc v12449>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.534229+0000 29=28+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.536229+0000 b123031 46=42+4)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.534229+0000 29=28+1)","memory_value.rstat":"n(v4 rc2024-03-31T23:19:46.536229+0000 b123031 46=42+4)","error_str":""},"return_code":0} 2024-03-31T23:20:13.282 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.268+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ed [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ auth{0=1,1=1,2=1} v418 ap=1 f(v0 m2024-03-31T23:19:46.334230+0000 2=2+0) n(v0 rc2024-03-31T23:19:46.336230+0000 b8768 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee77700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000009ed:[<0x100000009b5/nintendo v109>,<0x1000000054e/powerpc v6571>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000009ed:[<0x100000009b5/nintendo v418>,<0x1000000054e/powerpc v12449>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.334230+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.336230+0000 b8768 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.334230+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:46.336230+0000 b8768 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.282 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.269+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b6 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ auth{0=1,1=1,2=1,4=1} v414 ap=1 f(v0 m2024-03-31T23:19:46.565228+0000 7=7+0) n(v0 rc2024-03-31T23:19:46.567228+0000 b13918 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee7f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000009b6:[<0x100000009b5/4xx v319>,<0x1000000054e/powerpc v6571>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000009b6:[<0x100000009b5/4xx v414>,<0x1000000054e/powerpc v12449>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.565228+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.567228+0000 b13918 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.565228+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:46.567228+0000 b13918 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.019+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136e [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt auth v268 ap=1 s=872 n(v0 rc2024-03-31T23:19:43.556253+0000 b872 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bec37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000136e:[<0x1000000086c/mmc-pwrseq-simple.txt v194>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000136e:[<0x1000000086c/mmc-pwrseq-simple.txt v268>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.020+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136f [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt auth v256 ap=1 s=398 n(v0 rc2024-03-31T23:19:43.561253+0000 b398 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000136f:[<0x1000000086c/sdhci-spear.txt v198>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000136f:[<0x1000000086c/sdhci-spear.txt v256>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.020+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001370 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt auth v260 ap=1 s=2247 n(v0 rc2024-03-31T23:19:43.566253+0000 b2247 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001370:[<0x1000000086c/mmci.txt v202>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001370:[<0x1000000086c/mmci.txt v260>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.020+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001371 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt auth v270 ap=1 s=825 n(v0 rc2024-03-31T23:19:43.571253+0000 b825 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001371:[<0x1000000086c/rockchip-dw-mshc.txt v206>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001371:[<0x1000000086c/rockchip-dw-mshc.txt v270>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.021+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001372 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt auth v282 ap=1 s=621 n(v0 rc2024-03-31T23:19:43.575253+0000 b621 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001372:[<0x1000000086c/fsl-imx-mmc.txt v210>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001372:[<0x1000000086c/fsl-imx-mmc.txt v282>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.021+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001373 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt auth v278 ap=1 s=740 n(v0 rc2024-03-31T23:19:43.579253+0000 b740 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001373:[<0x1000000086c/moxa,moxart-mmc.txt v214>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001373:[<0x1000000086c/moxa,moxart-mmc.txt v278>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.283 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.022+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001374 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt auth v284 ap=1 s=1609 n(v0 rc2024-03-31T23:19:43.583253+0000 b1609 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0adb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001374:[<0x1000000086c/atmel-hsmci.txt v218>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001374:[<0x1000000086c/atmel-hsmci.txt v284>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.022+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001376 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt auth v292 ap=1 s=1024 n(v0 rc2024-03-31T23:19:43.590253+0000 b1024 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001376:[<0x1000000086c/davinci_mmc.txt v226>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001376:[<0x1000000086c/davinci_mmc.txt v292>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.022+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001375 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt auth v286 ap=1 s=1006 n(v0 rc2024-03-31T23:19:43.587253+0000 b1006 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001375:[<0x1000000086c/mmc-spi-slot.txt v222>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001375:[<0x1000000086c/mmc-spi-slot.txt v286>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.123+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113d [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/uml/ auth{0=1,2=1,3=1} v172 ap=1 f(v0 m2024-03-31T23:20:05.555071+0000 1=1+0) n(v0 rc2024-03-31T23:20:05.556071+0000 b120016 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@6},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53826000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000113d:[<0x10000001125/uml v42>,<0x10000000203/virtual v2168>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000113d:[<0x10000001125/uml v172>,<0x10000000203/virtual v4683>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.555071+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.556071+0000 b120016 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.555071+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.556071+0000 b120016 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.134+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e91 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/mei/ auth{0=1,2=1,3=1} v178 ap=1 f(v0 m2024-03-31T23:20:06.846061+0000 6=6+0) n(v0 rc2024-03-31T23:20:06.847061+0000 b25837 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@16},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53827600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e91:[<0x10000000e86/mei v38>,<0x10000000203/misc-devices v2162>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e91:[<0x10000000e86/mei v178>,<0x10000000203/misc-devices v4629>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:06.846061+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:06.847061+0000 b25837 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:06.846061+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:06.847061+0000 b25837 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.149+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec7 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/caif/ auth{0=1,2=1,3=1} v413 ap=1 f(v0 m2024-03-31T23:20:01.529105+0000 3=3+0) n(v0 rc2024-03-31T23:20:01.530105+0000 b17389 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5343ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ec7:[<0x10000000eb1/caif v272>,<0x10000000203/networking v2156>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ec7:[<0x10000000eb1/caif v413>,<0x10000000203/networking v4126>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.529105+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.530105+0000 b17389 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.529105+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.530105+0000 b17389 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.153+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f26 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/timestamping/ auth{0=1,2=1,3=1} v429 ap=1 f(v0 m2024-03-31T23:20:01.611104+0000 5=5+0) n(v0 rc2024-03-31T23:20:01.612104+0000 b31977 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f26:[<0x10000000eb1/timestamping v272>,<0x10000000203/networking v2156>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f26:[<0x10000000eb1/timestamping v429>,<0x10000000203/networking v4126>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.611104+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.612104+0000 b31977 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.611104+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.612104+0000 b31977 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.284 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.155+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efd [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/mac80211_hwsim/ auth{0=1,2=1,3=1} v373 ap=1 f(v0 m2024-03-31T23:20:01.650104+0000 3=3+0) n(v0 rc2024-03-31T23:20:01.651104+0000 b3093 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000efd:[<0x10000000eb1/mac80211_hwsim v272>,<0x10000000203/networking v2156>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000efd:[<0x10000000eb1/mac80211_hwsim v373>,<0x10000000203/networking v4126>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:01.650104+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:01.651104+0000 b3093 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:01.650104+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:01.651104+0000 b3093 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.174+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000324 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/ auth{0=1,2=1,3=1} v612 ap=1 f(v0 m2024-03-31T23:20:02.903093+0000 16=14+2) n(v3 rc2024-03-31T23:20:02.904093+0000 b2354416 196=193+3) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@32},l=25315 | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000324:[<0x10000000310/media v74>,<0x10000000203/DocBook v116>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000324:[<0x10000000310/media v612>,<0x10000000203/DocBook v4128>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.903093+0000 16=14+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.904093+0000 b2354416 196=193+3)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.903093+0000 16=14+2)","memory_value.rstat":"n(v3 rc2024-03-31T23:20:02.904093+0000 b2354416 196=193+3)","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.178+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000daf [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/muxes/ auth{0=1,2=1,3=1} v354 ap=1 f(v0 m2024-03-31T23:20:02.963093+0000 1=1+0) n(v0 rc2024-03-31T23:20:02.965093+0000 b2798 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@6},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000daf:[<0x10000000d92/muxes v75>,<0x10000000203/i2c v2131>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000daf:[<0x10000000d92/muxes v354>,<0x10000000203/i2c v4130>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.963093+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.964093+0000 b2798 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.963093+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:02.965093+0000 b2798 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.180+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d93 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/busses/ auth{0=1,2=1,3=1} v352 ap=1 f(v0 m2024-03-31T23:20:03.077092+0000 21=21+0) n(v0 rc2024-03-31T23:20:03.079092+0000 b43830 22=21+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@46},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000d93:[<0x10000000d92/busses v77>,<0x10000000203/i2c v2131>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000d93:[<0x10000000d92/busses v352>,<0x10000000203/i2c v4130>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.077092+0000 21=21+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.079092+0000 b43830 22=21+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.077092+0000 21=21+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.079092+0000 b43830 22=21+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.182+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115b [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/masters/ auth{0=1,2=1,3=1} v154 ap=1 f(v0 m2024-03-31T23:20:03.118092+0000 6=6+0) n(v0 rc2024-03-31T23:20:03.119092+0000 b7602 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@16},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000115b:[<0x10000001159/masters v34>,<0x10000000203/w1 v2158>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000115b:[<0x10000001159/masters v154>,<0x10000000203/w1 v4132>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.118092+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.119092+0000 b7602 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.118092+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.119092+0000 b7602 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.022+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001377 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt auth v252 ap=1 s=1577 n(v0 rc2024-03-31T23:19:43.594253+0000 b1577 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0aec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001377:[<0x1000000086c/sdhci-pxa.txt v230>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001377:[<0x1000000086c/sdhci-pxa.txt v252>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.022+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001378 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt auth v290 ap=1 s=821 n(v0 rc2024-03-31T23:19:43.599253+0000 b821 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0af180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001378:[<0x1000000086c/usdhi6rol0.txt v234>,<0x1000000054e/mmc v4573>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001378:[<0x1000000086c/usdhi6rol0.txt v290>,<0x1000000054e/mmc v11870>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.285 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.027+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001459 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt auth v274 ap=1 s=3236 n(v0 rc2024-03-31T23:19:44.860242+0000 b3236 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beeba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001459:[<0x10000000a11/tps65090.txt v82>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001459:[<0x10000000a11/tps65090.txt v274>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.286 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.027+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145a [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt auth v268 ap=1 s=452 n(v0 rc2024-03-31T23:19:44.867242+0000 b452 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beeba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000145a:[<0x10000000a11/da9210.txt v88>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000145a:[<0x10000000a11/da9210.txt v268>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.286 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.183+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001162 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/slaves/ auth{0=1,2=1,3=1} v152 ap=1 f(v0 m2024-03-31T23:20:03.136091+0000 5=5+0) n(v0 rc2024-03-31T23:20:03.137091+0000 b6942 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@14},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001162:[<0x10000001159/slaves v36>,<0x10000000203/w1 v2158>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001162:[<0x10000001159/slaves v152>,<0x10000000203/w1 v4132>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.136091+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.137091+0000 b6942 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.136091+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.137091+0000 b6942 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.286 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.183+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea4 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/nand/ auth{0=1,2=1,3=1} v38 ap=1 f(v0 m2024-03-31T23:20:03.162091+0000 1=1+0) n(v0 rc2024-03-31T23:20:03.164091+0000 b4488 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@6},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ea4:[<0x10000000ea3/nand v10>,<0x10000000203/mtd v2154>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ea4:[<0x10000000ea3/nand v38>,<0x10000000203/mtd v4134>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:03.162091+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:03.164091+0000 b4488 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:03.162091+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:03.164091+0000 b4488 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.286 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.237+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000670 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ auth{0=1,2=1,3=1} v1111 ap=1 f(v0 m2024-03-31T23:19:46.925225+0000 12=12+0) n(v0 rc2024-03-31T23:19:46.926225+0000 b25160 13=12+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53728680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000670:[<0x1000000060e/ti v220>,<0x1000000054e/clock v452>,<0x1000000054c/bindings v164>,<0x10000000203/devicetree v672>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000670:[<0x1000000060e/ti v1111>,<0x1000000054e/clock v12453>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.925225+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.926225+0000 b25160 13=12+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.925225+0000 12=12+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:46.926225+0000 b25160 13=12+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.286 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.242+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000663 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/st/ auth{0=1,2=1,3=1} v1109 ap=1 f(v0 m2024-03-31T23:19:47.082224+0000 8=8+0) n(v0 rc2024-03-31T23:19:47.083224+0000 b15513 9=8+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb53728c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000663:[<0x1000000060e/st v186>,<0x1000000054e/clock v452>,<0x1000000054c/bindings v164>,<0x10000000203/devicetree v672>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000663:[<0x1000000060e/st v1109>,<0x1000000054e/clock v12453>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:47.082224+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:47.083224+0000 b15513 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:47.082224+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:47.083224+0000 b15513 9=8+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.286 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.267+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112b [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/devices/ auth{0=1,2=1,3=1} v198 ap=1 f(v0 m2024-03-31T23:20:05.522072+0000 7=7+0) n(v0 rc2024-03-31T23:20:05.524072+0000 b17435 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@18},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb5381d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000112b:[<0x10000001127/devices v42>,<0x10000001125/kvm v45>,<0x10000000203/virtual v2168>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000112b:[<0x10000001127/devices v198>,<0x10000001125/kvm v176>,<0x10000000203/virtual v4683>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:05.522072+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:05.524072+0000 b17435 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:05.522072+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:05.524072+0000 b17435 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.296 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.027+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145d [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt auth v254 ap=1 s=923 n(v0 rc2024-03-31T23:19:44.891242+0000 b923 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000145d:[<0x10000000a11/vexpress.txt v106>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000145d:[<0x10000000a11/vexpress.txt v254>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.296 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.028+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145b [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt auth v248 ap=1 s=815 n(v0 rc2024-03-31T23:19:44.875242+0000 b815 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000145b:[<0x10000000a11/max8925-regulator.txt v94>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000145b:[<0x10000000a11/max8925-regulator.txt v248>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.028+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145c [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt auth v312 ap=1 s=3124 n(v0 rc2024-03-31T23:19:44.883242+0000 b3124 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000145c:[<0x10000000a11/ltc3589.txt v100>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000145c:[<0x10000000a11/ltc3589.txt v312>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.028+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145e [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt auth v262 ap=1 s=3573 n(v0 rc2024-03-31T23:19:44.900242+0000 b3573 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000145e:[<0x10000000a11/tps6586x.txt v112>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000145e:[<0x10000000a11/tps6586x.txt v262>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.029+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145f [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt auth v314 ap=1 s=6349 n(v0 rc2024-03-31T23:19:44.907242+0000 b6349 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000145f:[<0x10000000a11/mt6397-regulator.txt v118>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000145f:[<0x10000000a11/mt6397-regulator.txt v314>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.029+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001460 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt auth v316 ap=1 s=1244 n(v0 rc2024-03-31T23:19:44.915242+0000 b1244 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001460:[<0x10000000a11/gpio-regulator.txt v124>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001460:[<0x10000000a11/gpio-regulator.txt v316>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.029+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001461 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt auth v298 ap=1 s=2065 n(v0 rc2024-03-31T23:19:44.923242+0000 b2065 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001461:[<0x10000000a11/tps65217.txt v130>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001461:[<0x10000000a11/tps65217.txt v298>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.029+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001462 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt auth v282 ap=1 s=6658 n(v0 rc2024-03-31T23:19:44.930242+0000 b6658 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001462:[<0x10000000a11/pfuze100.txt v134>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001462:[<0x10000000a11/pfuze100.txt v282>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.030+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001463 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt auth v250 ap=1 s=1155 n(v0 rc2024-03-31T23:19:44.936242+0000 b1155 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beebd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001463:[<0x10000000a11/isl9305.txt v138>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001463:[<0x10000000a11/isl9305.txt v250>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.033+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001465 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt auth v294 ap=1 s=3079 n(v0 rc2024-03-31T23:19:44.948242+0000 b3079 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf11e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001465:[<0x10000000a11/max77802.txt v146>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001465:[<0x10000000a11/max77802.txt v294>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.033+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001466 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt auth v300 ap=1 s=4317 n(v0 rc2024-03-31T23:19:44.954242+0000 b4317 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf11eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001466:[<0x10000000a11/lp872x.txt v150>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001466:[<0x10000000a11/lp872x.txt v300>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.297 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.033+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001464 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt auth v266 ap=1 s=1096 n(v0 rc2024-03-31T23:19:44.942242+0000 b1096 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf11e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001464:[<0x10000000a11/88pm800.txt v142>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001464:[<0x10000000a11/88pm800.txt v266>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.033+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001467 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt auth v286 ap=1 s=865 n(v0 rc2024-03-31T23:19:44.961242+0000 b865 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf11f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001467:[<0x10000000a11/pbias-regulator.txt v154>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001467:[<0x10000000a11/pbias-regulator.txt v286>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.034+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001468 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt auth v292 ap=1 s=1232 n(v0 rc2024-03-31T23:19:44.966242+0000 b1232 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf11f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001468:[<0x10000000a11/anatop-regulator.txt v158>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001468:[<0x10000000a11/anatop-regulator.txt v292>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.034+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146c [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt auth v276 ap=1 s=5394 n(v0 rc2024-03-31T23:19:44.986241+0000 b5394 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf120c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000146c:[<0x10000000a11/max8997-regulator.txt v174>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000146c:[<0x10000000a11/max8997-regulator.txt v276>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.034+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001469 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt auth v272 ap=1 s=5522 n(v0 rc2024-03-31T23:19:44.972241+0000 b5522 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf11fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001469:[<0x10000000a11/ti-abb-regulator.txt v162>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001469:[<0x10000000a11/ti-abb-regulator.txt v272>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.035+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146a [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt auth v302 ap=1 s=446 n(v0 rc2024-03-31T23:19:44.978241+0000 b446 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf120100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000146a:[<0x10000000a11/max8973-regulator.txt v166>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000146a:[<0x10000000a11/max8973-regulator.txt v302>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.035+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146f [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt auth v280 ap=1 s=2740 n(v0 rc2024-03-31T23:19:45.003241+0000 b2740 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf132000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000146f:[<0x10000000a11/as3722-regulator.txt v186>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000146f:[<0x10000000a11/as3722-regulator.txt v280>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.036+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001471 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt auth v304 ap=1 s=1918 n(v0 rc2024-03-31T23:19:45.014241+0000 b1918 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf132b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001471:[<0x10000000a11/max8907.txt v194>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001471:[<0x10000000a11/max8907.txt v304>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.298 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.036+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146d [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt auth v290 ap=1 s=1820 n(v0 rc2024-03-31T23:19:44.992241+0000 b1820 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf121180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000146d:[<0x10000000a11/act8865-regulator.txt v178>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000146d:[<0x10000000a11/act8865-regulator.txt v290>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.037+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146e [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt auth v320 ap=1 s=755 n(v0 rc2024-03-31T23:19:44.997241+0000 b755 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf121700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000146e:[<0x10000000a11/tps51632-regulator.txt v182>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000146e:[<0x10000000a11/tps51632-regulator.txt v320>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.037+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146b [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt auth v258 ap=1 s=727 n(v0 rc2024-03-31T23:19:44.982241+0000 b727 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf120680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000146b:[<0x10000000a11/pwm-regulator.txt v170>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000146b:[<0x10000000a11/pwm-regulator.txt v258>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.038+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001472 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt auth v278 ap=1 s=702 n(v0 rc2024-03-31T23:19:45.019241+0000 b702 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf133080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001472:[<0x10000000a11/fan53555.txt v198>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001472:[<0x10000000a11/fan53555.txt v278>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.038+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001470 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt auth v318 ap=1 s=1876 n(v0 rc2024-03-31T23:19:45.008241+0000 b1876 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf132580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001470:[<0x10000000a11/da9211.txt v190>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001470:[<0x10000000a11/da9211.txt v318>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.038+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001475 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt auth v264 ap=1 s=1075 n(v0 rc2024-03-31T23:19:45.035241+0000 b1075 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf134100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001475:[<0x10000000a11/max8660.txt v210>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001475:[<0x10000000a11/max8660.txt v264>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.038+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001473 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt auth v322 ap=1 s=1606 n(v0 rc2024-03-31T23:19:45.024241+0000 b1606 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf133600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001473:[<0x10000000a11/max8952.txt v202>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001473:[<0x10000000a11/max8952.txt v322>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.039+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001474 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt auth v256 ap=1 s=752 n(v0 rc2024-03-31T23:19:45.030241+0000 b752 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf133b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001474:[<0x10000000a11/88pm860x.txt v206>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001474:[<0x10000000a11/88pm860x.txt v256>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.039+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001476 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt auth v288 ap=1 s=1020 n(v0 rc2024-03-31T23:19:45.041241+0000 b1020 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf134680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001476:[<0x10000000a11/fixed-regulator.txt v214>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001476:[<0x10000000a11/fixed-regulator.txt v288>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.039+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001477 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt auth v296 ap=1 s=5851 n(v0 rc2024-03-31T23:19:45.046241+0000 b5851 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf134c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001477:[<0x10000000a11/s5m8767-regulator.txt v218>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001477:[<0x10000000a11/s5m8767-regulator.txt v296>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.039+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001479 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt auth v284 ap=1 s=378 n(v0 rc2024-03-31T23:19:45.057241+0000 b378 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf135700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001479:[<0x10000000a11/sky81452-regulator.txt v226>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001479:[<0x10000000a11/sky81452-regulator.txt v284>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.040+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001478 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt auth v260 ap=1 s=3634 n(v0 rc2024-03-31T23:19:45.051241+0000 b3634 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf135180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001478:[<0x10000000a11/regulator.txt v222>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001478:[<0x10000000a11/regulator.txt v260>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.299 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.040+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147c [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt auth v252 ap=1 s=572 n(v0 rc2024-03-31T23:19:45.074241+0000 b572 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf13cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000147c:[<0x10000000a11/tps65218.txt v238>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000147c:[<0x10000000a11/tps65218.txt v252>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.040+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147a [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt auth v308 ap=1 s=1371 n(v0 rc2024-03-31T23:19:45.063241+0000 b1371 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf13c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000147a:[<0x10000000a11/tps62360-regulator.txt v230>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000147a:[<0x10000000a11/tps62360-regulator.txt v308>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.040+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147d [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt auth v270 ap=1 s=2138 n(v0 rc2024-03-31T23:19:45.080241+0000 b2138 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf13d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000147d:[<0x10000000a11/twl-regulator.txt v242>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000147d:[<0x10000000a11/twl-regulator.txt v270>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.041+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147e [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt auth v306 ap=1 s=2646 n(v0 rc2024-03-31T23:19:45.085241+0000 b2646 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf13d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000147e:[<0x10000000a11/palmas-pmic.txt v246>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000147e:[<0x10000000a11/palmas-pmic.txt v306>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.041+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147b [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt auth v310 ap=1 s=647 n(v0 rc2024-03-31T23:19:45.068241+0000 b647 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf13c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000147b:[<0x10000000a11/max1586-regulator.txt v234>,<0x1000000054e/regulator v5671>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000147b:[<0x10000000a11/max1586-regulator.txt v310>,<0x1000000054e/regulator v11878>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.042+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d9 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt auth v366 ap=1 s=1542 n(v0 rc2024-03-31T23:19:45.481237+0000 b1542 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d9:[<0x10000000782/gpio-matrix-keypad.txt v127>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d9:[<0x10000000782/gpio-matrix-keypad.txt v366>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.046+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d7 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt auth v390 ap=1 s=1786 n(v0 rc2024-03-31T23:19:45.472237+0000 b1786 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0af700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d7:[<0x10000000782/st-keyscan.txt v119>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d7:[<0x10000000782/st-keyscan.txt v390>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.046+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d8 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt auth v392 ap=1 s=727 n(v0 rc2024-03-31T23:19:45.477237+0000 b727 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d8:[<0x10000000782/clps711x-keypad.txt v123>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d8:[<0x10000000782/clps711x-keypad.txt v392>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.047+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014da [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt auth v362 ap=1 s=2027 n(v0 rc2024-03-31T23:19:45.487237+0000 b2027 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014da:[<0x10000000782/nvidia,tegra20-kbc.txt v131>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014da:[<0x10000000782/nvidia,tegra20-kbc.txt v362>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.048+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014db [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt auth v432 ap=1 s=1056 n(v0 rc2024-03-31T23:19:45.493237+0000 b1056 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014db:[<0x10000000782/gpio-keys-polled.txt v135>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014db:[<0x10000000782/gpio-keys-polled.txt v432>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.048+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dc [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt auth v418 ap=1 s=2200 n(v0 rc2024-03-31T23:19:45.499237+0000 b2200 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014dc:[<0x10000000782/qcom,pm8xxx-keypad.txt v139>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014dc:[<0x10000000782/qcom,pm8xxx-keypad.txt v418>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.048+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dd [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt auth v386 ap=1 s=1061 n(v0 rc2024-03-31T23:19:45.505237+0000 b1061 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014dd:[<0x10000000782/matrix-keymap.txt v143>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014dd:[<0x10000000782/matrix-keymap.txt v386>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.300 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.049+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014de [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt auth v430 ap=1 s=958 n(v0 rc2024-03-31T23:19:45.512237+0000 b958 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef20100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014de:[<0x10000000782/twl4030-keypad.txt v147>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014de:[<0x10000000782/twl4030-keypad.txt v430>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.049+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014df [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt auth v350 ap=1 s=905 n(v0 rc2024-03-31T23:19:45.516237+0000 b905 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef20680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014df:[<0x10000000782/e3x0-button.txt v151>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014df:[<0x10000000782/e3x0-button.txt v350>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.049+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e0 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt auth v404 ap=1 s=1247 n(v0 rc2024-03-31T23:19:45.521237+0000 b1247 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e0:[<0x10000000782/rotary-encoder.txt v155>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e0:[<0x10000000782/rotary-encoder.txt v404>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.050+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ auth{0=1,1=1,2=1,3=1} v451 ap=1 f(v0 m2024-03-31T23:19:45.600236+0000 15=15+0) n(v0 rc2024-03-31T23:19:45.603236+0000 b14831 16=15+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5609be97eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007a8:[<0x10000000782/touchscreen v106>,<0x1000000054e/input v972>,<0x1000000054c/bindings v164>,<0x10000000203/devicetree v672>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000007a8:[<0x10000000782/touchscreen v451>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:45.600236+0000 15=15+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:45.603236+0000 b14831 16=15+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:45.600236+0000 15=15+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:45.603236+0000 b14831 16=15+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.050+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f1 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt auth v338 ap=1 s=897 n(v0 rc2024-03-31T23:19:45.614236+0000 b897 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef21700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f1:[<0x10000000782/elants_i2c.txt v223>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f1:[<0x10000000782/elants_i2c.txt v338>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.050+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f2 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt auth v372 ap=1 s=952 n(v0 rc2024-03-31T23:19:45.621236+0000 b952 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef28000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f2:[<0x10000000782/elan_i2c.txt v227>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f2:[<0x10000000782/elan_i2c.txt v372>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.050+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f0 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt auth v342 ap=1 s=1660 n(v0 rc2024-03-31T23:19:45.608236+0000 b1660 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef21180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f0:[<0x10000000782/imx-keypad.txt v219>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f0:[<0x10000000782/imx-keypad.txt v342>,<0x1000000054e/input v12070>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.051+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f3 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt auth v420 ap=1 s=616 n(v0 rc2024-03-31T23:19:45.627236+0000 b616 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef28580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f3:[<0x10000000782/regulator-haptic.txt v231>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f3:[<0x10000000782/regulator-haptic.txt v420>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.051+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f4 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt auth v344 ap=1 s=618 n(v0 rc2024-03-31T23:19:45.633236+0000 b618 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef28b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f4:[<0x10000000782/ps2keyb-mouse-apbps2.txt v235>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f4:[<0x10000000782/ps2keyb-mouse-apbps2.txt v344>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.051+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f5 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt auth v408 ap=1 s=601 n(v0 rc2024-03-31T23:19:45.640236+0000 b601 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef29080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f5:[<0x10000000782/twl4030-pwrbutton.txt v239>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f5:[<0x10000000782/twl4030-pwrbutton.txt v408>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.052+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f6 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt auth v340 ap=1 s=1656 n(v0 rc2024-03-31T23:19:45.645236+0000 b1656 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef29600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f6:[<0x10000000782/ti,nspire-keypad.txt v243>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f6:[<0x10000000782/ti,nspire-keypad.txt v340>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.053+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f7 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt auth v394 ap=1 s=2945 n(v0 rc2024-03-31T23:19:45.652236+0000 b2945 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef29b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f7:[<0x10000000782/ads7846.txt v247>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f7:[<0x10000000782/ads7846.txt v394>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.301 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.053+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f9 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt auth v422 ap=1 s=1109 n(v0 rc2024-03-31T23:19:45.662236+0000 b1109 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef2a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f9:[<0x10000000782/qcom,pm8xxx-pwrkey.txt v255>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f9:[<0x10000000782/qcom,pm8xxx-pwrkey.txt v422>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.053+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f8 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt auth v440 ap=1 s=1069 n(v0 rc2024-03-31T23:19:45.656236+0000 b1069 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef2a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014f8:[<0x10000000782/input-reset.txt v251>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014f8:[<0x10000000782/input-reset.txt v440>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.053+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fa [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt auth v382 ap=1 s=1006 n(v0 rc2024-03-31T23:19:45.666236+0000 b1006 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef2ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014fa:[<0x10000000782/atmel,maxtouch.txt v259>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014fa:[<0x10000000782/atmel,maxtouch.txt v382>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.054+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fb [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt auth v442 ap=1 s=1408 n(v0 rc2024-03-31T23:19:45.670236+0000 b1408 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef2b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014fb:[<0x10000000782/sun4i-lradc-keys.txt v263>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014fb:[<0x10000000782/sun4i-lradc-keys.txt v442>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.054+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fd [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt auth v444 ap=1 s=2287 n(v0 rc2024-03-31T23:19:45.679236+0000 b2287 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014fd:[<0x10000000782/samsung-keypad.txt v271>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014fd:[<0x10000000782/samsung-keypad.txt v444>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.054+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001500 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt auth v400 ap=1 s=171 n(v0 rc2024-03-31T23:19:45.694235+0000 b171 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001500:[<0x10000000782/pwm-beeper.txt v283>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001500:[<0x10000000782/pwm-beeper.txt v400>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.054+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fe [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt auth v384 ap=1 s=213 n(v0 rc2024-03-31T23:19:45.684236+0000 b213 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014fe:[<0x10000000782/fsl-mma8450.txt v275>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014fe:[<0x10000000782/fsl-mma8450.txt v384>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.055+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ff [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt auth v434 ap=1 s=362 n(v0 rc2024-03-31T23:19:45.690236+0000 b362 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ff:[<0x10000000782/qcom,pm8xxx-vib.txt v279>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ff:[<0x10000000782/qcom,pm8xxx-vib.txt v434>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.055+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fc [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt auth v412 ap=1 s=371 n(v0 rc2024-03-31T23:19:45.675236+0000 b371 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef2b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014fc:[<0x10000000782/ti,drv2667.txt v267>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014fc:[<0x10000000782/ti,drv2667.txt v412>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.057+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001502 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt auth v396 ap=1 s=2319 n(v0 rc2024-03-31T23:19:45.707235+0000 b2319 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001502:[<0x10000000782/pxa27x-keypad.txt v291>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001502:[<0x10000000782/pxa27x-keypad.txt v396>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.057+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001501 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt auth v356 ap=1 s=895 n(v0 rc2024-03-31T23:19:45.701235+0000 b895 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001501:[<0x10000000782/stmpe-keypad.txt v287>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001501:[<0x10000000782/stmpe-keypad.txt v356>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.057+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001503 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt auth v380 ap=1 s=936 n(v0 rc2024-03-31T23:19:45.714235+0000 b936 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001503:[<0x10000000782/lpc32xx-key.txt v295>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001503:[<0x10000000782/lpc32xx-key.txt v380>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.302 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.057+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001504 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt auth v410 ap=1 s=413 n(v0 rc2024-03-31T23:19:45.720235+0000 b413 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001504:[<0x10000000782/tps65218-pwrbutton.txt v299>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001504:[<0x10000000782/tps65218-pwrbutton.txt v410>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.058+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001505 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt auth v354 ap=1 s=320 n(v0 rc2024-03-31T23:19:45.727235+0000 b320 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001505:[<0x10000000782/tca8418_keypad.txt v303>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001505:[<0x10000000782/tca8418_keypad.txt v354>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.058+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001506 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt auth v360 ap=1 s=1930 n(v0 rc2024-03-31T23:19:45.733235+0000 b1930 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001506:[<0x10000000782/ti,drv260x.txt v307>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001506:[<0x10000000782/ti,drv260x.txt v360>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.058+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001507 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt auth v374 ap=1 s=1415 n(v0 rc2024-03-31T23:19:45.740235+0000 b1415 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beec7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001507:[<0x10000000782/gpio-keys.txt v311>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001507:[<0x10000000782/gpio-keys.txt v374>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.059+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001508 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt auth v446 ap=1 s=435 n(v0 rc2024-03-31T23:19:45.745235+0000 b435 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf056000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001508:[<0x10000000782/spear-keyboard.txt v315>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001508:[<0x10000000782/spear-keyboard.txt v446>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.059+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001509 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt auth v388 ap=1 s=2706 n(v0 rc2024-03-31T23:19:45.750235+0000 b2706 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf056580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001509:[<0x10000000782/cros-ec-keyb.txt v319>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x10000001509:[<0x10000000782/cros-ec-keyb.txt v388>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.059+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150a [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt auth v346 ap=1 s=935 n(v0 rc2024-03-31T23:19:45.755235+0000 b935 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf056b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000150a:[<0x10000000782/omap-keypad.txt v323>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000150a:[<0x10000000782/omap-keypad.txt v346>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.059+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150b [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt auth v376 ap=1 s=1667 n(v0 rc2024-03-31T23:19:45.759235+0000 b1667 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf057080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000150b:[<0x10000000782/cap11xx.txt v327>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000150b:[<0x10000000782/cap11xx.txt v376>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.060+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150c [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt auth v414 ap=1 s=313 n(v0 rc2024-03-31T23:19:45.764235+0000 b313 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf057600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000150c:[<0x10000000782/gpio-beeper.txt v331>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000150c:[<0x10000000782/gpio-beeper.txt v414>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.060+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150d [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt auth v402 ap=1 s=1362 n(v0 rc2024-03-31T23:19:45.769235+0000 b1362 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf057b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000150d:[<0x10000000782/ti,palmas-pwrbutton.txt v335>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x1000000150d:[<0x10000000782/ti,palmas-pwrbutton.txt v402>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.303 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.060+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a1 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt auth v372 ap=1 s=980 n(v0 rc2024-03-31T23:19:45.257239+0000 b980 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beb33b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a1:[<0x100000006da/gpio_lpc32xx.txt v112>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a1:[<0x100000006da/gpio_lpc32xx.txt v372>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.060+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a2 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt auth v444 ap=1 s=733 n(v0 rc2024-03-31T23:19:45.260239+0000 b733 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beb34100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a2:[<0x100000006da/gpio-lp3943.txt v116>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a2:[<0x100000006da/gpio-lp3943.txt v444>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.061+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a4 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt auth v390 ap=1 s=2995 n(v0 rc2024-03-31T23:19:45.265239+0000 b2995 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beb34c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a4:[<0x100000006da/gpio-pcf857x.txt v124>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a4:[<0x100000006da/gpio-pcf857x.txt v390>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.061+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a5 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt auth v374 ap=1 s=7814 n(v0 rc2024-03-31T23:19:45.268239+0000 b7814 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beb35180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a5:[<0x100000006da/gpio.txt v128>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a5:[<0x100000006da/gpio.txt v374>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.061+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a3 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt auth v422 ap=1 s=428 n(v0 rc2024-03-31T23:19:45.262239+0000 b428 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beb34680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a3:[<0x100000006da/gpio-stmpe.txt v120>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a3:[<0x100000006da/gpio-stmpe.txt v422>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.062+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a6 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt auth v432 ap=1 s=2421 n(v0 rc2024-03-31T23:19:45.270239+0000 b2421 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beb35700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a6:[<0x100000006da/renesas,gpio-rcar.txt v132>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a6:[<0x100000006da/renesas,gpio-rcar.txt v432>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.062+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a7 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt auth v456 ap=1 s=684 n(v0 rc2024-03-31T23:19:45.273239+0000 b684 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a7:[<0x100000006da/gpio-fan.txt v136>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a7:[<0x100000006da/gpio-fan.txt v456>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.062+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a8 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt auth v446 ap=1 s=2502 n(v0 rc2024-03-31T23:19:45.275239+0000 b2502 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a8:[<0x100000006da/8xxx_gpio.txt v140>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a8:[<0x100000006da/8xxx_gpio.txt v446>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.063+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a9 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt auth v378 ap=1 s=737 n(v0 rc2024-03-31T23:19:45.278239+0000 b737 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014a9:[<0x100000006da/gpio-msm.txt v144>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014a9:[<0x100000006da/gpio-msm.txt v378>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.064+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014aa [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt auth v436 ap=1 s=1880 n(v0 rc2024-03-31T23:19:45.280239+0000 b1880 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014aa:[<0x100000006da/gpio-mvebu.txt v148>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014aa:[<0x100000006da/gpio-mvebu.txt v436>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.064+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ab [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt auth v470 ap=1 s=1770 n(v0 rc2024-03-31T23:19:45.283239+0000 b1770 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ab:[<0x100000006da/gpio-vf610.txt v152>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ab:[<0x100000006da/gpio-vf610.txt v470>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.064+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ac [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt auth v428 ap=1 s=1349 n(v0 rc2024-03-31T23:19:45.285239+0000 b1349 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ac:[<0x100000006da/nvidia,tegra20-gpio.txt v156>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ac:[<0x100000006da/nvidia,tegra20-gpio.txt v428>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.064+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ad [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt auth v454 ap=1 s=2196 n(v0 rc2024-03-31T23:19:45.288239+0000 b2196 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ad:[<0x100000006da/mrvl-gpio.txt v160>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ad:[<0x100000006da/mrvl-gpio.txt v454>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.304 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.065+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ae [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt auth v442 ap=1 s=760 n(v0 rc2024-03-31T23:19:45.291239+0000 b760 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ae:[<0x100000006da/gpio-palmas.txt v164>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ae:[<0x100000006da/gpio-palmas.txt v442>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.065+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014af [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt auth v450 ap=1 s=2102 n(v0 rc2024-03-31T23:19:45.293239+0000 b2102 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014af:[<0x100000006da/gpio-bcm-kona.txt v168>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014af:[<0x100000006da/gpio-bcm-kona.txt v450>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.065+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b1 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt auth v380 ap=1 s=1497 n(v0 rc2024-03-31T23:19:45.299239+0000 b1497 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b1:[<0x100000006da/sodaville.txt v176>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b1:[<0x100000006da/sodaville.txt v380>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.066+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b0 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt auth v430 ap=1 s=635 n(v0 rc2024-03-31T23:19:45.296239+0000 b635 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf0cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b0:[<0x100000006da/fujitsu,mb86s70-gpio.txt v172>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b0:[<0x100000006da/fujitsu,mb86s70-gpio.txt v430>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.066+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b2 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt auth v476 ap=1 s=664 n(v0 rc2024-03-31T23:19:45.301239+0000 b664 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef18000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b2:[<0x100000006da/gpio-xgene.txt v180>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b2:[<0x100000006da/gpio-xgene.txt v476>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.066+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b4 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt auth v382 ap=1 s=752 n(v0 rc2024-03-31T23:19:45.308239+0000 b752 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef18b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b4:[<0x100000006da/gpio-clps711x.txt v192>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b4:[<0x100000006da/gpio-clps711x.txt v382>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.066+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b3 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt auth v410 ap=1 s=1360 n(v0 rc2024-03-31T23:19:45.305239+0000 b1360 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b3:[<0x100000006da/gpio-tz1090-pdc.txt v186>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b3:[<0x100000006da/gpio-tz1090-pdc.txt v410>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.067+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b5 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt auth v412 ap=1 s=492 n(v0 rc2024-03-31T23:19:45.312239+0000 b492 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b5:[<0x100000006da/gpio-zevio.txt v198>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b5:[<0x100000006da/gpio-zevio.txt v412>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.067+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b6 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt auth v424 ap=1 s=1641 n(v0 rc2024-03-31T23:19:45.315239+0000 b1641 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef19600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b6:[<0x100000006da/gpio-davinci.txt v204>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b6:[<0x100000006da/gpio-davinci.txt v424>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.067+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b7 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt auth v392 ap=1 s=2388 n(v0 rc2024-03-31T23:19:45.319239+0000 b2388 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b7:[<0x100000006da/gpio-restart.txt v210>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b7:[<0x100000006da/gpio-restart.txt v392>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.305 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.067+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b8 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt auth v398 ap=1 s=1551 n(v0 rc2024-03-31T23:19:45.322239+0000 b1551 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b8:[<0x100000006da/gpio-poweroff.txt v216>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b8:[<0x100000006da/gpio-poweroff.txt v398>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.068+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b9 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt auth v400 ap=1 s=445 n(v0 rc2024-03-31T23:19:45.326239+0000 b445 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014b9:[<0x100000006da/pl061-gpio.txt v222>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014b9:[<0x100000006da/pl061-gpio.txt v400>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.068+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ba [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt auth v478 ap=1 s=1220 n(v0 rc2024-03-31T23:19:45.329239+0000 b1220 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ba:[<0x100000006da/gpio-omap.txt v228>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ba:[<0x100000006da/gpio-omap.txt v478>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.069+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bb [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt auth v468 ap=1 s=1067 n(v0 rc2024-03-31T23:19:45.333238+0000 b1067 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014bb:[<0x100000006da/gpio-sx150x.txt v234>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014bb:[<0x100000006da/gpio-sx150x.txt v468>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.069+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bd [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt auth v402 ap=1 s=1511 n(v0 rc2024-03-31T23:19:45.340238+0000 b1511 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014bd:[<0x100000006da/gpio-nmk.txt v246>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014bd:[<0x100000006da/gpio-nmk.txt v402>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.069+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bc [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt auth v408 ap=1 s=1253 n(v0 rc2024-03-31T23:19:45.336238+0000 b1253 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bef1b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014bc:[<0x100000006da/gpio-samsung.txt v240>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014bc:[<0x100000006da/gpio-samsung.txt v408>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.069+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014be [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt auth v384 ap=1 s=1032 n(v0 rc2024-03-31T23:19:45.343238+0000 b1032 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014be:[<0x100000006da/gpio-74xx-mmio.txt v252>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014be:[<0x100000006da/gpio-74xx-mmio.txt v384>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.070+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bf [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt auth v394 ap=1 s=602 n(v0 rc2024-03-31T23:19:45.347238+0000 b602 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014bf:[<0x100000006da/gpio-74x164.txt v258>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014bf:[<0x100000006da/gpio-74x164.txt v394>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.070+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c0 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt auth v404 ap=1 s=731 n(v0 rc2024-03-31T23:19:45.351238+0000 b731 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c0:[<0x100000006da/gpio_atmel.txt v264>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c0:[<0x100000006da/gpio_atmel.txt v404>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.070+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c1 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt auth v438 ap=1 s=2231 n(v0 rc2024-03-31T23:19:45.354238+0000 b2231 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c1:[<0x100000006da/gpio-max732x.txt v270>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c1:[<0x100000006da/gpio-max732x.txt v438>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.070+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c2 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt auth v434 ap=1 s=1189 n(v0 rc2024-03-31T23:19:45.357238+0000 b1189 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c2:[<0x100000006da/fsl-imx-gpio.txt v276>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c2:[<0x100000006da/fsl-imx-gpio.txt v434>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.071+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c3 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt auth v426 ap=1 s=847 n(v0 rc2024-03-31T23:19:45.366238+0000 b847 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c3:[<0x100000006da/gpio-zynq.txt v282>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c3:[<0x100000006da/gpio-zynq.txt v426>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.306 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.071+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c4 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt auth v414 ap=1 s=1894 n(v0 rc2024-03-31T23:19:45.371238+0000 b1894 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c4:[<0x100000006da/snps-dwapb-gpio.txt v288>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c4:[<0x100000006da/snps-dwapb-gpio.txt v414>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.071+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c5 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt auth v474 ap=1 s=1179 n(v0 rc2024-03-31T23:19:45.376238+0000 b1179 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c5:[<0x100000006da/gpio-mm-lantiq.txt v294>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c5:[<0x100000006da/gpio-mm-lantiq.txt v474>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.072+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c6 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt auth v448 ap=1 s=1036 n(v0 rc2024-03-31T23:19:45.381238+0000 b1036 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c6:[<0x100000006da/gpio-adnp.txt v300>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c6:[<0x100000006da/gpio-adnp.txt v448>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.072+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c7 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt auth v458 ap=1 s=429 n(v0 rc2024-03-31T23:19:45.388238+0000 b429 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c7:[<0x100000006da/moxa,moxart-gpio.txt v306>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c7:[<0x100000006da/moxa,moxart-gpio.txt v458>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.073+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c8 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt auth v464 ap=1 s=2474 n(v0 rc2024-03-31T23:19:45.394238+0000 b2474 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c8:[<0x100000006da/gpio-tz1090.txt v312>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c8:[<0x100000006da/gpio-tz1090.txt v464>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.073+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c9 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt auth v386 ap=1 s=3855 n(v0 rc2024-03-31T23:19:45.400238+0000 b3855 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014c9:[<0x100000006da/gpio-mcp23s08.txt v318>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014c9:[<0x100000006da/gpio-mcp23s08.txt v386>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.073+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cb [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt auth v472 ap=1 s=988 n(v0 rc2024-03-31T23:19:45.413238+0000 b988 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014cb:[<0x100000006da/gpio-xgene-sb.txt v326>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014cb:[<0x100000006da/gpio-xgene-sb.txt v472>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.074+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ca [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt auth v416 ap=1 s=511 n(v0 rc2024-03-31T23:19:45.407238+0000 b511 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ca:[<0x100000006da/cirrus,clps711x-mctrl-gpio.txt v322>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ca:[<0x100000006da/cirrus,clps711x-mctrl-gpio.txt v416>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.074+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cc [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt auth v406 ap=1 s=2287 n(v0 rc2024-03-31T23:19:45.419238+0000 b2287 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014cc:[<0x100000006da/gpio-mxs.txt v330>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014cc:[<0x100000006da/gpio-mxs.txt v406>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.074+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cd [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt auth v466 ap=1 s=953 n(v0 rc2024-03-31T23:19:45.425238+0000 b953 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014cd:[<0x100000006da/gpio-twl4030.txt v334>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014cd:[<0x100000006da/gpio-twl4030.txt v466>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.074+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ce [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt auth v452 ap=1 s=1797 n(v0 rc2024-03-31T23:19:45.432238+0000 b1797 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ce:[<0x100000006da/gpio-xilinx.txt v338>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ce:[<0x100000006da/gpio-xilinx.txt v452>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.075+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d1 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt auth v396 ap=1 s=1505 n(v0 rc2024-03-31T23:19:45.448238+0000 b1505 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d1:[<0x100000006da/cavium-octeon-gpio.txt v350>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d1:[<0x100000006da/cavium-octeon-gpio.txt v396>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.075+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d0 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt auth v460 ap=1 s=1916 n(v0 rc2024-03-31T23:19:45.442238+0000 b1916 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d0:[<0x100000006da/spear_spics.txt v346>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d0:[<0x100000006da/spear_spics.txt v460>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.307 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.075+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cf [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt auth v418 ap=1 s=1335 n(v0 rc2024-03-31T23:19:45.437238+0000 b1335 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014cf:[<0x100000006da/gpio-dsp-keystone.txt v342>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014cf:[<0x100000006da/gpio-dsp-keystone.txt v418>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.075+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d3 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt auth v462 ap=1 s=1253 n(v0 rc2024-03-31T23:19:45.455237+0000 b1253 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf092000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d3:[<0x100000006da/abilis,tb10x-gpio.txt v358>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d3:[<0x100000006da/abilis,tb10x-gpio.txt v462>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.076+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d2 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt auth v388 ap=1 s=620 n(v0 rc2024-03-31T23:19:45.452237+0000 b620 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609beee9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d2:[<0x100000006da/gpio-pca953x.txt v354>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d2:[<0x100000006da/gpio-pca953x.txt v388>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.076+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d4 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt auth v376 ap=1 s=1530 n(v0 rc2024-03-31T23:19:45.459237+0000 b1530 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf092580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d4:[<0x100000006da/gpio-stp-xway.txt v362>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d4:[<0x100000006da/gpio-stp-xway.txt v376>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.077+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d5 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt auth v420 ap=1 s=303 n(v0 rc2024-03-31T23:19:45.463237+0000 b303 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf092b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d5:[<0x100000006da/gpio-stericsson-coh901.txt v366>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d5:[<0x100000006da/gpio-stericsson-coh901.txt v420>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.077+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d6 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt auth v440 ap=1 s=905 n(v0 rc2024-03-31T23:19:45.467237+0000 b905 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf093080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014d6:[<0x100000006da/gpio-grgpio.txt v370>,<0x1000000054e/gpio v6015>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014d6:[<0x100000006da/gpio-grgpio.txt v440>,<0x1000000054e/gpio v11868>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.077+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e2 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt auth v120 ap=1 s=611 n(v0 rc2024-03-31T23:19:45.530237+0000 b611 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf058680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e2:[<0x100000007a8/sun4i.txt v38>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e2:[<0x100000007a8/sun4i.txt v120>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.078+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e1 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt auth v102 ap=1 s=756 n(v0 rc2024-03-31T23:19:45.526237+0000 b756 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf058100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e1:[<0x100000007a8/zforce_ts.txt v34>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e1:[<0x100000007a8/zforce_ts.txt v102>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.078+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e6 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt auth v106 ap=1 s=1371 n(v0 rc2024-03-31T23:19:45.549237+0000 b1371 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf080000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e6:[<0x100000007a8/tsc2007.txt v54>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e6:[<0x100000007a8/tsc2007.txt v106>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.078+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e4 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt auth v118 ap=1 s=1576 n(v0 rc2024-03-31T23:19:45.540237+0000 b1576 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf059180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e4:[<0x100000007a8/stmpe.txt v46>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e4:[<0x100000007a8/stmpe.txt v118>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.079+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e3 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt auth v112 ap=1 s=488 n(v0 rc2024-03-31T23:19:45.535237+0000 b488 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf058c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e3:[<0x100000007a8/egalax-ts.txt v42>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e3:[<0x100000007a8/egalax-ts.txt v112>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.079+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e7 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt auth v94 ap=1 s=1792 n(v0 rc2024-03-31T23:19:45.554237+0000 b1792 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf080580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e7:[<0x100000007a8/edt-ft5x06.txt v58>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e7:[<0x100000007a8/edt-ft5x06.txt v94>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.308 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.079+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e5 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt auth v96 ap=1 s=669 n(v0 rc2024-03-31T23:19:45.545237+0000 b669 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf059700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e5:[<0x100000007a8/mms114.txt v50>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e5:[<0x100000007a8/mms114.txt v96>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.080+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014eb [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt auth v98 ap=1 s=376 n(v0 rc2024-03-31T23:19:45.581236+0000 b376 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf081b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014eb:[<0x100000007a8/lpc32xx-tsc.txt v74>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014eb:[<0x100000007a8/lpc32xx-tsc.txt v98>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.080+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ec [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt auth v114 ap=1 s=2195 n(v0 rc2024-03-31T23:19:45.586236+0000 b2195 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf082100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ec:[<0x100000007a8/ti-tsc-adc.txt v78>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ec:[<0x100000007a8/ti-tsc-adc.txt v114>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.081+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ee [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt auth v104 ap=1 s=655 n(v0 rc2024-03-31T23:19:45.598236+0000 b655 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf082c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ee:[<0x100000007a8/pixcir_i2c_ts.txt v86>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ee:[<0x100000007a8/pixcir_i2c_ts.txt v104>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.083+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e8 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt auth v108 ap=1 s=1193 n(v0 rc2024-03-31T23:19:45.561237+0000 b1193 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf080b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e8:[<0x100000007a8/tsc2005.txt v62>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e8:[<0x100000007a8/tsc2005.txt v108>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.083+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e9 [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt auth v100 ap=1 s=431 n(v0 rc2024-03-31T23:19:45.567237+0000 b431 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf081080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014e9:[<0x100000007a8/sitronix-st1232.txt v66>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014e9:[<0x100000007a8/sitronix-st1232.txt v100>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.084+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ea [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt auth v116 ap=1 s=1221 n(v0 rc2024-03-31T23:19:45.574236+0000 b1221 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf081600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ea:[<0x100000007a8/touchscreen.txt v70>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ea:[<0x100000007a8/touchscreen.txt v116>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.087+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ed [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt auth v110 ap=1 s=830 n(v0 rc2024-03-31T23:19:45.592236+0000 b830 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf082680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ed:[<0x100000007a8/bu21013.txt v82>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ed:[<0x100000007a8/bu21013.txt v110>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.088+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ef [3,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt auth v92 ap=1 s=667 n(v0 rc2024-03-31T23:19:45.603236+0000 b667 1=1+0) caps={25315=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5609bf083180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000014ef:[<0x100000007a8/auo_pixcir_ts.txt v90>,<0x10000000782/touchscreen v215>,<0x1000000054e/input v6175>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[3]","memoryvalue":"(4)0x100000014ef:[<0x100000007a8/auo_pixcir_ts.txt v92>,<0x10000000782/touchscreen v451>,<0x1000000054e/input v12447>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-31T23:20:13.309 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:20:13.134+0000 7f23e0001700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f5 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ auth{0=1,1=1,2=1,3=1} v284 ap=1 f(v0 m2024-03-31T23:19:51.068191+0000 8=8+0) n(v0 rc2024-03-31T23:19:51.070191+0000 b9618 9=8+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5609be9f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007f5:[<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v164>,<0x10000000203/devicetree v672>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000007f5:[<0x100000007ec/i2c v284>,<0x1000000054e/media v12359>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:51.068191+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:51.070191+0000 b9618 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:51.068191+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:51.070191+0000 b9618 9=8+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.424 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.010+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ae [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/auxdisplay/ auth{0=1,1=1,3=1,4=1} v5370 ap=1 f(v0 m2024-03-31T23:19:58.103133+0000 5=5+0) n(v0 rc2024-03-31T23:19:58.107133+0000 b10385 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004ae:[<0x10000000203/auxdisplay v374>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004ae:[<0x10000000203/auxdisplay v5370>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.103133+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.107133+0000 b10385 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.103133+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.107133+0000 b10385 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.424 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.011+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e83 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mips/ auth{0=1,1=1,3=1} v5368 ap=1 f(v0 m2024-03-31T23:19:58.115133+0000 2=2+0) n(v0 rc2024-03-31T23:19:58.117133+0000 b4112 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e83:[<0x10000000203/mips v1975>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e83:[<0x10000000203/mips v5368>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.115133+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.117133+0000 b4112 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.115133+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.117133+0000 b4112 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.424 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.012+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3b [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/extcon/ auth{0=1,1=1,3=1,4=1} v5366 ap=1 f(v0 m2024-03-31T23:19:58.202132+0000 1=1+0) n(v0 rc2024-03-31T23:19:58.204132+0000 b5029 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c3b:[<0x10000000203/extcon v1977>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c3b:[<0x10000000203/extcon v5366>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.202132+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.203132+0000 b5029 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.202132+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.204132+0000 b5029 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.424 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.014+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf7 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/ auth{0=1,1=1,3=1,4=1} v5364 ap=1 f(v0 m2024-03-31T23:19:58.256132+0000 7=7+0) n(v0 rc2024-03-31T23:19:58.265132+0000 b72890 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000cf7:[<0x10000000203/gpio v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000cf7:[<0x10000000203/gpio v5364>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.256132+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.265132+0000 b72890 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.256132+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.265132+0000 b72890 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.014+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ auth{0=1,1=1,3=1} v5362 ap=1 f(v0 m2024-03-31T23:19:58.396131+0000 31=31+0) n(v0 rc2024-03-31T23:19:58.397131+0000 b285164 32=31+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@67},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000dd8:[<0x10000000203/input v1981>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000dd8:[<0x10000000203/input v5362>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.396131+0000 31=31+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.397131+0000 b285164 32=31+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.396131+0000 31=31+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.397131+0000 b285164 32=31+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.016+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001018 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/ auth{0=1,1=1,3=1} v5356 ap=1 f(v0 m2024-03-31T23:19:58.488130+0000 2=2+0) n(v0 rc2024-03-31T23:19:58.490130+0000 b11615 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001018:[<0x10000000203/sh v1987>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001018:[<0x10000000203/sh v5356>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.488130+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.490130+0000 b11615 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.488130+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.490130+0000 b11615 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.016+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001085 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/ auth{0=1,1=1,3=1,4=1} v5358 ap=1 f(v0 m2024-03-31T23:19:58.477130+0000 11=11+0) n(v0 rc2024-03-31T23:19:58.479130+0000 b62384 12=11+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@27},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001085:[<0x10000000203/timers v1985>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001085:[<0x10000000203/timers v5358>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.477130+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.479130+0000 b62384 12=11+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.477130+0000 11=11+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.479130+0000 b62384 12=11+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.016+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/ auth{0=1,1=1,3=1,4=1} v5360 ap=1 f(v0 m2024-03-31T23:19:58.437130+0000 8=8+0) n(v0 rc2024-03-31T23:19:58.439130+0000 b61672 9=8+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@21},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000100e:[<0x10000000203/serial v1983>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000100e:[<0x10000000203/serial v5360>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.437130+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.439130+0000 b61672 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.437130+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.439130+0000 b61672 9=8+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.018+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/ auth{0=1,1=1,3=1,4=1} v5354 ap=1 f(v0 m2024-03-31T23:19:58.602129+0000 14=12+2) n(v2 rc2024-03-31T23:19:58.604129+0000 b132510 24=21+3) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@29},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000117c:[<0x10000000203/x86 v2000>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000117c:[<0x10000000203/x86 v5354>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.602129+0000 14=12+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.604129+0000 b132510 24=21+3)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.602129+0000 14=12+2)","memory_value.rstat":"n(v2 rc2024-03-31T23:19:58.604129+0000 b132510 24=21+3)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.018+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/ auth{0=1,1=1,3=1} v5348 ap=1 f(v0 m2024-03-31T23:19:58.608129+0000 1=1+0) n(v0 rc2024-03-31T23:19:58.611129+0000 b862 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@7},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f3c:[<0x10000000203/nios2 v1995>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000f3c:[<0x10000000203/nios2 v5348>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.608129+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.611129+0000 b862 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.608129+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.611129+0000 b862 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.019+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd0 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ auth{0=1,1=1,3=1,4=1} v5346 ap=1 f(v0 m2024-03-31T23:19:58.636129+0000 5=5+0) n(v0 rc2024-03-31T23:19:58.638129+0000 b18873 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@15},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000dd0:[<0x10000000203/infiniband v1997>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000dd0:[<0x10000000203/infiniband v5346>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.636129+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.638129+0000 b18873 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.636129+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.638129+0000 b18873 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.020+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scheduler/ auth{0=1,1=1,3=1,4=1} v2980 ap=1 f(v0 m2024-03-31T23:19:52.049183+0000 10=10+0) n(v0 rc2024-03-31T23:19:52.053183+0000 b72155 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fb8:[<0x10000000203/scheduler v1959>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000fb8:[<0x10000000203/scheduler v2980>,<0x10000000202/Documentation v1098>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:52.049183+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:52.053183+0000 b72155 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:52.049183+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:52.053183+0000 b72155 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.023+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/usb/ auth{0=1,1=1,3=1} v2978 ap=1 f(v0 m2024-03-31T23:19:52.241181+0000 36=36+0) n(v0 rc2024-03-31T23:19:52.243181+0000 b285767 37=36+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000010a8:[<0x10000000203/usb v1961>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000010a8:[<0x10000000203/usb v2978>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:52.241181+0000 36=36+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:52.243181+0000 b285767 37=36+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:52.241181+0000 36=36+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:52.243181+0000 b285767 37=36+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.425 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.023+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3f [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/laptops/ auth{0=1,1=1,3=1,4=1} v2976 ap=1 f(v0 m2024-03-31T23:19:52.317181+0000 12=12+0) n(v0 rc2024-03-31T23:19:52.321181+0000 b119508 13=12+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e3f:[<0x10000000203/laptops v1963>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e3f:[<0x10000000203/laptops v2976>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:52.317181+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:52.321181+0000 b119508 13=12+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:52.317181+0000 12=12+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:52.321181+0000 b119508 13=12+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.023+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e99 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mmc/ auth{0=1,1=1,3=1,4=1} v2974 ap=1 f(v0 m2024-03-31T23:19:52.339181+0000 4=4+0) n(v0 rc2024-03-31T23:19:52.342181+0000 b8679 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000e99:[<0x10000000203/mmc v1965>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000e99:[<0x10000000203/mmc v2974>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:52.339181+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:52.342181+0000 b8679 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:52.339181+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:52.342181+0000 b8679 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.023+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/ auth{0=1,1=1,3=1,4=1} v2984 ap=1 f(v0 m2024-03-31T23:19:34.563328+0000 2=0+2) n(v4 rc2024-03-31T23:19:56.795144+0000 b510832 63=59+4) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@2},l=25315 | ptrwaiter=0 dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000101c:[<0x10000000203/sound v1982>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000101c:[<0x10000000203/sound v2984>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:34.563328+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:56.795144+0000 b510832 63=59+4)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:34.563328+0000 2=0+2)","memory_value.rstat":"n(v4 rc2024-03-31T23:19:56.795144+0000 b510832 63=59+4)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.025+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/thermal/ auth{0=1,1=1,3=1,4=1} v2966 ap=1 f(v0 m2024-03-31T23:19:56.883143+0000 7=7+0) n(v0 rc2024-03-31T23:19:56.886143+0000 b39371 8=7+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000107c:[<0x10000000203/thermal v1973>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000107c:[<0x10000000203/thermal v2966>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:56.883143+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:56.886143+0000 b39371 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:56.883143+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:56.886143+0000 b39371 8=7+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.026+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd9 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/firmware_class/ auth{0=1,1=1,3=1,4=1} v2964 ap=1 f(v0 m2024-03-31T23:19:56.917143+0000 2=2+0) n(v0 rc2024-03-31T23:19:56.919143+0000 b5013 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@9},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000cd9:[<0x10000000203/firmware_class v1975>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000cd9:[<0x10000000203/firmware_class v2964>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:56.917143+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:56.919143+0000 b5013 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:56.917143+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:56.919143+0000 b5013 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.027+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f1 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cgroups/ auth{0=1,1=1,3=1} v2962 ap=1 f(v0 m2024-03-31T23:19:57.017142+0000 13=13+0) n(v0 rc2024-03-31T23:19:57.018142+0000 b164228 14=13+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@31},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000004f1:[<0x10000000203/cgroups v508>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x100000004f1:[<0x10000000203/cgroups v2962>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:57.017142+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:57.018142+0000 b164228 14=13+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:57.017142+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:57.018142+0000 b164228 14=13+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.028+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001078 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/target/ auth{0=1,1=1,3=1,4=1} v2960 ap=1 f(v0 m2024-03-31T23:19:57.079141+0000 3=3+0) n(v0 rc2024-03-31T23:19:57.080141+0000 b59396 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@11},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001078:[<0x10000000203/target v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001078:[<0x10000000203/target v2960>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:57.079141+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:57.080141+0000 b59396 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:57.079141+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:57.080141+0000 b59396 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.035+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/postprocess/ auth{0=1,1=1,3=1} v202 ap=1 f(v0 m2024-03-31T23:19:59.411122+0000 2=2+0) n(v0 rc2024-03-31T23:19:59.413122+0000 b40890 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@8},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000109e:[<0x10000001093/postprocess v36>,<0x10000000203/trace v1990>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000109e:[<0x10000001093/postprocess v202>,<0x10000000203/trace v3679>,<0x10000000202/Documentation v1100>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.411122+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.413122+0000 b40890 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.411122+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.413122+0000 b40890 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.051+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca8 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/nfs/ auth{0=1,1=1,3=1} v1362 ap=1 f(v0 m2024-03-31T23:19:59.836119+0000 14=14+0) n(v0 rc2024-03-31T23:19:59.838119+0000 b75620 15=14+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@32},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000ca8:[<0x10000000c65/nfs v233>,<0x10000000203/filesystems v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000ca8:[<0x10000000c65/nfs v1362>,<0x10000000203/filesystems v3688>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.836119+0000 14=14+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.838119+0000 b75620 15=14+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.836119+0000 14=14+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.838119+0000 b75620 15=14+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.053+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c74 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/caching/ auth{0=1,1=1,3=1,4=1} v1360 ap=1 f(v0 m2024-03-31T23:19:59.894118+0000 6=6+0) n(v0 rc2024-03-31T23:19:59.895118+0000 b116068 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@16},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c74:[<0x10000000c65/caching v235>,<0x10000000203/filesystems v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c74:[<0x10000000c65/caching v1360>,<0x10000000203/filesystems v3688>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.894118+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.895118+0000 b116068 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.894118+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.895118+0000 b116068 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.426 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.054+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c7c [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/cifs/ auth{0=1,1=1,3=1,4=1} v1358 ap=1 f(v0 m2024-03-31T23:19:59.923118+0000 6=6+0) n(v0 rc2024-03-31T23:19:59.924118+0000 b96552 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@16},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c7c:[<0x10000000c65/cifs v237>,<0x10000000203/filesystems v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c7c:[<0x10000000c65/cifs v1358>,<0x10000000203/filesystems v3688>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.923118+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.924118+0000 b96552 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.923118+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.924118+0000 b96552 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.057+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c84 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/configfs/ auth{0=1,1=1,3=1} v1356 ap=1 f(v0 m2024-03-31T23:19:59.964118+0000 4=4+0) n(v0 rc2024-03-31T23:19:59.965118+0000 b45727 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@12},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000c84:[<0x10000000c65/configfs v239>,<0x10000000203/filesystems v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000c84:[<0x10000000c65/configfs v1356>,<0x10000000203/filesystems v3688>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.964118+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.965118+0000 b45727 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.964118+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.965118+0000 b45727 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.059+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbd [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/pohmelfs/ auth{0=1,1=1,3=1,4=1} v1354 ap=1 f(v0 m2024-03-31T23:19:59.998117+0000 3=3+0) n(v0 rc2024-03-31T23:19:59.999117+0000 b15882 4=3+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@10},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000cbd:[<0x10000000c65/pohmelfs v241>,<0x10000000203/filesystems v1979>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000cbd:[<0x10000000c65/pohmelfs v1354>,<0x10000000203/filesystems v3688>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:59.998117+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:59.999117+0000 b15882 4=3+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:59.998117+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:59.999117+0000 b15882 4=3+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.103+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118a [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/ auth{0=1,1=1,3=1} v312 ap=1 f(v0 m2024-03-31T23:19:58.555129+0000 8=8+0) n(v0 rc2024-03-31T23:19:58.557129+0000 b27297 9=8+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@20},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000118a:[<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v2000>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000118a:[<0x1000000117c/x86_64 v312>,<0x10000000203/x86 v5354>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.555129+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.557129+0000 b27297 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.555129+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.557129+0000 b27297 9=8+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.104+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001183 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/ auth{0=1,1=1,3=1,4=1} v310 ap=1 f(v0 m2024-03-31T23:19:58.581129+0000 1=1+0) n(v0 rc2024-03-31T23:19:58.584129+0000 b4889 2=1+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@6},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001183:[<0x1000000117c/i386 v50>,<0x10000000203/x86 v2000>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001183:[<0x1000000117c/i386 v310>,<0x10000000203/x86 v5354>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:58.581129+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:58.584129+0000 b4889 2=1+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:58.581129+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:58.584129+0000 b4889 2=1+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.119+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101d [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/ auth{0=1,1=1,3=1} v614 ap=1 f(v0 m2024-03-31T23:19:56.679145+0000 26=25+1) n(v2 rc2024-03-31T23:19:56.681145+0000 b315795 37=35+2) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@19},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000101d:[<0x1000000101c/alsa v113>,<0x10000000203/sound v1982>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x1000000101d:[<0x1000000101c/alsa v614>,<0x10000000203/sound v2984>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:56.679145+0000 26=25+1)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:56.681145+0000 b315795 37=35+2)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:56.679145+0000 26=25+1)","memory_value.rstat":"n(v2 rc2024-03-31T23:19:56.681145+0000 b315795 37=35+2)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.119+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001042 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/oss/ auth{0=1,1=1,3=1} v610 ap=1 f(v0 m2024-03-31T23:19:56.794144+0000 24=24+0) n(v0 rc2024-03-31T23:19:56.795144+0000 b195037 25=24+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@51},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001042:[<0x1000000101c/oss v110>,<0x10000000203/sound v1982>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001042:[<0x1000000101c/oss v610>,<0x10000000203/sound v2984>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:56.794144+0000 24=24+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:56.795144+0000 b195037 25=24+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:56.794144+0000 24=24+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:56.795144+0000 b195037 25=24+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.427 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:20:13.135+0000 7f56f0838700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001037 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/soc/ auth{0=1,1=1,3=1} v361 ap=1 f(v0 m2024-03-31T23:19:52.527179+0000 10=10+0) n(v0 rc2024-03-31T23:19:52.536179+0000 b47424 11=10+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bf304a3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001037:[<0x1000000101d/soc v74>,<0x1000000101c/alsa v113>,<0x10000000203/sound v1982>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000001037:[<0x1000000101d/soc v361>,<0x1000000101c/alsa v614>,<0x10000000203/sound v2984>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:52.527179+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:52.536179+0000 b47424 11=10+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:52.527179+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:52.536179+0000 b47424 11=10+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.719 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.280+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb6 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ auth{0=1,1=1,2=1} v477 ap=1 f(v0 m2024-03-31T23:19:50.800193+0000 2=2+0) n(v0 rc2024-03-31T23:19:50.804193+0000 b2017 3=2+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feec2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000bb6:[<0x10000000ba9/bridge v117>,<0x1000000054e/video v3251>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000bb6:[<0x10000000ba9/bridge v477>,<0x1000000054e/video v12457>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:50.800193+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:50.804193+0000 b2017 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:50.800193+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:50.804193+0000 b2017 3=2+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.719 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.282+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/ auth{0=1,2=1,3=1} fragtree_t(*^3) v2310 ap=1 f(v0 m2024-03-31T23:20:02.834094+0000 166=166+0) n(v0 rc2024-03-31T23:20:02.835094+0000 b1802353 167=166+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@343},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000033e:[<0x10000000324/v4l v386>,<0x10000000310/media v74>,<0x10000000203/DocBook v116>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x1000000033e:[<0x10000000324/v4l v2310>,<0x10000000310/media v612>,<0x10000000203/DocBook v4128>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.834094+0000 166=166+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.835094+0000 b1802353 167=166+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.834094+0000 166=166+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:02.835094+0000 b1802353 167=166+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.719 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:20:13.285+0000 7f8ce0de8700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000329 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ auth{0=1,2=1,3=1} v2308 ap=1 f(v0 m2024-03-31T23:20:02.898093+0000 13=13+0) n(v0 rc2024-03-31T23:20:02.899093+0000 b352826 14=13+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@30},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55bb537f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000329:[<0x10000000324/dvb v36>,<0x10000000310/media v74>,<0x10000000203/DocBook v116>,<0x10000000202/Documentation v162>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v30>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v22>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v36>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v47>,<0x1/volumes v45>]//[]","memoryvalue":"(2)0x10000000329:[<0x10000000324/dvb v2308>,<0x10000000310/media v612>,<0x10000000203/DocBook v4128>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:20:02.898093+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:20:02.899093+0000 b352826 14=13+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:20:02.898093+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:20:02.899093+0000 b352826 14=13+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.719 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.281+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000baf [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ auth{0=1,1=1,2=1,4=1} v475 ap=1 f(v0 m2024-03-31T23:19:50.872193+0000 6=6+0) n(v0 rc2024-03-31T23:19:50.874193+0000 b4553 7=6+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7feec2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000baf:[<0x10000000ba9/backlight v119>,<0x1000000054e/video v3251>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x10000000baf:[<0x10000000ba9/backlight v475>,<0x1000000054e/video v12457>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:50.872193+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:50.874193+0000 b4553 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:50.872193+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:50.874193+0000 b4553 7=6+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.720 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.305+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c2 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ auth{0=1,1=1,2=1,4=1} v364 ap=1 f(v0 m2024-03-31T23:19:46.480229+0000 7=5+2) n(v3 rc2024-03-31T23:19:46.482229+0000 b20387 17=14+3) old_inodes=1 (inest mix dirty) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 dirtyscattered=1 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000009c2:[<0x100000009be/cpm_qe v215>,<0x100000009b5/fsl v277>,<0x1000000054e/powerpc v6571>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000009c2:[<0x100000009be/cpm_qe v364>,<0x100000009b5/fsl v416>,<0x1000000054e/powerpc v12449>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.480229+0000 7=5+2)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.482229+0000 b20387 17=14+3)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.480229+0000 7=5+2)","memory_value.rstat":"n(v3 rc2024-03-31T23:19:46.482229+0000 b20387 17=14+3)","error_str":""},"return_code":0} 2024-03-31T23:20:13.720 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.311+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009cc [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ auth{0=1,1=1,2=1} v159 ap=1 f(v0 m2024-03-31T23:19:46.446229+0000 5=5+0) n(v0 rc2024-03-31T23:19:46.448229+0000 b8889 6=5+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee7eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000009cc:[<0x100000009c2/qe v79>,<0x100000009be/cpm_qe v215>,<0x100000009b5/fsl v277>,<0x1000000054e/powerpc v6571>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000009cc:[<0x100000009c2/qe v159>,<0x100000009be/cpm_qe v364>,<0x100000009b5/fsl v416>,<0x1000000054e/powerpc v12449>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.446229+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.448229+0000 b8889 6=5+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.446229+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:46.448229+0000 b8889 6=5+1)","error_str":""},"return_code":0} 2024-03-31T23:20:13.720 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:20:13.312+0000 7f7044def700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c4 [...4,head] /volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ auth{0=1,1=1,2=1,4=1} v157 ap=1 f(v0 m2024-03-31T23:19:46.472229+0000 4=4+0) n(v0 rc2024-03-31T23:19:46.474229+0000 b2583 5=4+1) old_inodes=1 (inest mix) (ifile excl) caps={25315=pAsLsXsFsx/pAsLsXsFsx@5},l=25315 | ptrwaiter=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=1 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55c7fee7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000009c4:[<0x100000009c2/cpm v109>,<0x100000009be/cpm_qe v215>,<0x100000009b5/fsl v277>,<0x1000000054e/powerpc v6571>,<0x1000000054c/bindings v429>,<0x10000000203/devicetree v2184>,<0x10000000202/Documentation v800>,<0x10000000201/linux-4.0.5 v51>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v47>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v67>,<0x1/volumes v65>]//[]","memoryvalue":"(2)0x100000009c4:[<0x100000009c2/cpm v157>,<0x100000009be/cpm_qe v364>,<0x100000009b5/fsl v416>,<0x1000000054e/powerpc v12449>,<0x1000000054c/bindings v816>,<0x10000000203/devicetree v2721>,<0x10000000202/Documentation v1102>,<0x10000000201/linux-4.0.5 v84>,<0x10000000006/untar_tar v95>,<0x10000000005/tmp v80>,<0x100000001fb/client.0 v53>,<0x100000001fa/0197c560-8497-408a-b67e-ff3c1c131db9 v82>,<0x10000000001/sv_1 v36>,<0x10000000000/qa v63>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-31T23:19:46.472229+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-31T23:19:46.474229+0000 b2583 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-31T23:19:46.472229+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-31T23:19:46.474229+0000 b2583 5=4+1)","error_str":""},"return_code":0} 2024-03-31T23:20:14.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: pgmap v64: 129 pgs: 129 active+clean; 163 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 947 op/s 2024-03-31T23:20:14.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub queued for path: / 2024-03-31T23:20:14.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000052b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/development-process) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000042e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ide) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e75 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/metag) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/wimax) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f69 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/regulator) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/security) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/backlight) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001093 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f67 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/powercap) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c24 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dvb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e5a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/locking) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000eab (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/netlabel) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c41 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/rapidio) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000436 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f94 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pti) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/powerpc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000444 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001195 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/xtensa) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/connector) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e72 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/memory-devices) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f8a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/prctl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e4d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/leds) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c65 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e05 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/isdn) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000003f9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f56 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/platform) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000dfb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ioctl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ea8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/namespaces) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e69 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/m68k) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000010cd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vDSO) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/parisc) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blockdev/drbd) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blackfin) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e1f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ja_JP) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/spi) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.079 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c19 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/driver-model) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000521 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/crypto) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000dba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ia64) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ptp) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001125 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000534 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/device-mapper) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm64) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000d08 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/hwmon) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000414 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000fa9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/s390) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001091 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/tpm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.080 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e86 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004ae (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/auxdisplay) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000040c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e83 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mips) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f39 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nfc) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/extcon) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001353 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ce9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/frv) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001352 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.081 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000cf7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000dd8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fault-injection) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.082 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001360 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.083 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001362 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.083 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001364 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cpuidle) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001366 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001367 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000136b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001368 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001365 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001199 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f3c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001369 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/block) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000136d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000136e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000136f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.086 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/console) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000fb8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scheduler) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001370 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001372 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000eb1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001374 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001376 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001375 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001377 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001378 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/usb) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.087 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/laptops) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e99 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mmc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/early-userspace) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c13 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dmaengine) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000107c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/thermal) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000310 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: active paths [/] 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/firmware_class) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cgroups) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001459 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000145a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000145d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000145b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.088 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000145c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/target) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000145e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000145f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001460 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001461 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001462 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001463 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001465 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001466 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001464 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001467 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001468 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001469 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.089 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000146a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000109e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/postprocess) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000146f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001471 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000146e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000146b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001472 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001470 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001475 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001473 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001474 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001476 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001477 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.090 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001479 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001478 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000147c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000147d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000147e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000147b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014da (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014db (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014df (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ca8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/nfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.092 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c74 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/caching) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014fa (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014fb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001500 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c7c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/cifs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ff (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014fc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001501 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.093 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000c84 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/configfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001504 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001505 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001506 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/pohmelfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001509 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000150a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000150b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.094 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014a9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014aa (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ab (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ac (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ad (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ae (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014af (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.095 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014b9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014bb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014bd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014bc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014be (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.096 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014bf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014cb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014cc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.097 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014cd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014d6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014eb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ec (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014e9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ea (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000014ef (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001183 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001042 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/oss) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/soc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000045d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000458 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000044e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.100 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000478 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004a0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000470 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000011a0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000011a9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/filesystems) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000011a3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm64) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000011b2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/video4linux) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000008e0 (~mds3/stray3/100000008e0) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000134c (~mds3/stray3/1000000134c) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000008f4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.101 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001351 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000009be (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000009b6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000bb6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/bridge) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000baf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/backlight) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000009c2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000009cc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000009c4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:13 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: pgmap v64: 129 pgs: 129 active+clean; 163 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 947 op/s 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub queued for path: / 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000052b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/development-process) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000042e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ide) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e75 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/metag) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/wimax) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f69 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/regulator) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/security) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/backlight) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001093 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f67 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/powercap) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c24 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dvb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e5a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/locking) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000eab (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/netlabel) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c41 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/rapidio) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000436 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f94 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pti) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/powerpc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000444 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001195 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/xtensa) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/connector) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e72 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/memory-devices) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f8a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/prctl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e4d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/leds) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c65 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e05 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/isdn) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000003f9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f56 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/platform) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000dfb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ioctl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.179 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ea8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/namespaces) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.179 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e69 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/m68k) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.179 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000010cd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vDSO) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.179 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/parisc) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.179 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blockdev/drbd) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.179 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blackfin) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e1f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ja_JP) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/spi) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c19 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/driver-model) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000521 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/crypto) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000dba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ia64) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ptp) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001125 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.180 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000534 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/device-mapper) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm64) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000d08 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/hwmon) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000414 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000fa9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/s390) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001091 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/tpm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e86 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004ae (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/auxdisplay) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000040c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e83 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mips) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f39 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nfc) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.181 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/extcon) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.182 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001353 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.182 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ce9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/frv) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.182 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.182 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001352 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000cf7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000dd8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.183 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fault-injection) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001360 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001362 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001364 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cpuidle) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001366 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001367 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000136b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.184 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001368 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001365 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001199 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f3c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001369 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/block) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000136d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000136e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000136f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/console) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000fb8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scheduler) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.185 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001370 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001372 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000eb1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001374 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001376 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001375 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001377 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001378 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/usb) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/laptops) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.186 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e99 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mmc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/early-userspace) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c13 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dmaengine) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000107c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/thermal) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000310 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: active paths [/] 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/firmware_class) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cgroups) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001459 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000145a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000145d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000145b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000145c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/target) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000145e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000145f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001460 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001461 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001462 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001463 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.188 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001465 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001466 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001464 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001467 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001468 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001469 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000146a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000109e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/postprocess) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000146f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001471 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000146e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000146b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001472 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.189 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001470 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001475 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001473 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001474 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001476 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001477 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001479 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001478 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000147c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000147d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000147e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000147b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.190 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014da (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014db (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014df (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.191 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ca8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/nfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c74 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/caching) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.192 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014fa (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014fb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001500 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c7c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/cifs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ff (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014fc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.193 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001501 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000c84 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/configfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001504 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001505 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001506 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/pohmelfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001509 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000150a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000150b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.194 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014a9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014aa (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ab (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.195 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ac (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ad (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ae (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014af (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014b9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.196 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014bb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014bd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014bc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014be (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014bf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.197 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014cb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014cc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014cd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.198 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014d6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.199 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014eb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ec (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014e9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ea (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000014ef (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.200 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001183 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001042 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/oss) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/soc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000045d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000458 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000044e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.201 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.202 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.202 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000478 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.202 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004a0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000470 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000011a0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000011a9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/filesystems) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000011a3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm64) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000011b2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/video4linux) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000008e0 (~mds3/stray3/100000008e0) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000134c (~mds3/stray3/1000000134c) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.203 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000008f4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001351 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000009be (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000009b6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000bb6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/bridge) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000baf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/backlight) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000009c2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000009cc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000009c4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.204 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:13 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: pgmap v64: 129 pgs: 129 active+clean; 163 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 947 op/s 2024-03-31T23:20:14.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub queued for path: / 2024-03-31T23:20:14.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000052b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/development-process) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000042e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ide) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e75 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/metag) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/wimax) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f69 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/regulator) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/security) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/backlight) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001093 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f67 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/powercap) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c24 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dvb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e5a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/locking) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000eab (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/netlabel) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c41 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/rapidio) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000436 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f94 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pti) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/powerpc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000444 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001195 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/xtensa) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/connector) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e72 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/memory-devices) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f8a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/prctl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e4d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/leds) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c65 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e05 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/isdn) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000003f9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f56 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/platform) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000dfb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ioctl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ea8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/namespaces) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e69 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/m68k) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000010cd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vDSO) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/parisc) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blockdev/drbd) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blackfin) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e1f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ja_JP) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/spi) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c19 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/driver-model) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.223 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000521 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/crypto) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000dba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ia64) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ptp) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001125 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000534 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/device-mapper) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm64) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000d08 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/hwmon) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000414 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000fa9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/s390) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001091 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/tpm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e86 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.224 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004ae (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/auxdisplay) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000040c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e83 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mips) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f39 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nfc) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/extcon) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001353 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ce9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/frv) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001352 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.225 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000cf7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000dd8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fault-injection) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001360 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001362 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.226 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.228 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001364 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cpuidle) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001366 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001367 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000136b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001368 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001365 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001199 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f3c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001369 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/block) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000136d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000136e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000136f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/console) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000fb8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scheduler) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001370 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001372 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.230 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000eb1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001374 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001376 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001375 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001377 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001378 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/usb) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/laptops) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e99 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mmc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/early-userspace) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c13 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dmaengine) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000107c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/thermal) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000310 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook) see mds.i log and `damage ls` output for details 2024-03-31T23:20:14.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: active paths [/] 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/firmware_class) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cgroups) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001459 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000145a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000145d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000145b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000145c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/target) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000145e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000145f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001460 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001461 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001462 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001463 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001465 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001466 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001464 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001467 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001468 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001469 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000146a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000109e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/postprocess) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000146f (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001471 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000146e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000146b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001472 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001470 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001475 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001473 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001474 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001476 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001477 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001479 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001478 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000147c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000147d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000147e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000147b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.234 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014da (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014db (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014df (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ca8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/nfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c74 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/caching) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014fa (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014fb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001500 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c7c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/cifs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.236 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ff (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014fc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001501 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000c84 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/configfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001504 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001505 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001506 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/pohmelfs) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001509 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000150a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.237 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000150b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014a9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014aa (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ab (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.238 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ac (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ad (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ae (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014af (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014b9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ba (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014bb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014bd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014bc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014be (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014bf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.240 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014cb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014cc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014cd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014d6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.241 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e1 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014eb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ec (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014e9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ea (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.242 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000014ef (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001183 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001042 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/oss) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c) see mds.f log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/soc) see mds.h log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000045d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000458 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000044e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000478 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004a0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000470 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000011a0 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000011a9 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/filesystems) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.245 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000011a3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm64) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000011b2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/video4linux) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000008e0 (~mds3/stray3/100000008e0) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000134c (~mds3/stray3/1000000134c) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000008f4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001351 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000009be (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000009b6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000bb6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/bridge) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000baf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/backlight) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000009c2 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000009cc (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.246 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000009c4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm) see mds.c log and `damage ls` output for details 2024-03-31T23:20:14.247 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:13 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cdrom) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000cdd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fmc) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000d92 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mn10300) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ea3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/bus-devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e38 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ko_KR) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f88 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pps) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/kbuild) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/scsi_transport_srp) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000110c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx88) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx2341x) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/bttv) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001127 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/uml) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000e91 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/mei) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/caif) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.077 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/timestamping) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000efd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/mac80211_hwsim) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000daf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/muxes) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000d93 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/busses) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/masters) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/slaves) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000ea4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/nand) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000670 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ti) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000663 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/st) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000112b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.078 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:14 smithi042 ceph-mon[32380]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:15.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cdrom) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000cdd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fmc) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000d92 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mn10300) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ea3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/bus-devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e38 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ko_KR) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f88 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pps) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/kbuild) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/scsi_transport_srp) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000110c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx88) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx2341x) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/bttv) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001127 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/uml) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000e91 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/mei) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/caif) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/timestamping) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000efd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/mac80211_hwsim) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000daf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/muxes) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000d93 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/busses) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/masters) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/slaves) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000ea4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/nand) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000670 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ti) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000663 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/st) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000112b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.175 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:14 smithi094 ceph-mon[36167]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:15.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cdrom) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000cdd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fmc) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000d92 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mn10300) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ea3 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/bus-devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e38 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ko_KR) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f88 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pps) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/kbuild) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/scsi_transport_srp) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000110c (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx88) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx2341x) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/bttv) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001127 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/uml) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000e91 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/mei) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/caif) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/timestamping) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000efd (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/mac80211_hwsim) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000daf (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/muxes) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000d93 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/busses) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/masters) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/slaves) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000ea4 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/nand) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000670 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ti) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000663 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/st) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000112b (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/devices) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.i log and `damage ls` output for details 2024-03-31T23:20:15.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:14 smithi188 ceph-mon[36068]: scrub summary: idle+waiting paths [/] 2024-03-31T23:20:16.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:15 smithi042 ceph-mon[32380]: pgmap v65: 129 pgs: 129 active+clean; 163 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 523 op/s 2024-03-31T23:20:16.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:15 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:16.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:15 smithi094 ceph-mon[36167]: pgmap v65: 129 pgs: 129 active+clean; 163 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 523 op/s 2024-03-31T23:20:16.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:15 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:16.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:15 smithi188 ceph-mon[36068]: pgmap v65: 129 pgs: 129 active+clean; 163 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 523 op/s 2024-03-31T23:20:16.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:15 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:17.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32376]: 2024-03-31T23:20:16.768+0000 7f0106966700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:17.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:16 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:20:17.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:16 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:20:17.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:16 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: pgmap v66: 129 pgs: 129 active+clean; 163 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 610 op/s 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:active 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:20:18.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:17 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: pgmap v66: 129 pgs: 129 active+clean; 163 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 610 op/s 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:active 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:20:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:17 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:20:18.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: pgmap v66: 129 pgs: 129 active+clean; 163 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 610 op/s 2024-03-31T23:20:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] up:active 2024-03-31T23:20:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:20:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:20:18.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:17 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:20:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:18 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:active 2024-03-31T23:20:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:18 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:19.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:18 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:20:19.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:18 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:active 2024-03-31T23:20:19.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:18 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:19.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:18 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:20:19.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:18 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] up:active 2024-03-31T23:20:19.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:18 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:19.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:18 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 -- 172.21.15.42:0/1939894966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c1020e0 msgr2=0x7f8c9c10e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/1939894966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c1020e0 0x7f8c9c10e5f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009930 tx=0x7f8c9402bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 -- 172.21.15.42:0/1939894966 shutdown_connections 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/1939894966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c1020e0 0x7f8c9c10e5f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/1939894966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c101720 0x7f8c9c101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/1939894966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c9c107730 0x7f8c9c107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.878+0000 7f8ca0d79640 1 -- 172.21.15.42:0/1939894966 >> 172.21.15.42:0/1939894966 conn(0x7f8c9c0fd230 msgr2=0x7f8c9c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 -- 172.21.15.42:0/1939894966 shutdown_connections 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 -- 172.21.15.42:0/1939894966 wait complete. 2024-03-31T23:20:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 Processor -- start 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 -- start start 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 0x7f8c9c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c9c1020e0 0x7f8c9c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.879+0000 7f8ca0d79640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c107730 0x7f8c9c19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8ca0d79640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c111c10 con 0x7f8c9c101720 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8ca0d79640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c111a90 con 0x7f8c9c107730 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8ca0d79640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c111d90 con 0x7f8c9c1020e0 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 0x7f8c9c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 0x7f8c9c197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36462/0 (socket says 172.21.15.42:36462) 2024-03-31T23:20:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3311714123 learned_addr learned my addr 172.21.15.42:0/3311714123 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c9c1020e0 0x7f8c9c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c107730 0x7f8c9c19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3311714123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c9c1020e0 msgr2=0x7f8c9c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c9c1020e0 0x7f8c9c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3311714123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c107730 msgr2=0x7f8c9c19c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c107730 0x7f8c9c19c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3311714123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9c19cfa0 con 0x7f8c9c101720 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c107730 0x7f8c9c19c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 0x7f8c9c197fb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00eb90 tx=0x7f8c8c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c937fe640 1 -- 172.21.15.42:0/3311714123 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c004d20 con 0x7f8c9c101720 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9c19d290 con 0x7f8c9c101720 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c937fe640 1 -- 172.21.15.42:0/3311714123 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c8c00ee90 con 0x7f8c9c101720 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8c937fe640 1 -- 172.21.15.42:0/3311714123 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0108b0 con 0x7f8c9c101720 2024-03-31T23:20:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.880+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9c1a4b20 con 0x7f8c9c101720 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.882+0000 7f8c937fe640 1 -- 172.21.15.42:0/3311714123 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f8c8c005020 con 0x7f8c9c101720 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 Processor -- start 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 -- start start 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c937fe640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c880a26b0 0x7f8c880a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c937fe640 1 -- 172.21.15.42:0/3311714123 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c8c0cf490 con 0x7f8c9c101720 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c880a26b0 0x7f8c880a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ebaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ec3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600ec61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557600e1d8f0 con 0x557600ec3db0 2024-03-31T23:20:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557600dc68d0 con 0x557600ebafe0 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557600e19990 con 0x557600eba6c0 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ebaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c9ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600ec61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ebaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:57098/0 (socket says 172.21.15.42:57098) 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3444950652 learned_addr learned my addr 172.21.15.42:0/3444950652 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.883+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ec3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3444950652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 msgr2=0x557600ec3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ec3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3444950652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 msgr2=0x557600ec61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600ec61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9a59c640 1 -- 172.21.15.42:0/3444950652 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557600b32210 con 0x557600eba6c0 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600ec61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:20:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c880a26b0 0x7f8c880a4b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005940 tx=0x7f8c9402de50 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ebaaa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c098270 tx=0x7f8c8c09b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1b8628919bb49ad server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c90ff9640 1 -- 172.21.15.42:0/3444950652 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0b4070 con 0x557600eba6c0 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c90ff9640 1 -- 172.21.15.42:0/3444950652 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c8c09b8a0 con 0x557600eba6c0 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.884+0000 7f8c90ff9640 1 -- 172.21.15.42:0/3444950652 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0cf160 con 0x557600eba6c0 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3444950652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 msgr2=0x557600ebaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ebaaa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c098270 tx=0x7f8c8c09b4a0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3444950652 shutdown_connections 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600ec61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ec3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3444950652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ebaaa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3444950652 >> 172.21.15.42:0/3444950652 conn(0x557600eb4fe0 msgr2=0x557600eb53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3444950652 shutdown_connections 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3444950652 wait complete. 2024-03-31T23:20:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 -- start start 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.885+0000 7f8ca3a31740 1 Processor -- start 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ec0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 0x557600ec13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ec3db0 0x557600ec1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557600ec69e0 con 0x557600ebafe0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557600dbbf80 con 0x557600eba6c0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557600ec6b60 con 0x557600ec3db0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 10 client.0 _ll_register_callbacks cb 0x557600e14290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 0x557600ec13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ec0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 0x557600ec13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36480/0 (socket says 172.21.15.42:36480) 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 -- 172.21.15.42:0/2803770144 learned_addr learned my addr 172.21.15.42:0/2803770144 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ec3db0 0x557600ec1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 -- 172.21.15.42:0/2803770144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ec3db0 msgr2=0x557600ec1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ec3db0 0x557600ec1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 -- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 msgr2=0x557600ec0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ec0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 -- 172.21.15.42:0/2803770144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557600bfe620 con 0x557600ebafe0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ec0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 0x557600ec13d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8c84012720 tx=0x7f8c84012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5bc94c968dc615 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2803770144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400f920 con 0x557600ebafe0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2803770144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c8400fac0 con 0x557600ebafe0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.886+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c8c09b8a0 con 0x557600ebafe0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2803770144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8c8400fd00 con 0x557600ebafe0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 10 client.16545 fetch_fsmap learned FSMap version 37 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557600ed29d0 con 0x557600ebafe0 2024-03-31T23:20:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2803770144 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c8c09b8a0 con 0x557600ebafe0 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2803770144 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8406+0+0 (secure 0 0 0) 0x7f8c84005490 con 0x557600ebafe0 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 10 client.16545 fetch_fsmap finished waiting for FSMap version 37 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 20 client.16545 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600ed6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 4 client.16545 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557600e31120 con 0x557600ed4210 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.887+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600ed6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600ed6600 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ab00ec30e73d375 server_cookie=c4cc9d6c17b71f93 in_seq=0 out_seq=0 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8c81ffb640 10 client.16545 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2803770144 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557600e31120 con 0x557600ed4210 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8c81ffb640 10 client.16545 handle_command_reply: tid=0 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8ca3a31740 1 client.16545 shutdown 2024-03-31T23:20:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 msgr2=0x557600ec13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.888+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 0x557600ec13d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8c84012720 tx=0x7f8c84012be0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 shutdown_connections 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600ed6600 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ec3db0 0x557600ec1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ebafe0 0x557600ec13d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8c81ffb640 0 client.16545 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2803770144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ec0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 >> 172.21.15.42:0/2803770144 conn(0x557600eb4fe0 msgr2=0x557600eb6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 shutdown_connections 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2803770144 wait complete. 2024-03-31T23:20:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.889+0000 7f8ca3a31740 20 client.16545 trim_cache size 0 max 16384 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.903+0000 7f8ca3a31740 1 Processor -- start 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.903+0000 7f8ca3a31740 1 -- start start 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.903+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ec35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ecf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600edbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1aec30 con 0x557600ec3db0 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1b08f0 con 0x557600ebafe0 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1af3c0 con 0x557600eba6c0 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c9ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600edbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ec35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c9ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600edbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36494/0 (socket says 172.21.15.42:36494) 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c9ad9d640 1 -- 172.21.15.42:0/3134560966 learned_addr learned my addr 172.21.15.42:0/3134560966 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ecf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 -- 172.21.15.42:0/3134560966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 msgr2=0x557600ec35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ec35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 -- 172.21.15.42:0/3134560966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 msgr2=0x557600edbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600edbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 -- 172.21.15.42:0/3134560966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557600ebf420 con 0x557600ebafe0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600edbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ecf780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c84000c00 tx=0x7f8c8401c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92dd7438467ee406 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c83fff640 1 -- 172.21.15.42:0/3134560966 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400fea0 con 0x557600ebafe0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c83fff640 1 -- 172.21.15.42:0/3134560966 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c8400f920 con 0x557600ebafe0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.904+0000 7f8c83fff640 1 -- 172.21.15.42:0/3134560966 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c840035f0 con 0x557600ebafe0 2024-03-31T23:20:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3134560966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 msgr2=0x557600ecf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ecf780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c84000c00 tx=0x7f8c8401c870 comp rx=0 tx=0).stop 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3134560966 shutdown_connections 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600edbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600ebafe0 0x557600ecf780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/3134560966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600eba6c0 0x557600ec35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3134560966 >> 172.21.15.42:0/3134560966 conn(0x557600eb4fe0 msgr2=0x557600eb3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3134560966 shutdown_connections 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 -- 172.21.15.42:0/3134560966 wait complete. 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 -- start start 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.905+0000 7f8ca3a31740 1 Processor -- start 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ebe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ebafe0 0x557600ebe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600f39260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1b0160 con 0x557600ec3db0 2024-03-31T23:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1afa90 con 0x557600eba6c0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1acbf0 con 0x557600ebafe0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 10 client.0 _ll_register_callbacks cb 0x7f8c84009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600f39260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ebe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600f39260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36506/0 (socket says 172.21.15.42:36506) 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 -- 172.21.15.42:0/2310542272 learned_addr learned my addr 172.21.15.42:0/2310542272 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c99d9b640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ebafe0 0x557600ebe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 -- 172.21.15.42:0/2310542272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ebafe0 msgr2=0x557600ebe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ebafe0 0x557600ebe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 -- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 msgr2=0x557600ebe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ebe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 -- 172.21.15.42:0/2310542272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557600f397f0 con 0x557600ec3db0 2024-03-31T23:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ebe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c9ad9d640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600f39260 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005ab0 tx=0x7f8c9402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bf7f723393cb1a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2310542272 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94049070 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2310542272 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8c940048d0 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.906+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c8400f920 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2310542272 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8c94004ad0 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 10 client.16551 fetch_fsmap learned FSMap version 37 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557600f3ab00 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2310542272 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c8400f920 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2310542272 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8406+0+0 (secure 0 0 0) 0x7f8c94040040 con 0x557600ec3db0 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 10 client.16551 fetch_fsmap finished waiting for FSMap version 37 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 20 client.16551 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600f3d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 4 client.16551 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:20:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557600e2ae30 con 0x557600ed4210 2024-03-31T23:20:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600f3d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8c9a59c640 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600f3d3d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=609a01a3bb5ccf18 server_cookie=cbb43d221d657344 in_seq=0 out_seq=0 2024-03-31T23:20:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:19.907+0000 7f8c81ffb640 10 client.16551 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:20.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: pgmap v67: 129 pgs: 129 active+clean; 169 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 751 op/s 2024-03-31T23:20:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:20:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:20:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:20:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: scrub summary: idle 2024-03-31T23:20:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:active 2024-03-31T23:20:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:19 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.080+0000 7f8c81ffb640 1 -- 172.21.15.42:0/2310542272 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557600e2ae30 con 0x557600ed4210 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.080+0000 7f8c81ffb640 10 client.16551 handle_command_reply: tid=0 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.080+0000 7f8ca3a31740 1 client.16551 shutdown 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 msgr2=0x557600f39260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600f39260 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005ab0 tx=0x7f8c9402bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 shutdown_connections 2024-03-31T23:20:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x557600ed4210 0x557600f3d3d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557600ec3db0 0x557600f39260 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557600ebafe0 0x557600ebe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8c81ffb640 0 client.16551 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 --2- 172.21.15.42:0/2310542272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557600eba6c0 0x557600ebe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 >> 172.21.15.42:0/2310542272 conn(0x557600eb4fe0 msgr2=0x557600ec0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 shutdown_connections 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 1 -- 172.21.15.42:0/2310542272 wait complete. 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca3a31740 20 client.16551 trim_cache size 0 max 16384 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:20:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:20:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:20:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c880a26b0 msgr2=0x7f8c880a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c880a26b0 0x7f8c880a4b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005940 tx=0x7f8c9402de50 comp rx=0 tx=0).stop 2024-03-31T23:20:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 msgr2=0x7f8c9c197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 0x7f8c9c197fb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00eb90 tx=0x7f8c8c00c6a0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 shutdown_connections 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c9c107730 0x7f8c9c19c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c9c1020e0 0x7f8c9c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f8c880a26b0 0x7f8c880a4b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 --2- 172.21.15.42:0/3311714123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9c101720 0x7f8c9c197fb0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.081+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 >> 172.21.15.42:0/3311714123 conn(0x7f8c9c0fd230 msgr2=0x7f8c9c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.082+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 shutdown_connections 2024-03-31T23:20:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:20.082+0000 7f8ca0d79640 1 -- 172.21.15.42:0/3311714123 wait complete. 2024-03-31T23:20:20.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: pgmap v67: 129 pgs: 129 active+clean; 169 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 751 op/s 2024-03-31T23:20:20.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:20:20.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:20:20.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:20:20.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: scrub summary: idle 2024-03-31T23:20:20.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:active 2024-03-31T23:20:20.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:19 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:20.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: pgmap v67: 129 pgs: 129 active+clean; 169 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 751 op/s 2024-03-31T23:20:20.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:20:20.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:20:20.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:20:20.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: scrub summary: idle 2024-03-31T23:20:20.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] up:active 2024-03-31T23:20:20.220 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:19 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:21.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:20 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:active 2024-03-31T23:20:21.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:20 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:21.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:20 smithi094 ceph-mon[36167]: pgmap v68: 129 pgs: 129 active+clean; 169 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 660 op/s 2024-03-31T23:20:21.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:20 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:active 2024-03-31T23:20:21.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:20 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:21.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:20 smithi042 ceph-mon[32380]: pgmap v68: 129 pgs: 129 active+clean; 169 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 660 op/s 2024-03-31T23:20:21.119 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:20 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] up:active 2024-03-31T23:20:21.119 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:20 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:21.119 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:20 smithi188 ceph-mon[36068]: pgmap v68: 129 pgs: 129 active+clean; 169 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 660 op/s 2024-03-31T23:20:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:21 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:22.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:21 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:22.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:21 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:23.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:22 smithi042 ceph-mon[32380]: pgmap v69: 129 pgs: 129 active+clean; 167 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 869 op/s 2024-03-31T23:20:23.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:22 smithi094 ceph-mon[36167]: pgmap v69: 129 pgs: 129 active+clean; 167 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 869 op/s 2024-03-31T23:20:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:22 smithi188 ceph-mon[36068]: pgmap v69: 129 pgs: 129 active+clean; 167 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 869 op/s 2024-03-31T23:20:23.802 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32376]: 2024-03-31T23:20:23.506+0000 7f0106966700 -1 log_channel(cluster) log [ERR] : Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:23 smithi042 ceph-mon[32380]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:23 smithi094 ceph-mon[36167]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:24.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:23 smithi188 ceph-mon[36068]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-31T23:20:25.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:24 smithi042 ceph-mon[32380]: pgmap v70: 129 pgs: 129 active+clean; 167 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 478 op/s 2024-03-31T23:20:25.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:24 smithi094 ceph-mon[36167]: pgmap v70: 129 pgs: 129 active+clean; 167 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 478 op/s 2024-03-31T23:20:25.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:24 smithi188 ceph-mon[36068]: pgmap v70: 129 pgs: 129 active+clean; 167 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 478 op/s 2024-03-31T23:20:27.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:26 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:27.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:26 smithi042 ceph-mon[32380]: pgmap v71: 129 pgs: 129 active+clean; 167 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 509 op/s 2024-03-31T23:20:27.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:26 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:27.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:26 smithi094 ceph-mon[36167]: pgmap v71: 129 pgs: 129 active+clean; 167 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 509 op/s 2024-03-31T23:20:27.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:26 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:27.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:26 smithi188 ceph-mon[36068]: pgmap v71: 129 pgs: 129 active+clean; 167 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 509 op/s 2024-03-31T23:20:29.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:28 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:29.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:28 smithi042 ceph-mon[32380]: pgmap v72: 129 pgs: 129 active+clean; 174 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 494 op/s 2024-03-31T23:20:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:28 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:28 smithi094 ceph-mon[36167]: pgmap v72: 129 pgs: 129 active+clean; 174 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 494 op/s 2024-03-31T23:20:29.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:28 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:29.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:28 smithi188 ceph-mon[36068]: pgmap v72: 129 pgs: 129 active+clean; 174 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 494 op/s 2024-03-31T23:20:29.833 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar xf doc.tar 2024-03-31T23:20:31.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:30 smithi188 ceph-mon[36068]: pgmap v73: 129 pgs: 129 active+clean; 174 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 312 op/s 2024-03-31T23:20:31.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:30 smithi042 ceph-mon[32380]: pgmap v73: 129 pgs: 129 active+clean; 174 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 312 op/s 2024-03-31T23:20:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:30 smithi094 ceph-mon[36167]: pgmap v73: 129 pgs: 129 active+clean; 174 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 312 op/s 2024-03-31T23:20:32.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:31 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:32.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:31 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:32.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:31 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 -- 172.21.15.42:0/2877949072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5081008a0 msgr2=0x7ff508100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 --2- 172.21.15.42:0/2877949072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5081008a0 0x7ff508100d20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009900 tx=0x7ff4f802bc30 comp rx=0 tx=0).stop 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 -- 172.21.15.42:0/2877949072 shutdown_connections 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 --2- 172.21.15.42:0/2877949072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff508101260 0x7ff50810d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 --2- 172.21.15.42:0/2877949072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5081008a0 0x7ff508100d20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 --2- 172.21.15.42:0/2877949072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5081055f0 0x7ff5081059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 -- 172.21.15.42:0/2877949072 >> 172.21.15.42:0/2877949072 conn(0x7ff5080774a0 msgr2=0x7ff5080778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 -- 172.21.15.42:0/2877949072 shutdown_connections 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.174+0000 7ff50fc72640 1 -- 172.21.15.42:0/2877949072 wait complete. 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 Processor -- start 2024-03-31T23:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 -- start start 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5081008a0 0x7ff508198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 0x7ff508198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5081055f0 0x7ff50819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff508111d00 con 0x7ff508101260 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff508111b80 con 0x7ff5081055f0 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50fc72640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff508111e80 con 0x7ff5081008a0 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 0x7ff508198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 0x7ff508198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55412/0 (socket says 172.21.15.42:55412) 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 -- 172.21.15.42:0/544180216 learned_addr learned my addr 172.21.15.42:0/544180216 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50e20f640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5081055f0 0x7ff50819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50da0e640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5081008a0 0x7ff508198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 -- 172.21.15.42:0/544180216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5081008a0 msgr2=0x7ff508198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5081008a0 0x7ff508198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 -- 172.21.15.42:0/544180216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5081055f0 msgr2=0x7ff50819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5081055f0 0x7ff50819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 -- 172.21.15.42:0/544180216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50819d0c0 con 0x7ff508101260 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.175+0000 7ff50d20d640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 0x7ff508198660 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005940 tx=0x7ff4f802dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.176+0000 7ff4feffd640 1 -- 172.21.15.42:0/544180216 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8043020 con 0x7ff508101260 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.176+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50819d350 con 0x7ff508101260 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.176+0000 7ff4feffd640 1 -- 172.21.15.42:0/544180216 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4f8004250 con 0x7ff508101260 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.176+0000 7ff4feffd640 1 -- 172.21.15.42:0/544180216 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8003a10 con 0x7ff508101260 2024-03-31T23:20:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.176+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081a4c40 con 0x7ff508101260 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.178+0000 7ff4feffd640 1 -- 172.21.15.42:0/544180216 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7ff4f8046020 con 0x7ff508101260 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.178+0000 7ff512850740 1 Processor -- start 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 -- start start 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff4feffd640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4f40a26b0 0x7ff4f40a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873374aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50e20f640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4f40a26b0 0x7ff4f40a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff4feffd640 1 -- 172.21.15.42:0/544180216 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff4f80f0d60 con 0x7ff508101260 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56487337ddb0 0x5648733801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5648732d78f0 con 0x5648733746c0 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5648732808d0 con 0x564873374fe0 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff512850740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5648732d3990 con 0x56487337ddb0 2024-03-31T23:20:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873374aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873374aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55420/0 (socket says 172.21.15.42:55420) 2024-03-31T23:20:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 -- 172.21.15.42:0/207823743 learned_addr learned my addr 172.21.15.42:0/207823743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50d20d640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50e20f640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56487337ddb0 0x5648733801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 -- 172.21.15.42:0/207823743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56487337ddb0 msgr2=0x5648733801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56487337ddb0 0x5648733801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 -- 172.21.15.42:0/207823743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 msgr2=0x56487337d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 -- 172.21.15.42:0/207823743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564872fec210 con 0x5648733746c0 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50e20f640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56487337ddb0 0x5648733801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50d20d640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50e20f640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4f40a26b0 0x7ff4f40a4b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff500005fd0 tx=0x7ff500011810 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.179+0000 7ff50da0e640 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873374aa0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff504009cf0 tx=0x7ff504011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa53f544d2cb07db server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff4f3fff640 1 -- 172.21.15.42:0/207823743 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504004230 con 0x5648733746c0 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff4f3fff640 1 -- 172.21.15.42:0/207823743 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5040043d0 con 0x5648733746c0 2024-03-31T23:20:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff4f3fff640 1 -- 172.21.15.42:0/207823743 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040199f0 con 0x5648733746c0 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 -- 172.21.15.42:0/207823743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 msgr2=0x564873374aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873374aa0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff504009cf0 tx=0x7ff504011810 comp rx=0 tx=0).stop 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 -- 172.21.15.42:0/207823743 shutdown_connections 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56487337ddb0 0x5648733801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 --2- 172.21.15.42:0/207823743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873374aa0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.180+0000 7ff512850740 1 -- 172.21.15.42:0/207823743 >> 172.21.15.42:0/207823743 conn(0x56487336efe0 msgr2=0x56487336f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 -- 172.21.15.42:0/207823743 shutdown_connections 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 -- 172.21.15.42:0/207823743 wait complete. 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 -- start start 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 Processor -- start 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x56487337ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x56487337b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5648733809e0 con 0x56487337ddb0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x564873275f80 con 0x564873374fe0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564873380b60 con 0x5648733746c0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff512850740 10 client.0 _ll_register_callbacks cb 0x5648732ce290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x56487337ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff50e20f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x56487337b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff50d20d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x56487337ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:56562/0 (socket says 172.21.15.42:56562) 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.181+0000 7ff50da0e640 1 -- 172.21.15.42:0/2923223832 learned_addr learned my addr 172.21.15.42:0/2923223832 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50e20f640 1 -- 172.21.15.42:0/2923223832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 msgr2=0x56487337ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50e20f640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x56487337ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50e20f640 1 -- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 msgr2=0x56487337b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50e20f640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50e20f640 1 -- 172.21.15.42:0/2923223832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648730b8620 con 0x56487337ddb0 2024-03-31T23:20:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50da0e640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x56487337ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50d20d640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff50e20f640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x56487337b860 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x564873370170 tx=0x7ff500004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c153f1bfd93127 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff4f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff4f17fa640 1 -- 172.21.15.42:0/2923223832 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500022070 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff4f17fa640 1 -- 172.21.15.42:0/2923223832 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff50000eb00 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5040043d0 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff4f17fa640 1 -- 172.21.15.42:0/2923223832 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff500030050 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff512850740 10 client.16563 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.182+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56487338c880 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff4f17fa640 1 -- 172.21.15.42:0/2923223832 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5040043d0 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff4f17fa640 1 -- 172.21.15.42:0/2923223832 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7ff50001d4b0 con 0x56487337ddb0 2024-03-31T23:20:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff512850740 10 client.16563 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff512850740 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff512850740 20 client.16563 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff512850740 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56487338de10 0x564873390270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff512850740 4 client.16563 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648732eb120 con 0x56487338de10 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff50da0e640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56487338de10 0x564873390270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff50da0e640 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56487338de10 0x564873390270 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad07d8a50823cd5f server_cookie=35aa86aec63735ef in_seq=0 out_seq=0 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.183+0000 7ff4f17fa640 10 client.16563 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff4f17fa640 1 -- 172.21.15.42:0/2923223832 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5648732eb120 con 0x56487338de10 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff4f17fa640 10 client.16563 handle_command_reply: tid=0 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 client.16563 shutdown 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 msgr2=0x56487337b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x56487337b860 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x564873370170 tx=0x7ff500004ab0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 shutdown_connections 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56487338de10 0x564873390270 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x56487337b860 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x56487337b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff4f17fa640 0 client.16563 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 --2- 172.21.15.42:0/2923223832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x56487337ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 >> 172.21.15.42:0/2923223832 conn(0x56487336efe0 msgr2=0x564873370d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 shutdown_connections 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 1 -- 172.21.15.42:0/2923223832 wait complete. 2024-03-31T23:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.185+0000 7ff512850740 20 client.16563 trim_cache size 0 max 16384 2024-03-31T23:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 Processor -- start 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 -- start start 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873389780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564873374fe0 0x56487337cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56487337ddb0 0x564873395b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b0d00 con 0x5648733746c0 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b2b10 con 0x56487337ddb0 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff512850740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b1490 con 0x564873374fe0 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873389780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873389780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55426/0 (socket says 172.21.15.42:55426) 2024-03-31T23:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff50da0e640 1 -- 172.21.15.42:0/2346082612 learned_addr learned my addr 172.21.15.42:0/2346082612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff50d20d640 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564873374fe0 0x56487337cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.200+0000 7ff50e20f640 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56487337ddb0 0x564873395b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff50da0e640 1 -- 172.21.15.42:0/2346082612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564873374fe0 msgr2=0x56487337cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff50da0e640 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564873374fe0 0x56487337cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff50da0e640 1 -- 172.21.15.42:0/2346082612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56487337ddb0 msgr2=0x564873395b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff50da0e640 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56487337ddb0 0x564873395b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff50da0e640 1 -- 172.21.15.42:0/2346082612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648733801a0 con 0x5648733746c0 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff50da0e640 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873389780 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff504009c40 tx=0x7ff504019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27a29845a923630 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff4f37fe640 1 -- 172.21.15.42:0/2346082612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504031070 con 0x5648733746c0 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff4f37fe640 1 -- 172.21.15.42:0/2346082612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff50402b2d0 con 0x5648733746c0 2024-03-31T23:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.201+0000 7ff4f37fe640 1 -- 172.21.15.42:0/2346082612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040053a0 con 0x5648733746c0 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- 172.21.15.42:0/2346082612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 msgr2=0x564873389780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873389780 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff504009c40 tx=0x7ff504019670 comp rx=0 tx=0).stop 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- 172.21.15.42:0/2346082612 shutdown_connections 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56487337ddb0 0x564873395b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564873374fe0 0x56487337cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- 172.21.15.42:0/2346082612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5648733746c0 0x564873389780 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- 172.21.15.42:0/2346082612 >> 172.21.15.42:0/2346082612 conn(0x56487336efe0 msgr2=0x56487337c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- 172.21.15.42:0/2346082612 shutdown_connections 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- 172.21.15.42:0/2346082612 wait complete. 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- start start 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 Processor -- start 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x5648733779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x564873377f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x564873378470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b2380 con 0x56487337ddb0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b1bf0 con 0x564873374fe0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.202+0000 7ff512850740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081aecc0 con 0x5648733746c0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff512850740 10 client.0 _ll_register_callbacks cb 0x7ff500009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50e20f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x564873378470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x5648733779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50d20d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x564873377f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x5648733779f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:56578/0 (socket says 172.21.15.42:56578) 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 -- 172.21.15.42:0/913141155 learned_addr learned my addr 172.21.15.42:0/913141155 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 -- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 msgr2=0x564873377f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x564873377f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 -- 172.21.15.42:0/913141155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 msgr2=0x564873378470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x564873378470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 -- 172.21.15.42:0/913141155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648733f3280 con 0x5648733746c0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff50da0e640 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x5648733779f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff504019590 tx=0x7ff504005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88d3eccbffa2ad1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff4f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff4f17fa640 1 -- 172.21.15.42:0/913141155 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50403a060 con 0x5648733746c0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff4f17fa640 1 -- 172.21.15.42:0/913141155 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7ff504005330 con 0x5648733746c0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.203+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff50402b2d0 con 0x5648733746c0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff4f17fa640 1 -- 172.21.15.42:0/913141155 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff504031070 con 0x5648733746c0 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 10 client.26329 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5648733f4590 con 0x5648733746c0 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff4f17fa640 1 -- 172.21.15.42:0/913141155 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff50402b2d0 con 0x5648733746c0 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff4f17fa640 1 -- 172.21.15.42:0/913141155 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7ff504003890 con 0x5648733746c0 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 10 client.26329 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 10 client.26329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 20 client.26329 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5648733f4af0 0x5648733f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 4 client.26329 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648732e4e30 con 0x5648733f4af0 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff50d20d640 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5648733f4af0 0x5648733f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff50d20d640 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5648733f4af0 0x5648733f6f10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fd0a515f6e028d server_cookie=675278fd11c265 in_seq=0 out_seq=0 2024-03-31T23:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:33.204+0000 7ff4f17fa640 10 client.26329 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:33.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:32 smithi188 ceph-mon[36068]: pgmap v74: 129 pgs: 129 active+clean; 171 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 442 op/s 2024-03-31T23:20:33.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:32 smithi042 ceph-mon[32380]: pgmap v74: 129 pgs: 129 active+clean; 171 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 442 op/s 2024-03-31T23:20:33.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:32 smithi094 ceph-mon[36167]: pgmap v74: 129 pgs: 129 active+clean; 171 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 442 op/s 2024-03-31T23:20:34.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:33 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:34.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:33 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:34.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:33 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff4f17fa640 1 -- 172.21.15.42:0/913141155 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648732e4e30 con 0x5648733f4af0 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff4f17fa640 10 client.26329 handle_command_reply: tid=0 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff512850740 1 client.26329 shutdown 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 msgr2=0x5648733779f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff512850740 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x5648733779f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff504019590 tx=0x7ff504005dc0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 shutdown_connections 2024-03-31T23:20:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.943+0000 7ff512850740 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x5648733f4af0 0x5648733f6f10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56487337ddb0 0x564873378470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff4f17fa640 0 client.26329 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564873374fe0 0x564873377f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 1 --2- 172.21.15.42:0/913141155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5648733746c0 0x5648733779f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 >> 172.21.15.42:0/913141155 conn(0x56487336efe0 msgr2=0x56487336df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 shutdown_connections 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 1 -- 172.21.15.42:0/913141155 wait complete. 2024-03-31T23:20:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.944+0000 7ff512850740 20 client.26329 trim_cache size 0 max 16384 2024-03-31T23:20:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:20:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:20:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:20:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4f40a26b0 msgr2=0x7ff4f40a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4f40a26b0 0x7ff4f40a4b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff500005fd0 tx=0x7ff500011810 comp rx=0 tx=0).stop 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 msgr2=0x7ff508198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 0x7ff508198660 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005940 tx=0x7ff4f802dc80 comp rx=0 tx=0).stop 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 shutdown_connections 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5081055f0 0x7ff50819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7ff4f40a26b0 0x7ff4f40a4b70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff508101260 0x7ff508198660 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 --2- 172.21.15.42:0/544180216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5081008a0 0x7ff508198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.946+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 >> 172.21.15.42:0/544180216 conn(0x7ff5080774a0 msgr2=0x7ff5080ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.947+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 shutdown_connections 2024-03-31T23:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:34.947+0000 7ff50fc72640 1 -- 172.21.15.42:0/544180216 wait complete. 2024-03-31T23:20:35.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:34 smithi042 ceph-mon[32380]: pgmap v75: 129 pgs: 129 active+clean; 171 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 234 op/s 2024-03-31T23:20:35.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:34 smithi094 ceph-mon[36167]: pgmap v75: 129 pgs: 129 active+clean; 171 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 234 op/s 2024-03-31T23:20:35.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:34 smithi188 ceph-mon[36068]: pgmap v75: 129 pgs: 129 active+clean; 171 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 234 op/s 2024-03-31T23:20:37.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:36 smithi042 ceph-mon[32380]: pgmap v76: 129 pgs: 129 active+clean; 176 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 607 op/s 2024-03-31T23:20:37.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:36 smithi094 ceph-mon[36167]: pgmap v76: 129 pgs: 129 active+clean; 176 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 607 op/s 2024-03-31T23:20:37.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:36 smithi188 ceph-mon[36068]: pgmap v76: 129 pgs: 129 active+clean; 176 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 607 op/s 2024-03-31T23:20:39.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:38 smithi042 ceph-mon[32380]: pgmap v77: 129 pgs: 129 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 973 op/s 2024-03-31T23:20:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:38 smithi094 ceph-mon[36167]: pgmap v77: 129 pgs: 129 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 973 op/s 2024-03-31T23:20:39.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:38 smithi188 ceph-mon[36068]: pgmap v77: 129 pgs: 129 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 973 op/s 2024-03-31T23:20:41.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:40 smithi042 ceph-mon[32380]: pgmap v78: 129 pgs: 129 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.9 MiB/s wr, 900 op/s 2024-03-31T23:20:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:40 smithi094 ceph-mon[36167]: pgmap v78: 129 pgs: 129 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.9 MiB/s wr, 900 op/s 2024-03-31T23:20:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:40 smithi188 ceph-mon[36068]: pgmap v78: 129 pgs: 129 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.9 MiB/s wr, 900 op/s 2024-03-31T23:20:43.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-31T23:20:43.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-31T23:20:43.186 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2024-03-31T23:20:43.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:42 smithi042 ceph-mon[32380]: pgmap v79: 129 pgs: 129 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 930 op/s 2024-03-31T23:20:43.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.359+0000 7f9b259dd640 1 -- 172.21.15.42:0/3456848846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2010ff70 msgr2=0x7f9b2010da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.359+0000 7f9b259dd640 1 --2- 172.21.15.42:0/3456848846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2010ff70 0x7f9b2010da60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b1001a910 tx=0x7f9b1003cca0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.360+0000 7f9b259dd640 1 -- 172.21.15.42:0/3456848846 shutdown_connections 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.360+0000 7f9b259dd640 1 --2- 172.21.15.42:0/3456848846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b2011af30 0x7f9b2011d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.360+0000 7f9b259dd640 1 --2- 172.21.15.42:0/3456848846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b2010dfa0 0x7f9b2010e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.360+0000 7f9b259dd640 1 --2- 172.21.15.42:0/3456848846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2010ff70 0x7f9b2010da60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.360+0000 7f9b259dd640 1 -- 172.21.15.42:0/3456848846 >> 172.21.15.42:0/3456848846 conn(0x7f9b2006c830 msgr2=0x7f9b2006cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.362+0000 7f9b259dd640 1 -- 172.21.15.42:0/3456848846 shutdown_connections 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.362+0000 7f9b259dd640 1 -- 172.21.15.42:0/3456848846 wait complete. 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.363+0000 7f9b259dd640 1 Processor -- start 2024-03-31T23:20:43.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.363+0000 7f9b259dd640 1 -- start start 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.364+0000 7f9b259dd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b2010dfa0 0x7f9b2011a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.364+0000 7f9b259dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b2010ff70 0x7f9b20116880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.364+0000 7f9b259dd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 0x7f9b20116dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.364+0000 7f9b259dd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b201132d0 con 0x7f9b2010ff70 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.364+0000 7f9b259dd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20113150 con 0x7f9b2010dfa0 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.364+0000 7f9b259dd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20113450 con 0x7f9b2011af30 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.365+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 0x7f9b20116dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.365+0000 7f9b1effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b2010dfa0 0x7f9b2011a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.365+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 0x7f9b20116dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:33702/0 (socket says 172.21.15.42:33702) 2024-03-31T23:20:43.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.365+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/2086653273 learned_addr learned my addr 172.21.15.42:0/2086653273 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:43.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.366+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/2086653273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b2010dfa0 msgr2=0x7f9b2011a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.366+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b2010dfa0 0x7f9b2011a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.366+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b2010ff70 msgr2=0x7f9b20116880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T23:20:43.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.366+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b2010ff70 0x7f9b20116880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.366+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/2086653273 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b20117650 con 0x7f9b2011af30 2024-03-31T23:20:43.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.366+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 0x7f9b20116dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b970 tx=0x7f9b1800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.369+0000 7f9b249db640 1 -- 172.21.15.42:0/2086653273 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18019070 con 0x7f9b2011af30 2024-03-31T23:20:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.369+0000 7f9b249db640 1 -- 172.21.15.42:0/2086653273 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b1800cb40 con 0x7f9b2011af30 2024-03-31T23:20:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.369+0000 7f9b249db640 1 -- 172.21.15.42:0/2086653273 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18007730 con 0x7f9b2011af30 2024-03-31T23:20:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.369+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b201aad00 con 0x7f9b2011af30 2024-03-31T23:20:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.369+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201ab220 con 0x7f9b2011af30 2024-03-31T23:20:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.377+0000 7f9b285b7740 1 Processor -- start 2024-03-31T23:20:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.379+0000 7f9b249db640 1 -- 172.21.15.42:0/2086653273 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f9b1801c070 con 0x7f9b2011af30 2024-03-31T23:20:43.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.383+0000 7f9b249db640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9b080a27e0 0x7f9b080a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.383+0000 7f9b249db640 1 -- 172.21.15.42:0/2086653273 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f9b180ce120 con 0x7f9b2011af30 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.384+0000 7f9b285b7740 1 -- start start 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x56398761e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987627250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563987627790 0x563987629b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b285b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563987582180 con 0x56398761ebb0 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b285b7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56398752ab70 con 0x563987627790 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b285b7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56398757e220 con 0x56398761e290 2024-03-31T23:20:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9b080a27e0 0x7f9b080a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987627250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987627250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60758/0 (socket says 172.21.15.42:60758) 2024-03-31T23:20:43.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.385+0000 7f9b1e7fc640 1 -- 172.21.15.42:0/1204999682 learned_addr learned my addr 172.21.15.42:0/1204999682 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:43.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1effd640 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x56398761e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 -- 172.21.15.42:0/1204999682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 msgr2=0x56398761e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:43.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x56398761e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 -- 172.21.15.42:0/1204999682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563987627790 msgr2=0x563987629b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-31T23:20:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563987627790 0x563987629b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 -- 172.21.15.42:0/1204999682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56398753e7c0 con 0x56398761ebb0 2024-03-31T23:20:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9b080a27e0 0x7f9b080a4ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400bfd0 tx=0x7f9b1400b780 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.386+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987627250 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9b14014fd0 tx=0x7f9b14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad09b1f9fb0b202 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.388+0000 7f9b05ffb640 1 -- 172.21.15.42:0/1204999682 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14017470 con 0x56398761ebb0 2024-03-31T23:20:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.388+0000 7f9b05ffb640 1 -- 172.21.15.42:0/1204999682 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b14017b10 con 0x56398761ebb0 2024-03-31T23:20:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.389+0000 7f9b285b7740 1 -- 172.21.15.42:0/1204999682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 msgr2=0x563987627250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.389+0000 7f9b05ffb640 1 -- 172.21.15.42:0/1204999682 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14017470 con 0x56398761ebb0 2024-03-31T23:20:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.389+0000 7f9b285b7740 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987627250 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9b14014fd0 tx=0x7f9b14017000 comp rx=0 tx=0).stop 2024-03-31T23:20:43.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.392+0000 7f9b285b7740 1 -- 172.21.15.42:0/1204999682 shutdown_connections 2024-03-31T23:20:43.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.392+0000 7f9b285b7740 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563987627790 0x563987629b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.392+0000 7f9b285b7740 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987627250 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.392+0000 7f9b285b7740 1 --2- 172.21.15.42:0/1204999682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x56398761e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.392+0000 7f9b285b7740 1 -- 172.21.15.42:0/1204999682 >> 172.21.15.42:0/1204999682 conn(0x5639876189c0 msgr2=0x563987618da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.394+0000 7f9b285b7740 1 -- 172.21.15.42:0/1204999682 shutdown_connections 2024-03-31T23:20:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.394+0000 7f9b285b7740 1 -- 172.21.15.42:0/1204999682 wait complete. 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.394+0000 7f9b285b7740 1 -- start start 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 Processor -- start 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987624760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987624ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x5639876251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56398762a5c0 con 0x563987627790 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5639875204a0 con 0x56398761ebb0 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56398762a740 con 0x56398761e290 2024-03-31T23:20:43.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.395+0000 7f9b285b7740 10 client.0 _ll_register_callbacks cb 0x563987523d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:43.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x5639876251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x5639876251e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60766/0 (socket says 172.21.15.42:60766) 2024-03-31T23:20:43.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3586671044 learned_addr learned my addr 172.21.15.42:0/3586671044 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:43.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987624760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3586671044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 msgr2=0x563987624760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987624760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 msgr2=0x563987624ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987624ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.396+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3586671044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639873607d0 con 0x563987627790 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.397+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x5639876251e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b940 tx=0x7f9b1809a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d119a2248ff7e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.397+0000 7f9afeffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.399+0000 7f9afeffd640 1 -- 172.21.15.42:0/3586671044 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b180b3060 con 0x563987627790 2024-03-31T23:20:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.399+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b14017b10 con 0x563987627790 2024-03-31T23:20:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.400+0000 7f9afeffd640 1 -- 172.21.15.42:0/3586671044 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f9b180b3200 con 0x563987627790 2024-03-31T23:20:43.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.401+0000 7f9afeffd640 1 -- 172.21.15.42:0/3586671044 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9b180a3010 con 0x563987627790 2024-03-31T23:20:43.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.405+0000 7f9b285b7740 10 client.16575 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:43.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.405+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5639872963f0 con 0x563987627790 2024-03-31T23:20:43.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.406+0000 7f9afeffd640 1 -- 172.21.15.42:0/3586671044 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b14017b10 con 0x563987627790 2024-03-31T23:20:43.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.406+0000 7f9afeffd640 1 -- 172.21.15.42:0/3586671044 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f9b18099b00 con 0x563987627790 2024-03-31T23:20:43.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.407+0000 7f9b285b7740 10 client.16575 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:43.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.407+0000 7f9b285b7740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:43.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.407+0000 7f9b285b7740 20 client.16575 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:43.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.407+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x563987637c00 0x563987639ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.407+0000 7f9b285b7740 4 client.16575 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:43.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.407+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56398758f6c0 con 0x563987637c00 2024-03-31T23:20:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.413+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x563987637c00 0x563987639ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.416+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x563987637c00 0x563987639ff0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bfdf3c2ab26b4bd server_cookie=17cb46ae65ee1400 in_seq=0 out_seq=0 2024-03-31T23:20:43.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.418+0000 7f9afeffd640 10 client.16575 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:43.421 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:42 smithi094 ceph-mon[36167]: pgmap v79: 129 pgs: 129 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 930 op/s 2024-03-31T23:20:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.422+0000 7f9afeffd640 1 -- 172.21.15.42:0/3586671044 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56398758f6c0 con 0x563987637c00 2024-03-31T23:20:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.423+0000 7f9afeffd640 10 client.16575 handle_command_reply: tid=0 2024-03-31T23:20:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.425+0000 7f9b285b7740 1 client.16575 shutdown 2024-03-31T23:20:43.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.431+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 msgr2=0x5639876251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.431+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x5639876251e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b940 tx=0x7f9b1809a6b0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 shutdown_connections 2024-03-31T23:20:43.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x563987637c00 0x563987639ff0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x5639876251e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987624ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3586671044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987624760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 >> 172.21.15.42:0/3586671044 conn(0x5639876189c0 msgr2=0x563987617c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.433+0000 7f9afeffd640 0 client.16575 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:43.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.436+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 shutdown_connections 2024-03-31T23:20:43.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.437+0000 7f9b285b7740 1 -- 172.21.15.42:0/3586671044 wait complete. 2024-03-31T23:20:43.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.439+0000 7f9b285b7740 20 client.16575 trim_cache size 0 max 16384 2024-03-31T23:20:43.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:42 smithi188 ceph-mon[36068]: pgmap v79: 129 pgs: 129 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 930 op/s 2024-03-31T23:20:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.481+0000 7f9b285b7740 1 Processor -- start 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 -- start start 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987633440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987623070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x563987625000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c00ff00 con 0x563987627790 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c011d10 con 0x56398761ebb0 2024-03-31T23:20:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.483+0000 7f9b285b7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c010690 con 0x56398761e290 2024-03-31T23:20:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.484+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x563987625000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.484+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x563987625000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60780/0 (socket says 172.21.15.42:60780) 2024-03-31T23:20:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.484+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3788963498 learned_addr learned my addr 172.21.15.42:0/3788963498 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.485+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987623070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.485+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987633440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.485+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3788963498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 msgr2=0x563987633440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.485+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987633440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.485+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3788963498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 msgr2=0x563987623070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.485+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987623070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.486+0000 7f9b1f7fe640 1 -- 172.21.15.42:0/3788963498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563987623750 con 0x563987627790 2024-03-31T23:20:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.486+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x563987625000 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9b1809a640 tx=0x7f9b18014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2b88e641a60140 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.487+0000 7f9b057fa640 1 -- 172.21.15.42:0/3788963498 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b180b3040 con 0x563987627790 2024-03-31T23:20:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.487+0000 7f9b057fa640 1 -- 172.21.15.42:0/3788963498 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b180cb740 con 0x563987627790 2024-03-31T23:20:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.487+0000 7f9b057fa640 1 -- 172.21.15.42:0/3788963498 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18099b00 con 0x563987627790 2024-03-31T23:20:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.489+0000 7f9b285b7740 1 -- 172.21.15.42:0/3788963498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 msgr2=0x563987625000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.489+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x563987625000 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9b1809a640 tx=0x7f9b18014f20 comp rx=0 tx=0).stop 2024-03-31T23:20:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.491+0000 7f9b285b7740 1 -- 172.21.15.42:0/3788963498 shutdown_connections 2024-03-31T23:20:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.491+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563987627790 0x563987625000 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.492+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761ebb0 0x563987623070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.492+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3788963498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56398761e290 0x563987633440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.492+0000 7f9b285b7740 1 -- 172.21.15.42:0/3788963498 >> 172.21.15.42:0/3788963498 conn(0x5639876189c0 msgr2=0x563987617c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.493+0000 7f9b285b7740 1 -- 172.21.15.42:0/3788963498 shutdown_connections 2024-03-31T23:20:43.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.493+0000 7f9b285b7740 1 -- 172.21.15.42:0/3788963498 wait complete. 2024-03-31T23:20:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.494+0000 7f9b285b7740 1 -- start start 2024-03-31T23:20:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.494+0000 7f9b285b7740 1 Processor -- start 2024-03-31T23:20:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761e290 0x563987621a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987621f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563987627790 0x56398769cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c011580 con 0x56398761ebb0 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c010df0 con 0x56398761e290 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c00dec0 con 0x563987627790 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b285b7740 10 client.0 _ll_register_callbacks cb 0x7f9b18096290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987621f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987621f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60782/0 (socket says 172.21.15.42:60782) 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b1e7fc640 1 -- 172.21.15.42:0/3584341005 learned_addr learned my addr 172.21.15.42:0/3584341005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761e290 0x563987621a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.496+0000 7f9b1f7fe640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563987627790 0x56398769cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.497+0000 7f9b1effd640 1 -- 172.21.15.42:0/3584341005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563987627790 msgr2=0x56398769cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.497+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563987627790 0x56398769cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.497+0000 7f9b1effd640 1 -- 172.21.15.42:0/3584341005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 msgr2=0x563987621f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.497+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987621f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.497+0000 7f9b1effd640 1 -- 172.21.15.42:0/3584341005 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56398761e9e0 con 0x56398761e290 2024-03-31T23:20:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.497+0000 7f9b1effd640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761e290 0x563987621a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b10000c00 tx=0x7f9b10005d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3f89b459d6f151 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.498+0000 7f9afeffd640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:20:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.498+0000 7f9afeffd640 1 -- 172.21.15.42:0/3584341005 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1005d030 con 0x56398761e290 2024-03-31T23:20:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.498+0000 7f9afeffd640 1 -- 172.21.15.42:0/3584341005 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f9b1004a040 con 0x56398761e290 2024-03-31T23:20:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.499+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b180cb740 con 0x56398761e290 2024-03-31T23:20:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.500+0000 7f9afeffd640 1 -- 172.21.15.42:0/3584341005 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9b10059aa0 con 0x56398761e290 2024-03-31T23:20:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.500+0000 7f9b285b7740 10 client.26393 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.500+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5639872560f0 con 0x56398761e290 2024-03-31T23:20:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.500+0000 7f9afeffd640 1 -- 172.21.15.42:0/3584341005 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b180cb740 con 0x56398761e290 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9afeffd640 1 -- 172.21.15.42:0/3584341005 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f9b1003d8d0 con 0x56398761e290 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9b285b7740 10 client.26393 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9b285b7740 10 client.26393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9b285b7740 20 client.26393 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56398769eb70 0x5639876a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9b285b7740 4 client.26393 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-31T23:20:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.502+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563987589a10 con 0x56398769eb70 2024-03-31T23:20:43.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.511+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56398769eb70 0x5639876a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.511+0000 7f9b1e7fc640 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56398769eb70 0x5639876a0f90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0833efd8f58efa server_cookie=74ed395530eb1366 in_seq=0 out_seq=0 2024-03-31T23:20:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.512+0000 7f9afeffd640 10 client.26393 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.517+0000 7f9afeffd640 1 -- 172.21.15.42:0/3584341005 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563987589a10 con 0x56398769eb70 2024-03-31T23:20:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.517+0000 7f9afeffd640 10 client.26393 handle_command_reply: tid=0 2024-03-31T23:20:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.517+0000 7f9b285b7740 1 client.26393 shutdown 2024-03-31T23:20:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.518+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761e290 msgr2=0x563987621a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.518+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761e290 0x563987621a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b10000c00 tx=0x7f9b10005d60 comp rx=0 tx=0).stop 2024-03-31T23:20:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 shutdown_connections 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x56398769eb70 0x5639876a0f90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563987627790 0x56398769cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56398761ebb0 0x563987621f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 --2- 172.21.15.42:0/3584341005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56398761e290 0x563987621a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 >> 172.21.15.42:0/3584341005 conn(0x5639876189c0 msgr2=0x563987617c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9afeffd640 0 client.26393 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.519+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 shutdown_connections 2024-03-31T23:20:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.520+0000 7f9b285b7740 1 -- 172.21.15.42:0/3584341005 wait complete. 2024-03-31T23:20:43.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.520+0000 7f9b285b7740 20 client.26393 trim_cache size 0 max 16384 2024-03-31T23:20:43.521 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:20:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-03-31T23:20:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-03-31T23:20:43.522 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.521+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9b080a27e0 msgr2=0x7f9b080a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.521+0000 7f9b259dd640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9b080a27e0 0x7f9b080a4ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400bfd0 tx=0x7f9b1400b780 comp rx=0 tx=0).stop 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.521+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 msgr2=0x7f9b20116dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.521+0000 7f9b259dd640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 0x7f9b20116dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b970 tx=0x7f9b1800be30 comp rx=0 tx=0).stop 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 shutdown_connections 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b2011af30 0x7f9b20116dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9b080a27e0 0x7f9b080a4ca0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400bfd0 tx=0x7f9b1400b780 comp rx=0 tx=0).stop 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b2010ff70 0x7f9b20116880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 --2- 172.21.15.42:0/2086653273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b2010dfa0 0x7f9b2011a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 >> 172.21.15.42:0/2086653273 conn(0x7f9b2006c830 msgr2=0x7f9b2011c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 shutdown_connections 2024-03-31T23:20:43.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.522+0000 7f9b259dd640 1 -- 172.21.15.42:0/2086653273 wait complete. 2024-03-31T23:20:43.541 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-31T23:20:43.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:20:43.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.700+0000 7f68f5313640 1 -- 172.21.15.42:0/2795310125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0100650 msgr2=0x7f68f0100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.700+0000 7f68f5313640 1 --2- 172.21.15.42:0/2795310125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0100650 0x7f68f0100ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009930 tx=0x7f68e402bc20 comp rx=0 tx=0).stop 2024-03-31T23:20:43.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 -- 172.21.15.42:0/2795310125 shutdown_connections 2024-03-31T23:20:43.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 --2- 172.21.15.42:0/2795310125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0101010 0x7f68f010d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 --2- 172.21.15.42:0/2795310125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0100650 0x7f68f0100ad0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 --2- 172.21.15.42:0/2795310125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68f0106660 0x7f68f0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 -- 172.21.15.42:0/2795310125 >> 172.21.15.42:0/2795310125 conn(0x7f68f0077750 msgr2=0x7f68f0077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 -- 172.21.15.42:0/2795310125 shutdown_connections 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 -- 172.21.15.42:0/2795310125 wait complete. 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 Processor -- start 2024-03-31T23:20:43.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.701+0000 7f68f5313640 1 -- start start 2024-03-31T23:20:43.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68f5313640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68f0100650 0x7f68f0197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68f5313640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0101010 0x7f68f0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68f5313640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 0x7f68f019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68f5313640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0110b90 con 0x7f68f0106660 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68f5313640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0110a10 con 0x7f68f0100650 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68f5313640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0110d10 con 0x7f68f0101010 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 0x7f68f019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 0x7f68f019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39192/0 (socket says 172.21.15.42:39192) 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 -- 172.21.15.42:0/743944929 learned_addr learned my addr 172.21.15.42:0/743944929 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ee7fc640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0101010 0x7f68f0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 -- 172.21.15.42:0/743944929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0101010 msgr2=0x7f68f0197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0101010 0x7f68f0197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 -- 172.21.15.42:0/743944929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68f0100650 msgr2=0x7f68f0197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68f0100650 0x7f68f0197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 -- 172.21.15.42:0/743944929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f019c000 con 0x7f68f0106660 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.702+0000 7f68ef7fe640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 0x7f68f019b8d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f68e800eca0 tx=0x7f68e800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.703+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8004b20 con 0x7f68f0106660 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.703+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f019c2f0 con 0x7f68f0106660 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.703+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68e8004cc0 con 0x7f68f0106660 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.703+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8017630 con 0x7f68f0106660 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.703+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f00688b0 con 0x7f68f0106660 2024-03-31T23:20:43.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.704+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f0068540 con 0x7f68f0106660 2024-03-31T23:20:43.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.706+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f68e8005020 con 0x7f68f0106660 2024-03-31T23:20:43.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.706+0000 7f68d7fff640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f68d80a2610 0x7f68d80a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:43.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.707+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f68e80d1240 con 0x7f68f0106660 2024-03-31T23:20:43.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.707+0000 7f68eeffd640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f68d80a2610 0x7f68d80a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:43.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.707+0000 7f68eeffd640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f68d80a2610 0x7f68d80a4ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005fd0 tx=0x7f68e0005f40 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:43.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.711+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f68e809dd10 con 0x7f68f0106660 2024-03-31T23:20:43.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.935+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68f00692d0 con 0x7f68f0106660 2024-03-31T23:20:43.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.936+0000 7f68d7fff640 1 -- 172.21.15.42:0/743944929 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11954 (secure 0 0 0) 0x7f68e809d610 con 0x7f68f0106660 2024-03-31T23:20:43.937 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:20:43.937 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:20:32.240468+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":78,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":77,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":77,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":76,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24464,24442,24454]},"id":1}]} 2024-03-31T23:20:43.938 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 42 2024-03-31T23:20:43.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f68d80a2610 msgr2=0x7f68d80a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f68d80a2610 0x7f68d80a4ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005fd0 tx=0x7f68e0005f40 comp rx=0 tx=0).stop 2024-03-31T23:20:43.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 msgr2=0x7f68f019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:43.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 0x7f68f019b8d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f68e800eca0 tx=0x7f68e800b690 comp rx=0 tx=0).stop 2024-03-31T23:20:43.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 shutdown_connections 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f68d80a2610 0x7f68d80a4ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68f0106660 0x7f68f019b8d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0101010 0x7f68f0197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 --2- 172.21.15.42:0/743944929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68f0100650 0x7f68f0197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 >> 172.21.15.42:0/743944929 conn(0x7f68f0077750 msgr2=0x7f68f0102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 shutdown_connections 2024-03-31T23:20:43.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:43.938+0000 7f68f5313640 1 -- 172.21.15.42:0/743944929 wait complete. 2024-03-31T23:20:43.950 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-31T23:20:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 -- 172.21.15.42:0/4204780190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 msgr2=0x7f9c2010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 --2- 172.21.15.42:0/4204780190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c2010d490 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009cd0 tx=0x7f9c1002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 -- 172.21.15.42:0/4204780190 shutdown_connections 2024-03-31T23:20:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 --2- 172.21.15.42:0/4204780190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c2010d490 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 --2- 172.21.15.42:0/4204780190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c201005c0 0x7f9c20100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 --2- 172.21.15.42:0/4204780190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c20106660 0x7f9c20106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 -- 172.21.15.42:0/4204780190 >> 172.21.15.42:0/4204780190 conn(0x7f9c20077750 msgr2=0x7f9c20077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 -- 172.21.15.42:0/4204780190 shutdown_connections 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 -- 172.21.15.42:0/4204780190 wait complete. 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.056+0000 7f9c2527c640 1 Processor -- start 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 -- start start 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c201005c0 0x7f9c20198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c20198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c20106660 0x7f9c2019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20110b40 con 0x7f9c20100f80 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201109c0 con 0x7f9c20106660 2024-03-31T23:20:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c2527c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20110cc0 con 0x7f9c201005c0 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c20198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c20106660 0x7f9c2019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c201005c0 0x7f9c20198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c20198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39220/0 (socket says 172.21.15.42:39220) 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/337110189 learned_addr learned my addr 172.21.15.42:0/337110189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/337110189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c201005c0 msgr2=0x7f9c20198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c201005c0 0x7f9c20198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/337110189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c20106660 msgr2=0x7f9c2019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c20106660 0x7f9c2019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/337110189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2019cfd0 con 0x7f9c20100f80 2024-03-31T23:20:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.057+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c20198570 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b4a0 tx=0x7f9c1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.058+0000 7f9c07fff640 1 -- 172.21.15.42:0/337110189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14014070 con 0x7f9c20100f80 2024-03-31T23:20:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.058+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2019d2c0 con 0x7f9c20100f80 2024-03-31T23:20:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.058+0000 7f9c07fff640 1 -- 172.21.15.42:0/337110189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c14010b10 con 0x7f9c20100f80 2024-03-31T23:20:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.058+0000 7f9c07fff640 1 -- 172.21.15.42:0/337110189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14017d60 con 0x7f9c20100f80 2024-03-31T23:20:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.058+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201a4bd0 con 0x7f9c20100f80 2024-03-31T23:20:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.060+0000 7f9c07fff640 1 -- 172.21.15.42:0/337110189 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f9c14017070 con 0x7f9c20100f80 2024-03-31T23:20:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.060+0000 7f9c27e5b740 1 Processor -- start 2024-03-31T23:20:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.060+0000 7f9c27e5b740 1 -- start start 2024-03-31T23:20:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dfe63251b0 con 0x55dfe63ca970 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55dfe62cdc00 con 0x55dfe63c1d90 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dfe6321250 con 0x55dfe63c1470 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c07fff640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9c080a2610 0x7f9c080a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:51166/0 (socket says 172.21.15.42:51166) 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39234/0 (socket says 172.21.15.42:39234) 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 -- 172.21.15.42:0/1069141586 learned_addr learned my addr 172.21.15.42:0/1069141586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1f7fe640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9c080a2610 0x7f9c080a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 -- 172.21.15.42:0/1069141586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 msgr2=0x55dfe63c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c07fff640 1 -- 172.21.15.42:0/337110189 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f9c140ce020 con 0x7f9c20100f80 2024-03-31T23:20:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 -- 172.21.15.42:0/1069141586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 msgr2=0x55dfe63ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 -- 172.21.15.42:0/1069141586 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe62ed3d0 con 0x55dfe63c1d90 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1f7fe640 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1f7fe640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9c080a2610 0x7f9c080a4ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c10005cc0 tx=0x7f9c10005c50 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.061+0000 7f9c1effd640 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ca430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009ca0 tx=0x7f9c18011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7cd8e6e5150812b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c057fa640 1 -- 172.21.15.42:0/1069141586 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18004220 con 0x55dfe63c1d90 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c057fa640 1 -- 172.21.15.42:0/1069141586 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c180043c0 con 0x55dfe63c1d90 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c057fa640 1 -- 172.21.15.42:0/1069141586 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18019910 con 0x55dfe63c1d90 2024-03-31T23:20:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 -- 172.21.15.42:0/1069141586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 msgr2=0x55dfe63ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ca430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009ca0 tx=0x7f9c18011810 comp rx=0 tx=0).stop 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 -- 172.21.15.42:0/1069141586 shutdown_connections 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ca430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/1069141586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 -- 172.21.15.42:0/1069141586 >> 172.21.15.42:0/1069141586 conn(0x55dfe63bbba0 msgr2=0x55dfe63bbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 -- 172.21.15.42:0/1069141586 shutdown_connections 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.062+0000 7f9c27e5b740 1 -- 172.21.15.42:0/1069141586 wait complete. 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 -- start start 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 Processor -- start 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1470 0x55dfe63c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dfe63cd760 con 0x55dfe63ca970 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55dfe62c3470 con 0x55dfe63c1470 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dfe63cd8e0 con 0x55dfe63c1d90 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c27e5b740 10 client.0 _ll_register_callbacks cb 0x55dfe62e0cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1470 0x55dfe63c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:50990/0 (socket says 172.21.15.42:50990) 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1470 0x55dfe63c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:51178/0 (socket says 172.21.15.42:51178) 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/2255777352 learned_addr learned my addr 172.21.15.42:0/2255777352 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39238/0 (socket says 172.21.15.42:39238) 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/2255777352 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1470 msgr2=0x55dfe63c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1470 0x55dfe63c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/2255777352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 msgr2=0x55dfe63c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/2255777352 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe60393f0 con 0x55dfe63c1d90 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1f7fe640 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63c7e90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c1409a2f0 tx=0x7f9c14017360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0688e9bdf46286 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.063+0000 7f9c02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c02ff5640 1 -- 172.21.15.42:0/2255777352 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1401e040 con 0x55dfe63c1d90 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c180043c0 con 0x55dfe63c1d90 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c02ff5640 1 -- 172.21.15.42:0/2255777352 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f9c14096c60 con 0x55dfe63c1d90 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c02ff5640 1 -- 172.21.15.42:0/2255777352 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9c140a2f50 con 0x55dfe63c1d90 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 10 client.26359 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55dfe61037d0 con 0x55dfe63c1d90 2024-03-31T23:20:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c02ff5640 1 -- 172.21.15.42:0/2255777352 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c180043c0 con 0x55dfe63c1d90 2024-03-31T23:20:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c02ff5640 1 -- 172.21.15.42:0/2255777352 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f9c140cb680 con 0x55dfe63c1d90 2024-03-31T23:20:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 10 client.26359 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 10 client.26359 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:20:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 20 client.26359 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe63daa00 0x55dfe63dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 4 client.26359 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfe63326f0 con 0x55dfe63daa00 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.064+0000 7f9c1effd640 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe63daa00 0x55dfe63dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.065+0000 7f9c02ff5640 10 client.26359 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.065+0000 7f9c1effd640 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe63daa00 0x55dfe63dcdf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=68d2996611613d40 server_cookie=5db9e885b9bb2f79 in_seq=0 out_seq=0 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.065+0000 7f9c02ff5640 1 -- 172.21.15.42:0/2255777352 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55dfe63326f0 con 0x55dfe63daa00 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c02ff5640 10 client.26359 handle_command_reply: tid=0 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 client.26359 shutdown 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 msgr2=0x55dfe63c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63c7e90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c1409a2f0 tx=0x7f9c14017360 comp rx=0 tx=0).stop 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 shutdown_connections 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe63daa00 0x55dfe63dcdf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63c7e90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2255777352 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1470 0x55dfe63c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c02ff5640 0 client.26359 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 >> 172.21.15.42:0/2255777352 conn(0x55dfe63bbba0 msgr2=0x55dfe63bd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 shutdown_connections 2024-03-31T23:20:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2255777352 wait complete. 2024-03-31T23:20:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.066+0000 7f9c27e5b740 20 client.26359 trim_cache size 0 max 16384 2024-03-31T23:20:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 Processor -- start 2024-03-31T23:20:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 -- start start 2024-03-31T23:20:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 0x55dfe63d6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63ca970 0x55dfe63ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201aebc0 con 0x55dfe63c1470 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201b09d0 con 0x55dfe63ca970 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201af350 con 0x55dfe63c1d90 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 0x55dfe63d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 0x55dfe63d6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39240/0 (socket says 172.21.15.42:39240) 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 -- 172.21.15.42:0/2796379470 learned_addr learned my addr 172.21.15.42:0/2796379470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1f7fe640 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63ca970 0x55dfe63ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 -- 172.21.15.42:0/2796379470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 msgr2=0x55dfe63e26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63e26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 -- 172.21.15.42:0/2796379470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63ca970 msgr2=0x55dfe63ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.079+0000 7f9c1effd640 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63ca970 0x55dfe63ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c1effd640 1 -- 172.21.15.42:0/2796379470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe63bb9d0 con 0x55dfe63c1470 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c1effd640 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 0x55dfe63d6500 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009ca0 tx=0x7f9c18019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e29e26406f6fa46 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c04ff9640 1 -- 172.21.15.42:0/2796379470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18031070 con 0x55dfe63c1470 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c04ff9640 1 -- 172.21.15.42:0/2796379470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c18005a70 con 0x55dfe63c1470 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c04ff9640 1 -- 172.21.15.42:0/2796379470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1802b2f0 con 0x55dfe63c1470 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2796379470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 msgr2=0x55dfe63d6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 0x55dfe63d6500 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009ca0 tx=0x7f9c18019570 comp rx=0 tx=0).stop 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2796379470 shutdown_connections 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63ca970 0x55dfe63ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1d90 0x55dfe63e26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.080+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/2796379470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63c1470 0x55dfe63d6500 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2796379470 >> 172.21.15.42:0/2796379470 conn(0x55dfe63bbba0 msgr2=0x55dfe63c2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2796379470 shutdown_connections 2024-03-31T23:20:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- 172.21.15.42:0/2796379470 wait complete. 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- start start 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 Processor -- start 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201b0240 con 0x55dfe63ca970 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201afab0 con 0x55dfe63c1d90 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201acb80 con 0x55dfe63c1470 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c27e5b740 10 client.0 _ll_register_callbacks cb 0x7f9c140850b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39248/0 (socket says 172.21.15.42:39248) 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1f7fe640 1 -- 172.21.15.42:0/3424804967 learned_addr learned my addr 172.21.15.42:0/3424804967 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1effd640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 msgr2=0x55dfe63d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.081+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/3424804967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 msgr2=0x55dfe63ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c1e7fc640 1 -- 172.21.15.42:0/3424804967 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe63cef80 con 0x55dfe63c1d90 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c1f7fe640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c1e7fc640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ce1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c14096fc0 tx=0x7f9c140047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494db19af258f998 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c02ff5640 1 -- 172.21.15.42:0/3424804967 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1401e070 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c02ff5640 1 -- 172.21.15.42:0/3424804967 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f9c140ba0d0 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c18005a70 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c02ff5640 1 -- 172.21.15.42:0/3424804967 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9c1409a5f0 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 10 client.26411 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55dfe6440d90 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c02ff5640 1 -- 172.21.15.42:0/3424804967 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c18005a70 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c02ff5640 1 -- 172.21.15.42:0/3424804967 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f9c14099bd0 con 0x55dfe63c1d90 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 10 client.26411 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 10 client.26411 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 20 client.26411 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe6441580 0x55dfe64439a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 4 client.26411 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.082+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 --> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dfe632ca40 con 0x55dfe6441580 2024-03-31T23:20:44.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.083+0000 7f9c1effd640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe6441580 0x55dfe64439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.083+0000 7f9c02ff5640 10 client.26411 ms_handle_connect on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:44.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.083+0000 7f9c1effd640 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe6441580 0x55dfe64439a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3b12ca5530f8fd1c server_cookie=1adb680909a90acd in_seq=0 out_seq=0 2024-03-31T23:20:44.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c02ff5640 1 -- 172.21.15.42:0/3424804967 <== mds.4 v2:172.21.15.188:6834/2839339934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+51419 (crc 0 0 0) 0x55dfe632ca40 con 0x55dfe6441580 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c02ff5640 10 client.26411 handle_command_reply: tid=0 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 client.26411 shutdown 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 msgr2=0x55dfe63ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ce1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c14096fc0 tx=0x7f9c140047d0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 shutdown_connections 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:6834/2839339934,v1:172.21.15.188:6835/2839339934] conn(0x55dfe6441580 0x55dfe64439a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dfe63ca970 0x55dfe63ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55dfe63c1d90 0x55dfe63ce1d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 --2- 172.21.15.42:0/3424804967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfe63c1470 0x55dfe63d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c02ff5640 0 client.26411 ms_handle_reset on v2:172.21.15.188:6834/2839339934 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 >> 172.21.15.42:0/3424804967 conn(0x55dfe63bbba0 msgr2=0x55dfe63ba4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 shutdown_connections 2024-03-31T23:20:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 1 -- 172.21.15.42:0/3424804967 wait complete. 2024-03-31T23:20:44.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.084+0000 7f9c27e5b740 20 client.26411 trim_cache size 0 max 16384 2024-03-31T23:20:44.093 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4301020, 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633016, 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt" 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4625427, 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632729, 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt" 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 32074646, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632742, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt" 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 66618238, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632736, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt" 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 80448036, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632760, 2024-03-31T23:20:44.095 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt" 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 125713755, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633021, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt" 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 139240011, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633133, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt" 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.096 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 142148835, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633095, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt" 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 143888670, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632754, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt" 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 185263699, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633143, 2024-03-31T23:20:44.097 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt" 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 229468411, 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633076, 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt" 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 232638249, 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632722, 2024-03-31T23:20:44.098 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt" 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 248829660, 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633073, 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt" 2024-03-31T23:20:44.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 249513673, 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633122, 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt" 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 257388063, 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629013, 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blockdev/drbd" 2024-03-31T23:20:44.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 261676986, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632743, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt" 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 348756532, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632731, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt" 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 375466605, 2024-03-31T23:20:44.101 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633011, 2024-03-31T23:20:44.102 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt" 2024-03-31T23:20:44.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.102 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.102 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 386007076, 2024-03-31T23:20:44.102 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633110, 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt" 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 408961844, 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633069, 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt" 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.103 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 461703833, 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633161, 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt" 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 479362501, 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633131, 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt" 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 494766462, 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633068, 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt" 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 501316179, 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633091, 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt" 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 513178719, 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633150, 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt" 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.106 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 518001637, 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632741, 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt" 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 565708603, 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633006, 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt" 2024-03-31T23:20:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 610812994, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633008, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt" 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 683319518, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632750, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt" 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 706758514, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633107, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt" 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 759462314, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633138, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt" 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 802433743, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633163, 2024-03-31T23:20:44.109 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt" 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 823388627, 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633058, 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt" 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 824987533, 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633097, 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt" 2024-03-31T23:20:44.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 871986282, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632737, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt" 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 894372181, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632723, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt" 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.111 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 948273478, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633065, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt" 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 954842226, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633140, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt" 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 989487781, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633152, 2024-03-31T23:20:44.112 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt" 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1014684957, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632759, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt" 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1066879578, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633121, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt" 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1092995563, 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633120, 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt" 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1093329468, 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632724, 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt" 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1113531635, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632988, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt" 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1121415419, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632755, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt" 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1149371712, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632751, 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt" 2024-03-31T23:20:44.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1220491125, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632733, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt" 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1233874400, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632993, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt" 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.116 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1267159192, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632757, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt" 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1282492737, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633094, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt" 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1286570856, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632728, 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt" 2024-03-31T23:20:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1307561397, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632746, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt" 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1317696703, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633089, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt" 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.118 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1332180438, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633137, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt" 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1349278670, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633148, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt" 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1354288822, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633010, 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt" 2024-03-31T23:20:44.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1361748053, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633087, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt" 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1367564770, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631719, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/powercap" 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.120 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1405035921, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633064, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt" 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1406138008, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633126, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt" 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1406416043, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631721, 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/regulator" 2024-03-31T23:20:44.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1414348456, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633105, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt" 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1425956151, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633125, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt" 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.122 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1497827043, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633104, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt" 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1508507842, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633130, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt" 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1518640106, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633002, 2024-03-31T23:20:44.123 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt" 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1520391700, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633149, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt" 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1539868378, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632745, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt" 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1544021846, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632727, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt" 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1574939132, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632740, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt" 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1612634008, 2024-03-31T23:20:44.125 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633151, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt" 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1662135837, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633022, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt" 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1663969182, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633115, 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt" 2024-03-31T23:20:44.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1708574425, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632994, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt" 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1747617069, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633004, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt" 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.127 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1754922982, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633164, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt" 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1759299844, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632730, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt" 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1812727805, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633074, 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt" 2024-03-31T23:20:44.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1848161034, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632989, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt" 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1859520005, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633093, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt" 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.129 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1874372392, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633135, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt" 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1930531310, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632758, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt" 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1932877010, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632998, 2024-03-31T23:20:44.130 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt" 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1952827825, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633060, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt" 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1957578052, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633101, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt" 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.131 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2001470038, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633154, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt" 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2016170389, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629736, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen" 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2050719256, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632997, 2024-03-31T23:20:44.132 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt" 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2072056883, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633153, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt" 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2073692239, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633136, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt" 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.133 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2104535502, 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633057, 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt" 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2119624882, 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633128, 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt" 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.134 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2164945762, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633145, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt" 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2187604373, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633059, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt" 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2202488865, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633159, 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt" 2024-03-31T23:20:44.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2214959522, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633088, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt" 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2277526784, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633112, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt" 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.136 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2334212371, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632999, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt" 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2352829770, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633142, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt" 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2357746035, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633082, 2024-03-31T23:20:44.137 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt" 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2365624164, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633162, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt" 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2390420866, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633147, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt" 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2415262628, 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633090, 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt" 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2454082273, 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633108, 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt" 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.139 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2478033055, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633005, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt" 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2478853849, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632747, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt" 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2493029267, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633070, 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt" 2024-03-31T23:20:44.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2519208782, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632749, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt" 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2524276340, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633100, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt" 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.141 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2524793656, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633015, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt" 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2555644750, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633062, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt" 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2575887856, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633155, 2024-03-31T23:20:44.142 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt" 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2578510967, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633080, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt" 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2611717555, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633129, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt" 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.143 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2646459793, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633072, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt" 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2669017695, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633067, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt" 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2674043914, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632726, 2024-03-31T23:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt" 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2676789362, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633144, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt" 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2703465015, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633102, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt" 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.145 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2718097337, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633146, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt" 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2720299948, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633119, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt" 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2780783023, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633117, 2024-03-31T23:20:44.146 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt" 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2790663864, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633116, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt" 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2796507020, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633079, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt" 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2800965290, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633098, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt" 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2825317495, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633123, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt" 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2837229841, 2024-03-31T23:20:44.148 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633017, 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt" 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2857068766, 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633124, 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt" 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.149 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2859165870, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633013, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt" 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2949338862, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633113, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt" 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2952466682, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633109, 2024-03-31T23:20:44.150 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt" 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2962733100, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633141, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt" 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2982375769, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633103, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt" 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2984825519, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633158, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt" 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2989936707, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633157, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt" 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3010480998, 2024-03-31T23:20:44.152 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633134, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt" 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3037750814, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633118, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt" 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3048978256, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633009, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt" 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3062623345, 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633165, 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt" 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3083924842, 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633075, 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt" 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.154 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3152602966, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633099, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt" 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3166605688, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633096, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt" 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3173081878, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633092, 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt" 2024-03-31T23:20:44.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3229210515, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633003, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt" 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3305456135, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633078, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt" 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.156 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3305509575, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633139, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt" 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3312714205, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633077, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt" 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3313845763, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633014, 2024-03-31T23:20:44.157 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt" 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3361138963, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633081, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt" 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3437759118, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633000, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt" 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.158 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3447275656, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632748, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt" 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3506865949, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632725, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt" 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3554597811, 2024-03-31T23:20:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633111, 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt" 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3565426968, 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633007, 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt" 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.160 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3599794302, 2024-03-31T23:20:44.162 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632987, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt" 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3630771600, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632744, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt" 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3634156059, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632735, 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt" 2024-03-31T23:20:44.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3638390518, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633132, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt" 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3672832252, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633083, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt" 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.164 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3700569817, 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632986, 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt" 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3702279170, 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633019, 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt" 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.165 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3703721097, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633127, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt" 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3719084196, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629813, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c" 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3721850968, 2024-03-31T23:20:44.166 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633156, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt" 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3732117081, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633114, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt" 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3763109276, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632990, 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt" 2024-03-31T23:20:44.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3821907582, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632996, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt" 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3842057212, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633020, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt" 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.168 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3857175626, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633086, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt" 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3858020710, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632753, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt" 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3859148367, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632992, 2024-03-31T23:20:44.169 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt" 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3882763851, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632738, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt" 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3896499083, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633106, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt" 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3909353541, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633071, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt" 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3929464718, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633085, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt" 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3967346326, 2024-03-31T23:20:44.171 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632985, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt" 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3970816502, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633018, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt" 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3984454166, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633084, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt" 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3986734475, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633061, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt" 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4014967196, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632734, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt" 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4026234777, 2024-03-31T23:20:44.173 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633012, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt" 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4042298818, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632752, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt" 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4050007358, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632995, 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt" 2024-03-31T23:20:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4099634174, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633001, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt" 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4158472784, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632756, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt" 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.175 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4190383048, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632732, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt" 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4202627650, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632739, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt" 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4204280414, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633063, 2024-03-31T23:20:44.176 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt" 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4228711577, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632991, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt" 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4241555617, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633160, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt" 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.177 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.178 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4257354551, 2024-03-31T23:20:44.178 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511633066, 2024-03-31T23:20:44.178 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt" 2024-03-31T23:20:44.178 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:20:44.178 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-03-31T23:20:44.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9c080a2610 msgr2=0x7f9c080a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9c080a2610 0x7f9c080a4ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c10005cc0 tx=0x7f9c10005c50 comp rx=0 tx=0).stop 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 msgr2=0x7f9c20198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c20198570 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b4a0 tx=0x7f9c1400b960 comp rx=0 tx=0).stop 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 shutdown_connections 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c20106660 0x7f9c2019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f9c080a2610 0x7f9c080a4ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c20100f80 0x7f9c20198570 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 --2- 172.21.15.42:0/337110189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c201005c0 0x7f9c20198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 >> 172.21.15.42:0/337110189 conn(0x7f9c20077750 msgr2=0x7f9c200ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 shutdown_connections 2024-03-31T23:20:44.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.085+0000 7f9c2527c640 1 -- 172.21.15.42:0/337110189 wait complete. 2024-03-31T23:20:44.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-31T23:20:44.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:43 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/743944929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:20:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 -- 172.21.15.42:0/1314764248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1020b0 msgr2=0x7f861c10e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 --2- 172.21.15.42:0/1314764248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1020b0 0x7f861c10e5c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8614009cd0 tx=0x7f861402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 -- 172.21.15.42:0/1314764248 shutdown_connections 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 --2- 172.21.15.42:0/1314764248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1020b0 0x7f861c10e5c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 --2- 172.21.15.42:0/1314764248 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f861c1016f0 0x7f861c101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 --2- 172.21.15.42:0/1314764248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 0x7f861c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 -- 172.21.15.42:0/1314764248 >> 172.21.15.42:0/1314764248 conn(0x7f861c0fd1e0 msgr2=0x7f861c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 -- 172.21.15.42:0/1314764248 shutdown_connections 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.287+0000 7f862232c640 1 -- 172.21.15.42:0/1314764248 wait complete. 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 Processor -- start 2024-03-31T23:20:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 -- start start 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 0x7f861c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f861c1020b0 0x7f861c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 0x7f861c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f861c111bf0 con 0x7f861c1016f0 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f861c111a70 con 0x7f861c107700 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f862232c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f861c111d70 con 0x7f861c1020b0 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 0x7f861c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 0x7f861c198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39254/0 (socket says 172.21.15.42:39254) 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861bfff640 1 -- 172.21.15.42:0/1951830774 learned_addr learned my addr 172.21.15.42:0/1951830774 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f86208c9640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 0x7f861c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861b7fe640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f861c1020b0 0x7f861c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861bfff640 1 -- 172.21.15.42:0/1951830774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f861c1020b0 msgr2=0x7f861c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861bfff640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f861c1020b0 0x7f861c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.288+0000 7f861bfff640 1 -- 172.21.15.42:0/1951830774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 msgr2=0x7f861c19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f861bfff640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 0x7f861c19c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f861bfff640 1 -- 172.21.15.42:0/1951830774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c19d060 con 0x7f861c1016f0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f86208c9640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 0x7f861c19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f861bfff640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 0x7f861c198070 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e9f0 tx=0x7f860c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f86197fa640 1 -- 172.21.15.42:0/1951830774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c00cd80 con 0x7f861c1016f0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f86197fa640 1 -- 172.21.15.42:0/1951830774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f860c010930 con 0x7f861c1016f0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c19d350 con 0x7f861c1016f0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f86197fa640 1 -- 172.21.15.42:0/1951830774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c018b00 con 0x7f861c1016f0 2024-03-31T23:20:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.289+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c1a4be0 con 0x7f861c1016f0 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.291+0000 7f86197fa640 1 -- 172.21.15.42:0/1951830774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f860c018ca0 con 0x7f861c1016f0 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.291+0000 7f8624fec740 1 Processor -- start 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.291+0000 7f8624fec740 1 -- start start 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.291+0000 7f8624fec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f8624fec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084ccd90 0x556e084d5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f8624fec740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f8624fec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556e084301b0 con 0x556e084ccd90 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f8624fec740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556e083d8c00 con 0x556e084d5970 2024-03-31T23:20:44.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f8624fec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556e0842c250 con 0x556e084cc470 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084ccd90 0x556e084d5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f86208c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084ccd90 0x556e084d5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39270/0 (socket says 172.21.15.42:39270) 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861bfff640 1 -- 172.21.15.42:0/733422752 learned_addr learned my addr 172.21.15.42:0/733422752 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f86197fa640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f86040a2610 0x7f86040a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f86208c9640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f86040a2610 0x7f86040a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 -- 172.21.15.42:0/733422752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 msgr2=0x556e084cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 -- 172.21.15.42:0/733422752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084ccd90 msgr2=0x556e084d5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084ccd90 0x556e084d5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f86197fa640 1 -- 172.21.15.42:0/1951830774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f860c0cf180 con 0x7f861c1016f0 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 -- 172.21.15.42:0/733422752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e083f83d0 con 0x556e084d5970 2024-03-31T23:20:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f861b7fe640 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084d7d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8610009bf0 tx=0x7f8610011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276a54fc4e3a3092 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f86208c9640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f86040a2610 0x7f86040a4ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8614005cc0 tx=0x7f861402c0f0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.292+0000 7f86027fc640 1 -- 172.21.15.42:0/733422752 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610004050 con 0x556e084d5970 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f86027fc640 1 -- 172.21.15.42:0/733422752 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8610005520 con 0x556e084d5970 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f86027fc640 1 -- 172.21.15.42:0/733422752 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100035f0 con 0x556e084d5970 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 -- 172.21.15.42:0/733422752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 msgr2=0x556e084d7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084d7d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8610009bf0 tx=0x7f8610011810 comp rx=0 tx=0).stop 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 -- 172.21.15.42:0/733422752 shutdown_connections 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084d7d60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084ccd90 0x556e084d5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 --2- 172.21.15.42:0/733422752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 -- 172.21.15.42:0/733422752 >> 172.21.15.42:0/733422752 conn(0x556e084c6ba0 msgr2=0x556e084c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 -- 172.21.15.42:0/733422752 shutdown_connections 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.293+0000 7f8624fec740 1 -- 172.21.15.42:0/733422752 wait complete. 2024-03-31T23:20:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 -- start start 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 Processor -- start 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084d5970 0x556e084d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556e084d8760 con 0x556e084cc470 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556e083ce470 con 0x556e084ccd90 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556e084d88e0 con 0x556e084d5970 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f8624fec740 10 client.0 _ll_register_callbacks cb 0x556e083ebcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39280/0 (socket says 172.21.15.42:39280) 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 -- 172.21.15.42:0/636720354 learned_addr learned my addr 172.21.15.42:0/636720354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861b7fe640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f86208c9640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084d5970 0x556e084d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 -- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084d5970 msgr2=0x556e084d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084d5970 0x556e084d33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 -- 172.21.15.42:0/636720354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 msgr2=0x556e084d2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861bfff640 1 -- 172.21.15.42:0/636720354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e081443f0 con 0x556e084cc470 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.294+0000 7f861b7fe640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f861bfff640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d2930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e9c0 tx=0x7f860c099b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec99ca3f1708ad2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f85fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f85fb7fe640 1 -- 172.21.15.42:0/636720354 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c09b180 con 0x556e084cc470 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f85fb7fe640 1 -- 172.21.15.42:0/636720354 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f860c084d80 con 0x556e084cc470 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8610005520 con 0x556e084cc470 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f85fb7fe640 1 -- 172.21.15.42:0/636720354 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f860c09afa0 con 0x556e084cc470 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 10 client.16617 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556e0820e7d0 con 0x556e084cc470 2024-03-31T23:20:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f85fb7fe640 1 -- 172.21.15.42:0/636720354 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8610005520 con 0x556e084cc470 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f85fb7fe640 1 -- 172.21.15.42:0/636720354 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f860c0d1110 con 0x556e084cc470 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 10 client.16617 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 10 client.16617 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 20 client.16617 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e084e5a40 0x556e084e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 4 client.16617 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.295+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e0843d6f0 con 0x556e084e5a40 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.296+0000 7f861b7fe640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e084e5a40 0x556e084e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.296+0000 7f85fb7fe640 10 client.16617 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.296+0000 7f861b7fe640 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e084e5a40 0x556e084e7f00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4a013697834aa0cd server_cookie=ae9033ae4023ba8b in_seq=0 out_seq=0 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f85fb7fe640 1 -- 172.21.15.42:0/636720354 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556e0843d6f0 con 0x556e084e5a40 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f85fb7fe640 10 client.16617 handle_command_reply: tid=0 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 client.16617 shutdown 2024-03-31T23:20:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 msgr2=0x556e084d2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d2930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e9c0 tx=0x7f860c099b50 comp rx=0 tx=0).stop 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 shutdown_connections 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e084e5a40 0x556e084e7f00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084d5970 0x556e084d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f85fb7fe640 0 client.16617 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 --2- 172.21.15.42:0/636720354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d2930 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 >> 172.21.15.42:0/636720354 conn(0x556e084c6ba0 msgr2=0x556e084c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 shutdown_connections 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 1 -- 172.21.15.42:0/636720354 wait complete. 2024-03-31T23:20:44.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.297+0000 7f8624fec740 20 client.16617 trim_cache size 0 max 16384 2024-03-31T23:20:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 Processor -- start 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 -- start start 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084ccd90 0x556e084d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1aecd0 con 0x556e084cc470 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1b0ae0 con 0x556e084d5970 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f8624fec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1af460 con 0x556e084ccd90 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39292/0 (socket says 172.21.15.42:39292) 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 -- 172.21.15.42:0/4121959434 learned_addr learned my addr 172.21.15.42:0/4121959434 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861b7fe640 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084ccd90 0x556e084d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f86208c9640 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 -- 172.21.15.42:0/4121959434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084ccd90 msgr2=0x556e084d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084ccd90 0x556e084d1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 -- 172.21.15.42:0/4121959434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 msgr2=0x556e084e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 -- 172.21.15.42:0/4121959434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e084c69d0 con 0x556e084cc470 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.311+0000 7f861bfff640 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d5060 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f860c097320 tx=0x7f860c0bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c85b2cba92471e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8601ffb640 1 -- 172.21.15.42:0/4121959434 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c0b4070 con 0x556e084cc470 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8601ffb640 1 -- 172.21.15.42:0/4121959434 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f860c010cf0 con 0x556e084cc470 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8601ffb640 1 -- 172.21.15.42:0/4121959434 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c09b640 con 0x556e084cc470 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 -- 172.21.15.42:0/4121959434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 msgr2=0x556e084d5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d5060 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f860c097320 tx=0x7f860c0bb040 comp rx=0 tx=0).stop 2024-03-31T23:20:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 -- 172.21.15.42:0/4121959434 shutdown_connections 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084d5970 0x556e084e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084ccd90 0x556e084d1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 --2- 172.21.15.42:0/4121959434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084cc470 0x556e084d5060 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 -- 172.21.15.42:0/4121959434 >> 172.21.15.42:0/4121959434 conn(0x556e084c6ba0 msgr2=0x556e084c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 -- 172.21.15.42:0/4121959434 shutdown_connections 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.312+0000 7f8624fec740 1 -- 172.21.15.42:0/4121959434 wait complete. 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 -- start start 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 Processor -- start 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084d93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 0x556e084d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1b0350 con 0x556e084d5970 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1afbc0 con 0x556e084ccd90 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1acc90 con 0x556e084cc470 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f8624fec740 10 client.0 _ll_register_callbacks cb 0x7f860c018420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 0x556e084d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f861bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 0x556e084d9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39304/0 (socket says 172.21.15.42:39304) 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 -- 172.21.15.42:0/528581023 learned_addr learned my addr 172.21.15.42:0/528581023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f861b7fe640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 -- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 msgr2=0x556e084d93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084d93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 -- 172.21.15.42:0/528581023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 msgr2=0x556e084d98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f86208c9640 1 -- 172.21.15.42:0/528581023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e084d7d60 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.313+0000 7f861bfff640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f86208c9640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 0x556e084d9e30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8614009cd0 tx=0x7f86140095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9844038cd1b8d8e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f85fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f85fb7fe640 1 -- 172.21.15.42:0/528581023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614039040 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f85fb7fe640 1 -- 172.21.15.42:0/528581023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8614004510 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f860c010cf0 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f85fb7fe640 1 -- 172.21.15.42:0/528581023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8614060050 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 10 client.16623 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556e0854be70 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f85fb7fe640 1 -- 172.21.15.42:0/528581023 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f860c010cf0 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f85fb7fe640 1 -- 172.21.15.42:0/528581023 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f861403f070 con 0x556e084d5970 2024-03-31T23:20:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 10 client.16623 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 10 client.16623 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 20 client.16623 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e0854c700 0x556e0854eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 4 client.16623 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.314+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 --> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e08437a40 con 0x556e0854c700 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.315+0000 7f861bfff640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e0854c700 0x556e0854eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.315+0000 7f85fb7fe640 10 client.16623 ms_handle_connect on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.315+0000 7f861bfff640 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e0854c700 0x556e0854eb20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f7bf9adda9a62e70 server_cookie=d31c0e85618dec20 in_seq=0 out_seq=0 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.315+0000 7f85fb7fe640 1 -- 172.21.15.42:0/528581023 <== mds.3 v2:172.21.15.188:6836/67113861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+12091 (crc 0 0 0) 0x556e08437a40 con 0x556e0854c700 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.315+0000 7f85fb7fe640 10 client.16623 handle_command_reply: tid=0 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 client.16623 shutdown 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 msgr2=0x556e084d9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 0x556e084d9e30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8614009cd0 tx=0x7f86140095c0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 shutdown_connections 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:6836/67113861,v1:172.21.15.188:6837/67113861] conn(0x556e0854c700 0x556e0854eb20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556e084d5970 0x556e084d9e30 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556e084ccd90 0x556e084d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 --2- 172.21.15.42:0/528581023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e084cc470 0x556e084d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 >> 172.21.15.42:0/528581023 conn(0x556e084c6ba0 msgr2=0x556e084c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f85fb7fe640 0 client.16623 ms_handle_reset on v2:172.21.15.188:6836/67113861 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 shutdown_connections 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 1 -- 172.21.15.42:0/528581023 wait complete. 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f8624fec740 20 client.16623 trim_cache size 0 max 16384 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-03-31T23:20:44.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 38884308, 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628952, 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa" 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 86259726, 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631365, 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/isdn" 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.326 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 148043962, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628967, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm64" 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 159918336, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632306, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/video4linux" 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 245672910, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631754, 2024-03-31T23:20:44.327 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/prctl" 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 286616219, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628854, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi" 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 334448283, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628980, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/backlight" 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 349834618, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631304, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ide" 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 906521195, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630317, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo" 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 999282790, 2024-03-31T23:20:44.329 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630774, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/bridge" 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1341651418, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628868, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe" 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1349762113, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628954, 2024-03-31T23:20:44.330 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti" 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1398814574, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628920, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX" 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1458712440, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630909, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fault-injection" 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1493388811, 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628793, 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID" 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1527181522, 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628878, 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel" 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.332 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1615452130, 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629099, 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/development-process" 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1755660774, 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628912, 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile" 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1767816383, 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628992, 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/block" 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1977795076, 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630767, 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/backlight" 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2128130559, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628932, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung" 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2146056455, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628893, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100" 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2203444678, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629080, 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cpuidle" 2024-03-31T23:20:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2217696050, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631465, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/m68k" 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2290452833, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632297, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/filesystems" 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2304716075, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632288, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm" 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2350042911, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628945, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm" 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2441265911, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630262, 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx" 2024-03-31T23:20:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2491983498, 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632017, 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/tpm" 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2508309214, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632281, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN" 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2615469995, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628960, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi" 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2861550870, 2024-03-31T23:20:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630048, 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds3/stray3/100000008e0" 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2920993612, 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628885, 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell" 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2924934189, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632716, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds3/stray3/1000000134c" 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2976128837, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628918, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr" 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3049223252, 2024-03-31T23:20:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628888, 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP" 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3074510556, 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630270, 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl" 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3094456807, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632191, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vm" 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3122252642, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631682, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/parisc" 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3273991727, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632721, 2024-03-31T23:20:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt" 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3276281572, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631450, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/locking" 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3389096914, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631531, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/netlabel" 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3515008116, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631355, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ioctl" 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3732401918, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628947, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe" 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3741512943, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628937, 2024-03-31T23:20:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP" 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3830300789, 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630284, 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe" 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4160080457, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632291, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm64" 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4184288873, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630068, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc" 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4233034033, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630276, 2024-03-31T23:20:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm" 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4259745427, 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630274, 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe" 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4283392829, 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628855, 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei" 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:20:44.348 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f86040a2610 msgr2=0x7f86040a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f86040a2610 0x7f86040a4ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8614005cc0 tx=0x7f861402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 msgr2=0x7f861c198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 0x7f861c198070 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e9f0 tx=0x7f860c00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 shutdown_connections 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f861c107700 0x7f861c19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f861c1020b0 0x7f861c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f86040a2610 0x7f86040a4ad0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.316+0000 7f862232c640 1 --2- 172.21.15.42:0/1951830774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f861c1016f0 0x7f861c198070 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.317+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 >> 172.21.15.42:0/1951830774 conn(0x7f861c0fd1e0 msgr2=0x7f861c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.317+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 shutdown_connections 2024-03-31T23:20:44.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.317+0000 7f862232c640 1 -- 172.21.15.42:0/1951830774 wait complete. 2024-03-31T23:20:44.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-31T23:20:44.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:43 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/743944929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:20:44.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:43 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/743944929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 -- 172.21.15.42:0/3299129440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 msgr2=0x7f6c6c10d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/3299129440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c10d540 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009cd0 tx=0x7f6c6402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 -- 172.21.15.42:0/3299129440 shutdown_connections 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/3299129440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c10d540 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/3299129440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c6c100670 0x7f6c6c100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/3299129440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c6c106680 0x7f6c6c106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 -- 172.21.15.42:0/3299129440 >> 172.21.15.42:0/3299129440 conn(0x7f6c6c0777b0 msgr2=0x7f6c6c077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 -- 172.21.15.42:0/3299129440 shutdown_connections 2024-03-31T23:20:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.496+0000 7f6c70ed4640 1 -- 172.21.15.42:0/3299129440 wait complete. 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 Processor -- start 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 -- start start 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c6c100670 0x7f6c6c198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c6c106680 0x7f6c6c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c110bb0 con 0x7f6c6c101030 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c110a30 con 0x7f6c6c106680 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c70ed4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c110d30 con 0x7f6c6c100670 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39322/0 (socket says 172.21.15.42:39322) 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 -- 172.21.15.42:0/397461193 learned_addr learned my addr 172.21.15.42:0/397461193 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c6c100670 0x7f6c6c198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c6c106680 0x7f6c6c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 -- 172.21.15.42:0/397461193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c6c100670 msgr2=0x7f6c6c198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c6c100670 0x7f6c6c198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 -- 172.21.15.42:0/397461193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c6c106680 msgr2=0x7f6c6c19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c6c106680 0x7f6c6c19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.497+0000 7f6c69d9b640 1 -- 172.21.15.42:0/397461193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c19d130 con 0x7f6c6c101030 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.498+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c198680 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e9f0 tx=0x7f6c6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.498+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/397461193 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000cd80 con 0x7f6c6c101030 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.498+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c19d420 con 0x7f6c6c101030 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.498+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/397461193 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c60010930 con 0x7f6c6c101030 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.498+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/397461193 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60018b00 con 0x7f6c6c101030 2024-03-31T23:20:44.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.498+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c1a4cb0 con 0x7f6c6c101030 2024-03-31T23:20:44.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.500+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/397461193 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f6c60018cc0 con 0x7f6c6c101030 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.500+0000 7f6c73b99740 1 Processor -- start 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.500+0000 7f6c73b99740 1 -- start start 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.500+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913bfa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c03430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c05d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c73b99740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563913b5e1b0 con 0x563913bfa470 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c73b99740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563913b06c00 con 0x563913c03970 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c73b99740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563913b5a250 con 0x563913bfad90 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c5b7fe640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6c540a2610 0x7f6c540a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c03430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c69d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c05d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c03430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:51068/0 (socket says 172.21.15.42:51068) 2024-03-31T23:20:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 -- 172.21.15.42:0/2410852370 learned_addr learned my addr 172.21.15.42:0/2410852370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913bfa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6c540a2610 0x7f6c540a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/397461193 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f6c600cf250 con 0x7f6c6c101030 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 -- 172.21.15.42:0/2410852370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 msgr2=0x563913c05d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c05d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 -- 172.21.15.42:0/2410852370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 msgr2=0x563913bfa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913bfa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 -- 172.21.15.42:0/2410852370 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563913b263d0 con 0x563913bfad90 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c03430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009ca0 tx=0x7f6c5c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694fae423735d958 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6c540a2610 0x7f6c540a4ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005cc0 tx=0x7f6c64005c50 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.501+0000 7f6c58ff9640 1 -- 172.21.15.42:0/2410852370 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c01e070 con 0x563913bfad90 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c58ff9640 1 -- 172.21.15.42:0/2410852370 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c5c019b30 con 0x563913bfad90 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c58ff9640 1 -- 172.21.15.42:0/2410852370 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00eb70 con 0x563913bfad90 2024-03-31T23:20:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 -- 172.21.15.42:0/2410852370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 msgr2=0x563913c03430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c03430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009ca0 tx=0x7f6c5c011810 comp rx=0 tx=0).stop 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 -- 172.21.15.42:0/2410852370 shutdown_connections 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c05d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c03430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2410852370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913bfa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 -- 172.21.15.42:0/2410852370 >> 172.21.15.42:0/2410852370 conn(0x563913bf4ba0 msgr2=0x563913bf4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 -- 172.21.15.42:0/2410852370 shutdown_connections 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.502+0000 7f6c73b99740 1 -- 172.21.15.42:0/2410852370 wait complete. 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 -- start start 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 Processor -- start 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c00a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c00f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913c01480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563913c06760 con 0x563913bfa470 2024-03-31T23:20:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563913afc470 con 0x563913bfad90 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563913c068e0 con 0x563913c03970 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c73b99740 10 client.0 _ll_register_callbacks cb 0x563913b19cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c00a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c00a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39328/0 (socket says 172.21.15.42:39328) 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 -- 172.21.15.42:0/520670803 learned_addr learned my addr 172.21.15.42:0/520670803 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c00f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913c01480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 -- 172.21.15.42:0/520670803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 msgr2=0x563913c01480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913c01480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 -- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 msgr2=0x563913c00f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c00f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.503+0000 7f6c6a59c640 1 -- 172.21.15.42:0/520670803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639138723f0 con 0x563913bfa470 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c00a00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e670 tx=0x7f6c5c005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f3ca506d01700e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c51ffb640 1 -- 172.21.15.42:0/520670803 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c01e050 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c51ffb640 1 -- 172.21.15.42:0/520670803 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f6c5c005040 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c5c019b30 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c51ffb640 1 -- 172.21.15.42:0/520670803 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6c5c033050 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 10 client.16635 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56391393c7d0 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c51ffb640 1 -- 172.21.15.42:0/520670803 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c5c019b30 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c51ffb640 1 -- 172.21.15.42:0/520670803 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f6c5c004750 con 0x563913bfa470 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 10 client.16635 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 10 client.16635 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 20 client.16635 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c138f0 0x563913c15ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 4 client.16635 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.504+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563913b6b6f0 con 0x563913c138f0 2024-03-31T23:20:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.505+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c138f0 0x563913c15ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.505+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c138f0 0x563913c15ce0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6bee11a285d8f76d server_cookie=7713ea419ca2fdd2 in_seq=0 out_seq=0 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.505+0000 7f6c51ffb640 10 client.16635 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.505+0000 7f6c51ffb640 1 -- 172.21.15.42:0/520670803 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563913b6b6f0 con 0x563913c138f0 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.505+0000 7f6c51ffb640 10 client.16635 handle_command_reply: tid=0 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 client.16635 shutdown 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 msgr2=0x563913c00a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c00a00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e670 tx=0x7f6c5c005da0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 shutdown_connections 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c138f0 0x563913c15ce0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913c01480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c00f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c51ffb640 0 client.16635 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 --2- 172.21.15.42:0/520670803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c00a00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 >> 172.21.15.42:0/520670803 conn(0x563913bf4ba0 msgr2=0x563913bf68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 shutdown_connections 2024-03-31T23:20:44.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 1 -- 172.21.15.42:0/520670803 wait complete. 2024-03-31T23:20:44.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.506+0000 7f6c73b99740 20 client.16635 trim_cache size 0 max 16384 2024-03-31T23:20:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 Processor -- start 2024-03-31T23:20:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 -- start start 2024-03-31T23:20:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c0f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c1b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913bf3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1aec60 con 0x563913bfa470 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1b0a70 con 0x563913bfad90 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c73b99740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1af3f0 con 0x563913c03970 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c0f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c6ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913bf3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c69d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c1b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c6ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913bf3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:51086/0 (socket says 172.21.15.42:51086) 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 -- 172.21.15.42:0/2368151233 learned_addr learned my addr 172.21.15.42:0/2368151233 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c69d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c1b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:51294/0 (socket says 172.21.15.42:51294) 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.520+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c0f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39342/0 (socket says 172.21.15.42:39342) 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 -- 172.21.15.42:0/2368151233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 msgr2=0x563913c1b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c1b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 -- 172.21.15.42:0/2368151233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 msgr2=0x563913c0f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c0f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 -- 172.21.15.42:0/2368151233 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563913bf0460 con 0x563913c03970 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c0f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913bf3bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c64036000 tx=0x7f6c6402e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1e9e6041e6efee server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c53fff640 1 -- 172.21.15.42:0/2368151233 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64039040 con 0x563913c03970 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c53fff640 1 -- 172.21.15.42:0/2368151233 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c64055070 con 0x563913c03970 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.521+0000 7f6c53fff640 1 -- 172.21.15.42:0/2368151233 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640507e0 con 0x563913c03970 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 -- 172.21.15.42:0/2368151233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 msgr2=0x563913bf3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913bf3bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c64036000 tx=0x7f6c6402e040 comp rx=0 tx=0).stop 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 -- 172.21.15.42:0/2368151233 shutdown_connections 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913c03970 0x563913bf3bc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913bfad90 0x563913c1b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 --2- 172.21.15.42:0/2368151233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c0f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 -- 172.21.15.42:0/2368151233 >> 172.21.15.42:0/2368151233 conn(0x563913bf4ba0 msgr2=0x563913bf34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 -- 172.21.15.42:0/2368151233 shutdown_connections 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 -- 172.21.15.42:0/2368151233 wait complete. 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 -- start start 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.522+0000 7f6c73b99740 1 Processor -- start 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c07570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c07ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c07ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1b02e0 con 0x563913bfa470 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1afb50 con 0x563913c03970 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1acc20 con 0x563913bfad90 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 10 client.0 _ll_register_callbacks cb 0x7f6c600972d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c07570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c07570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39344/0 (socket says 172.21.15.42:39344) 2024-03-31T23:20:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 -- 172.21.15.42:0/323656364 learned_addr learned my addr 172.21.15.42:0/323656364 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c07ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c07ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 -- 172.21.15.42:0/323656364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 msgr2=0x563913c07ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c07ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 -- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 msgr2=0x563913c07ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c07ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 -- 172.21.15.42:0/323656364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563913c78c60 con 0x563913bfa470 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c07ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6ad9d640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c07ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c6a59c640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c07570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c004b20 tx=0x7f6c5c009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d03e9a183afdea8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c51ffb640 1 -- 172.21.15.42:0/323656364 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c01e040 con 0x563913bfa470 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c51ffb640 1 -- 172.21.15.42:0/323656364 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f6c5c004830 con 0x563913bfa470 2024-03-31T23:20:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c64055070 con 0x563913bfa470 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.523+0000 7f6c51ffb640 1 -- 172.21.15.42:0/323656364 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6c5c044050 con 0x563913bfa470 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 10 client.16641 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563913c79f40 con 0x563913bfa470 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c51ffb640 1 -- 172.21.15.42:0/323656364 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c64055070 con 0x563913bfa470 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c51ffb640 1 -- 172.21.15.42:0/323656364 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f6c5c03f030 con 0x563913bfa470 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 10 client.16641 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 10 client.16641 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 20 client.16641 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c7a7d0 0x563913c7cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 4 client.16641 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 --> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563913b65a40 con 0x563913c7a7d0 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c7a7d0 0x563913c7cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c69d9b640 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c7a7d0 0x563913c7cbf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7266a24c16b98b8f server_cookie=21dd129c6a6ddb20 in_seq=0 out_seq=0 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.524+0000 7f6c51ffb640 10 client.16641 ms_handle_connect on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c51ffb640 1 -- 172.21.15.42:0/323656364 <== mds.2 v2:172.21.15.94:6836/2576498268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+11521 (crc 0 0 0) 0x563913b65a40 con 0x563913c7a7d0 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c51ffb640 10 client.16641 handle_command_reply: tid=0 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 client.16641 shutdown 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 msgr2=0x563913c07570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c07570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c004b20 tx=0x7f6c5c009690 comp rx=0 tx=0).stop 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 shutdown_connections 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:6836/2576498268,v1:172.21.15.94:6837/2576498268] conn(0x563913c7a7d0 0x563913c7cbf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563913c03970 0x563913c07ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c51ffb640 0 client.16641 ms_handle_reset on v2:172.21.15.94:6836/2576498268 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563913bfad90 0x563913c07ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 --2- 172.21.15.42:0/323656364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563913bfa470 0x563913c07570 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 >> 172.21.15.42:0/323656364 conn(0x563913bf4ba0 msgr2=0x563913bf6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 shutdown_connections 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 1 -- 172.21.15.42:0/323656364 wait complete. 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c73b99740 20 client.16641 trim_cache size 0 max 16384 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 26686829, 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631423, 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/laptops" 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 198129083, 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631676, 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2" 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 209860566, 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631037, 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/pohmelfs" 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.534 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 366618619, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631785, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/s390" 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 411333611, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632030, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/postprocess" 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 490684355, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631738, 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/powerpc" 2024-03-31T23:20:44.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 733354233, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630873, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/driver-model" 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 787911685, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628974, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/auxdisplay" 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.536 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 870233173, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632005, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers" 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 875429055, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631474, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/memory-devices" 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 922295830, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631996, 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/thermal" 2024-03-31T23:20:44.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1098264676, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631016, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/nfs" 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1166910310, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631528, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/namespaces" 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.538 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1222872134, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632248, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/wimax" 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1338748727, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631065, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/firmware_class" 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1423555430, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631774, 2024-03-31T23:20:44.539 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/rapidio" 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1427977444, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631095, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio" 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1488059514, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631764, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pti" 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.540 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1491967418, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631886, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial" 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1856916145, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632277, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/xtensa" 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1915129779, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628986, 2024-03-31T23:20:44.541 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blackfin" 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1961354446, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631927, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/soc" 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2132267479, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630972, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/cifs" 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2143362119, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630980, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/configfs" 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2170037842, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631513, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mmc" 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2240383973, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632019, 2024-03-31T23:20:44.543 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace" 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2325688787, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632077, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vDSO" 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2535417857, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631992, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/target" 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.544 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2548473035, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631900, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound" 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2679042563, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631964, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/spi" 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2723671920, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631391, 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ja_JP" 2024-03-31T23:20:44.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2778980192, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632040, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/usb" 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2901817142, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631938, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/oss" 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.546 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3024406236, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630964, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/caching" 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3067879939, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631491, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mips" 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3118286672, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631896, 2024-03-31T23:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh" 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3170097294, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631312, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband" 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3252304207, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631800, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scheduler" 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3292006634, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631320, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input" 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3328252056, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632252, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86" 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3351357155, 2024-03-31T23:20:44.549 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629041, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cgroups" 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3656090942, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630949, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems" 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3710695727, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630907, 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/extcon" 2024-03-31T23:20:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3736793059, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632259, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386" 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3869015510, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632266, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64" 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3908015195, 2024-03-31T23:20:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631871, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/security" 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3930549333, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628846, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting" 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4006744840, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631112, 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/hwmon" 2024-03-31T23:20:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4279229863, 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631901, 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa" 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:20:44.553 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-03-31T23:20:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.525+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6c540a2610 msgr2=0x7f6c540a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6c540a2610 0x7f6c540a4ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005cc0 tx=0x7f6c64005c50 comp rx=0 tx=0).stop 2024-03-31T23:20:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 msgr2=0x7f6c6c198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c198680 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e9f0 tx=0x7f6c6000eeb0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 shutdown_connections 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c6c106680 0x7f6c6c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6c540a2610 0x7f6c540a4ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c6c101030 0x7f6c6c198680 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 --2- 172.21.15.42:0/397461193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c6c100670 0x7f6c6c198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 >> 172.21.15.42:0/397461193 conn(0x7f6c6c0777b0 msgr2=0x7f6c6c069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 shutdown_connections 2024-03-31T23:20:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.526+0000 7f6c70ed4640 1 -- 172.21.15.42:0/397461193 wait complete. 2024-03-31T23:20:44.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-31T23:20:44.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 -- 172.21.15.42:0/1280949625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea68100f80 msgr2=0x7fea6810d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 --2- 172.21.15.42:0/1280949625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea68100f80 0x7fea6810d490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea60009cd0 tx=0x7fea6002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 -- 172.21.15.42:0/1280949625 shutdown_connections 2024-03-31T23:20:44.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 --2- 172.21.15.42:0/1280949625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea68100f80 0x7fea6810d490 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 --2- 172.21.15.42:0/1280949625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea681005c0 0x7fea68100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 --2- 172.21.15.42:0/1280949625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea68106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 -- 172.21.15.42:0/1280949625 >> 172.21.15.42:0/1280949625 conn(0x7fea68077750 msgr2=0x7fea68077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 -- 172.21.15.42:0/1280949625 shutdown_connections 2024-03-31T23:20:44.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 -- 172.21.15.42:0/1280949625 wait complete. 2024-03-31T23:20:44.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 Processor -- start 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.663+0000 7fea6d640640 1 -- start start 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea681005c0 0x7fea68198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea68100f80 0x7fea681993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea681a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea68110b00 con 0x7fea68106660 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea68110980 con 0x7fea68100f80 2024-03-31T23:20:44.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea68110c80 con 0x7fea681005c0 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea681a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea681005c0 0x7fea68198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea68100f80 0x7fea681993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea681005c0 0x7fea68198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:51120/0 (socket says 172.21.15.42:51120) 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea66ffd640 1 -- 172.21.15.42:0/2816570719 learned_addr learned my addr 172.21.15.42:0/2816570719 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea681a3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39370/0 (socket says 172.21.15.42:39370) 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 -- 172.21.15.42:0/2816570719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea681005c0 msgr2=0x7fea68198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea681005c0 0x7fea68198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 -- 172.21.15.42:0/2816570719 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea68100f80 msgr2=0x7fea681993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea68100f80 0x7fea681993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 -- 172.21.15.42:0/2816570719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea681a4440 con 0x7fea68106660 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea677fe640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea681a3f00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fea6002c630 tx=0x7fea60034440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea64ff9640 1 -- 172.21.15.42:0/2816570719 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60039040 con 0x7fea68106660 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea681a4610 con 0x7fea68106660 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea64ff9640 1 -- 172.21.15.42:0/2816570719 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea60044070 con 0x7fea68106660 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea64ff9640 1 -- 172.21.15.42:0/2816570719 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea600043a0 con 0x7fea68106660 2024-03-31T23:20:44.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.664+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea681a4a20 con 0x7fea68106660 2024-03-31T23:20:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.667+0000 7fea64ff9640 1 -- 172.21.15.42:0/2816570719 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fea60003b00 con 0x7fea68106660 2024-03-31T23:20:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.667+0000 7fea70223740 1 Processor -- start 2024-03-31T23:20:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.667+0000 7fea70223740 1 -- start start 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.667+0000 7fea64ff9640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fea540a2610 0x7fea540a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.667+0000 7fea5ffff640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fea540a2610 0x7fea540a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.667+0000 7fea64ff9640 1 -- 172.21.15.42:0/2816570719 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fea600f1210 con 0x7fea68106660 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea70223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfe9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea70223740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cff2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea70223740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cff4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea70223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559c7cf4d1b0 con 0x559c7cfe9470 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea70223740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559c7cef5c00 con 0x559c7cff2970 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea70223740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559c7cf49250 con 0x559c7cfe9d90 2024-03-31T23:20:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfe9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cff2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfe9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39378/0 (socket says 172.21.15.42:39378) 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 -- 172.21.15.42:0/53693842 learned_addr learned my addr 172.21.15.42:0/53693842 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea677fe640 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cff4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 -- 172.21.15.42:0/53693842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 msgr2=0x559c7cff2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cff2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 -- 172.21.15.42:0/53693842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 msgr2=0x559c7cff4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cff4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 -- 172.21.15.42:0/53693842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7cf153d0 con 0x559c7cfe9470 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea5ffff640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fea540a2610 0x7fea540a4ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea680693b0 tx=0x7fea50011920 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea66ffd640 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfe9850 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fea58009cf0 tx=0x7fea58011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90148998288436b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea5d7fa640 1 -- 172.21.15.42:0/53693842 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5801e070 con 0x559c7cfe9470 2024-03-31T23:20:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea5d7fa640 1 -- 172.21.15.42:0/53693842 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea58009de0 con 0x559c7cfe9470 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.668+0000 7fea5d7fa640 1 -- 172.21.15.42:0/53693842 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea580196b0 con 0x559c7cfe9470 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 -- 172.21.15.42:0/53693842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 msgr2=0x559c7cfe9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfe9850 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fea58009cf0 tx=0x7fea58011810 comp rx=0 tx=0).stop 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 -- 172.21.15.42:0/53693842 shutdown_connections 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cff4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cff2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 --2- 172.21.15.42:0/53693842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfe9850 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 -- 172.21.15.42:0/53693842 >> 172.21.15.42:0/53693842 conn(0x559c7cfe3ba0 msgr2=0x559c7cfe3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 -- 172.21.15.42:0/53693842 shutdown_connections 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 -- 172.21.15.42:0/53693842 wait complete. 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.669+0000 7fea70223740 1 -- start start 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 Processor -- start 2024-03-31T23:20:44.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9d90 0x559c7cfeff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cff0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559c7cff5760 con 0x559c7cfe9470 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x559c7ceeb470 con 0x559c7cfe9d90 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559c7cff58e0 con 0x559c7cff2970 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea70223740 10 client.0 _ll_register_callbacks cb 0x559c7cf08cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfef9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39394/0 (socket says 172.21.15.42:39394) 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 -- 172.21.15.42:0/2637638170 learned_addr learned my addr 172.21.15.42:0/2637638170 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea677fe640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cff0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea5ffff640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9d90 0x559c7cfeff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 -- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 msgr2=0x559c7cff0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cff0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 -- 172.21.15.42:0/2637638170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9d90 msgr2=0x559c7cfeff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9d90 0x559c7cfeff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 -- 172.21.15.42:0/2637638170 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7cc613f0 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea66ffd640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfef9f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fea58011d10 tx=0x7fea580052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73892ed918a2547b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.670+0000 7fea4e7fc640 1 -- 172.21.15.42:0/2637638170 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58026020 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea4e7fc640 1 -- 172.21.15.42:0/2637638170 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fea580054e0 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea58009de0 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea4e7fc640 1 -- 172.21.15.42:0/2637638170 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fea58031050 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 10 client.16653 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559c7cd2b7d0 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea4e7fc640 1 -- 172.21.15.42:0/2637638170 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea58009de0 con 0x559c7cfe9470 2024-03-31T23:20:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea4e7fc640 1 -- 172.21.15.42:0/2637638170 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fea58021030 con 0x559c7cfe9470 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 10 client.16653 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 10 client.16653 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 20 client.16653 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d002950 0x559c7d004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 4 client.16653 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c7cf5a6f0 con 0x559c7d002950 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.671+0000 7fea5ffff640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d002950 0x559c7d004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea4e7fc640 10 client.16653 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea5ffff640 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d002950 0x559c7d004d40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b8344e72035c5e3 server_cookie=a30bcfc2acbd4a28 in_seq=0 out_seq=0 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea4e7fc640 1 -- 172.21.15.42:0/2637638170 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559c7cf5a6f0 con 0x559c7d002950 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea4e7fc640 10 client.16653 handle_command_reply: tid=0 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 client.16653 shutdown 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 msgr2=0x559c7cfef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfef9f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fea58011d10 tx=0x7fea580052f0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 shutdown_connections 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d002950 0x559c7d004d40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cff0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9d90 0x559c7cfeff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea4e7fc640 0 client.16653 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 --2- 172.21.15.42:0/2637638170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cfef9f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.672+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 >> 172.21.15.42:0/2637638170 conn(0x559c7cfe3ba0 msgr2=0x559c7cfe58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.673+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 shutdown_connections 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.673+0000 7fea70223740 1 -- 172.21.15.42:0/2637638170 wait complete. 2024-03-31T23:20:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.673+0000 7fea70223740 20 client.16653 trim_cache size 0 max 16384 2024-03-31T23:20:44.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.686+0000 7fea70223740 1 Processor -- start 2024-03-31T23:20:44.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 -- start start 2024-03-31T23:20:44.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cff2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cffaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cfdebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea681aebd0 con 0x559c7cfe9470 2024-03-31T23:20:44.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea681b09e0 con 0x559c7cff2970 2024-03-31T23:20:44.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea70223740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea681af360 con 0x559c7cfe9d90 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cff2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cff2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39410/0 (socket says 172.21.15.42:39410) 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 -- 172.21.15.42:0/3791505176 learned_addr learned my addr 172.21.15.42:0/3791505176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea677fe640 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cfdebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea5ffff640 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cffaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 -- 172.21.15.42:0/3791505176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 msgr2=0x559c7cffaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cffaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 -- 172.21.15.42:0/3791505176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 msgr2=0x559c7cfdebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cfdebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 -- 172.21.15.42:0/3791505176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7cfee9a0 con 0x559c7cfe9470 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea5ffff640 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cffaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.687+0000 7fea66ffd640 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cff2120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fea580058c0 tx=0x7fea580194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8a9d30ba85043c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea5cff9640 1 -- 172.21.15.42:0/3791505176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58016020 con 0x559c7cfe9470 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea5cff9640 1 -- 172.21.15.42:0/3791505176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea58004ce0 con 0x559c7cfe9470 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea5cff9640 1 -- 172.21.15.42:0/3791505176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58026070 con 0x559c7cfe9470 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 -- 172.21.15.42:0/3791505176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 msgr2=0x559c7cff2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cff2120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fea580058c0 tx=0x7fea580194b0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 -- 172.21.15.42:0/3791505176 shutdown_connections 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cff2970 0x559c7cfdebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cfe9d90 0x559c7cffaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 --2- 172.21.15.42:0/3791505176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9470 0x559c7cff2120 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 -- 172.21.15.42:0/3791505176 >> 172.21.15.42:0/3791505176 conn(0x559c7cfe3ba0 msgr2=0x559c7cfe2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 -- 172.21.15.42:0/3791505176 shutdown_connections 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.688+0000 7fea70223740 1 -- 172.21.15.42:0/3791505176 wait complete. 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 -- start start 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 Processor -- start 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9470 0x559c7cfed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 0x559c7cfebc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cfec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea681b0250 con 0x559c7cfe9d90 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea681afac0 con 0x559c7cfe9470 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea681acb90 con 0x559c7cff2970 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea70223740 10 client.0 _ll_register_callbacks cb 0x7fea500099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 0x559c7cfebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 0x559c7cfebc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39416/0 (socket says 172.21.15.42:39416) 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 -- 172.21.15.42:0/200134477 learned_addr learned my addr 172.21.15.42:0/200134477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea66ffd640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9470 0x559c7cfed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea677fe640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cfec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 -- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 msgr2=0x559c7cfec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cfec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 -- 172.21.15.42:0/200134477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9470 msgr2=0x559c7cfed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9470 0x559c7cfed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.689+0000 7fea5ffff640 1 -- 172.21.15.42:0/200134477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7cfe9bc0 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea5ffff640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 0x559c7cfebc60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fea50009aa0 tx=0x7fea50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaa0772d4f8cffb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea4e7fc640 1 -- 172.21.15.42:0/200134477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5001a040 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea4e7fc640 1 -- 172.21.15.42:0/200134477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fea5000fa50 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea58004ce0 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea4e7fc640 1 -- 172.21.15.42:0/200134477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fea5003b050 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 10 client.16659 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559c7d0050b0 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea4e7fc640 1 -- 172.21.15.42:0/200134477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea58004ce0 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea4e7fc640 1 -- 172.21.15.42:0/200134477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fea5001d030 con 0x559c7cfe9d90 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 10 client.16659 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 10 client.16659 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-31T23:20:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 20 client.16659 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d06e060 0x559c7d070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 4 client.16659 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.690+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 --> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c7cf54a40 con 0x559c7d06e060 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea66ffd640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d06e060 0x559c7d070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea66ffd640 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d06e060 0x559c7d070480 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90c9aff18f57d05e server_cookie=56b4d02516c8793b in_seq=0 out_seq=0 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea4e7fc640 10 client.16659 ms_handle_connect on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea4e7fc640 1 -- 172.21.15.42:0/200134477 <== mds.1 v2:172.21.15.188:6838/2041061045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+13974 (crc 0 0 0) 0x559c7cf54a40 con 0x559c7d06e060 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea4e7fc640 10 client.16659 handle_command_reply: tid=0 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 client.16659 shutdown 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 msgr2=0x559c7cfebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 0x559c7cfebc60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fea50009aa0 tx=0x7fea50004730 comp rx=0 tx=0).stop 2024-03-31T23:20:44.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 shutdown_connections 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:6838/2041061045,v1:172.21.15.188:6839/2041061045] conn(0x559c7d06e060 0x559c7d070480 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c7cff2970 0x559c7cfec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea4e7fc640 0 client.16659 ms_handle_reset on v2:172.21.15.188:6838/2041061045 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.691+0000 7fea70223740 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c7cfe9d90 0x559c7cfebc60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea70223740 1 --2- 172.21.15.42:0/200134477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559c7cfe9470 0x559c7cfed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 >> 172.21.15.42:0/200134477 conn(0x559c7cfe3ba0 msgr2=0x559c7cfef990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 shutdown_connections 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea70223740 1 -- 172.21.15.42:0/200134477 wait complete. 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea70223740 20 client.16659 trim_cache size 0 max 16384 2024-03-31T23:20:44.699 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 17078459, 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632219, 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/masters" 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 108326420, 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631081, 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/frv" 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 199708860, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628820, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU" 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 201352695, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630884, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dvb" 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 606546248, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629064, 2024-03-31T23:20:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/console" 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 646328528, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628302, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed" 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 696579399, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631613, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/mac80211_hwsim" 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 777426991, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629035, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cdrom" 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 794180261, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632129, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx2341x" 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 953336272, 2024-03-31T23:20:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631494, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices" 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1291204607, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631702, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/platform" 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1350743073, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631290, 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ia64" 2024-03-31T23:20:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1401457630, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631416, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ko_KR" 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1518420608, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628812, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI" 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1710668914, 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631654, 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/timestamping" 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1729309631, 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631251, 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/busses" 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1852036597, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629058, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/connector" 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2001560740, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631524, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/nand" 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2057507626, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631752, 2024-03-31T23:20:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pps" 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2063114807, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630913, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fb" 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2073072502, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632167, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm" 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2075272106, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629031, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/bus-devices" 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2147471103, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631537, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking" 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2255803278, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632109, 2024-03-31T23:20:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/bttv" 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2329558954, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631766, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ptp" 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2344491472, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628295, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete" 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2401930991, 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628310, 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable" 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2463177086, 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628560, 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook" 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2472602542, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630900, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/early-userspace" 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2485290326, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631279, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/muxes" 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2519037830, 2024-03-31T23:20:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631811, 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi" 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2526694931, 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629089, 2024-03-31T23:20:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/crypto" 2024-03-31T23:20:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2653451380, 2024-03-31T23:20:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629411, 2024-03-31T23:20:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/st" 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2785587445, 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628585, 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb" 2024-03-31T23:20:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2799590939, 2024-03-31T23:20:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632086, 2024-03-31T23:20:44.717 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux" 2024-03-31T23:20:44.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.717 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.717 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3020991579, 2024-03-31T23:20:44.717 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632171, 2024-03-31T23:20:44.718 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/devices" 2024-03-31T23:20:44.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.718 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.718 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3126774065, 2024-03-31T23:20:44.718 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631559, 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/caif" 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3180696723, 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628293, 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI" 2024-03-31T23:20:44.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3205876959, 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632165, 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual" 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3240715226, 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629108, 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/device-mapper" 2024-03-31T23:20:44.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3296487531, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632217, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1" 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3343746043, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631399, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/kbuild" 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.721 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3358378464, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628606, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l" 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3425077258, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630867, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dmaengine" 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3507129003, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631673, 2024-03-31T23:20:44.722 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nfc" 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3515236119, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628580, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media" 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3644704437, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632140, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx88" 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3661539855, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632189, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/uml" 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3720177696, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631518, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mn10300" 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3886663783, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631250, 2024-03-31T23:20:44.724 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c" 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3958890556, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631862, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/scsi_transport_srp" 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3979913271, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511632226, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/slaves" 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.725 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4019574024, 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511628337, 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing" 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4029965908, 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631477, 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/metag" 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.726 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.727 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4068313032, 2024-03-31T23:20:44.727 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631523, 2024-03-31T23:20:44.727 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd" 2024-03-31T23:20:44.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.727 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4106948464, 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511629424, 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ti" 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4231562831, 2024-03-31T23:20:44.729 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631069, 2024-03-31T23:20:44.729 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fmc" 2024-03-31T23:20:44.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.729 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.729 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4268822147, 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631505, 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/mei" 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4294443766, 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511631437, 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/leds" 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:20:44.730 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-03-31T23:20:44.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fea540a2610 msgr2=0x7fea540a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fea540a2610 0x7fea540a4ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea680693b0 tx=0x7fea50011920 comp rx=0 tx=0).stop 2024-03-31T23:20:44.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 msgr2=0x7fea681a3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea681a3f00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fea6002c630 tx=0x7fea60034440 comp rx=0 tx=0).stop 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 shutdown_connections 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fea540a2610 0x7fea540a4ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea68106660 0x7fea681a3f00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea68100f80 0x7fea681993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 --2- 172.21.15.42:0/2816570719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea681005c0 0x7fea68198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 >> 172.21.15.42:0/2816570719 conn(0x7fea68077750 msgr2=0x7fea680fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 shutdown_connections 2024-03-31T23:20:44.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.692+0000 7fea6d640640 1 -- 172.21.15.42:0/2816570719 wait complete. 2024-03-31T23:20:44.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-31T23:20:44.803 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar c linux-4.0.5 2024-03-31T23:20:44.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 -- 172.21.15.42:0/1286387029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a0100fb0 msgr2=0x7fb4a010d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 --2- 172.21.15.42:0/1286387029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a0100fb0 0x7fb4a010d470 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb498009ca0 tx=0x7fb49802c180 comp rx=0 tx=0).stop 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 -- 172.21.15.42:0/1286387029 shutdown_connections 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 --2- 172.21.15.42:0/1286387029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a0100fb0 0x7fb4a010d470 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 --2- 172.21.15.42:0/1286387029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4a0100610 0x7fb4a0100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 --2- 172.21.15.42:0/1286387029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a01066b0 0x7fb4a0106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 -- 172.21.15.42:0/1286387029 >> 172.21.15.42:0/1286387029 conn(0x7fb4a00776e0 msgr2=0x7fb4a0077af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 -- 172.21.15.42:0/1286387029 shutdown_connections 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.843+0000 7fb4a5076640 1 -- 172.21.15.42:0/1286387029 wait complete. 2024-03-31T23:20:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.844+0000 7fb4a5076640 1 Processor -- start 2024-03-31T23:20:44.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.844+0000 7fb4a5076640 1 -- start start 2024-03-31T23:20:44.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a0100610 0x7fb4a019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4a0100fb0 0x7fb4a019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 0x7fb4a019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a0110b00 con 0x7fb4a01066b0 2024-03-31T23:20:44.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a0110980 con 0x7fb4a0100610 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a0110c80 con 0x7fb4a0100fb0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 0x7fb4a019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 0x7fb4a019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39440/0 (socket says 172.21.15.42:39440) 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 -- 172.21.15.42:0/2107593333 learned_addr learned my addr 172.21.15.42:0/2107593333 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a0100610 0x7fb4a019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49e59c640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4a0100fb0 0x7fb4a019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 -- 172.21.15.42:0/2107593333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4a0100fb0 msgr2=0x7fb4a019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4a0100fb0 0x7fb4a019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 -- 172.21.15.42:0/2107593333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a0100610 msgr2=0x7fb4a019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a0100610 0x7fb4a019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 -- 172.21.15.42:0/2107593333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a019f200 con 0x7fb4a01066b0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb49f59e640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 0x7fb4a019ead0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb498037040 tx=0x7fb498034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb487fff640 1 -- 172.21.15.42:0/2107593333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498039040 con 0x7fb4a01066b0 2024-03-31T23:20:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb487fff640 1 -- 172.21.15.42:0/2107593333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb498044070 con 0x7fb4a01066b0 2024-03-31T23:20:44.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a019f490 con 0x7fb4a01066b0 2024-03-31T23:20:44.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb487fff640 1 -- 172.21.15.42:0/2107593333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4980042a0 con 0x7fb4a01066b0 2024-03-31T23:20:44.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.845+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a01a6d80 con 0x7fb4a01066b0 2024-03-31T23:20:44.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb487fff640 1 -- 172.21.15.42:0/2107593333 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fb498032d20 con 0x7fb4a01066b0 2024-03-31T23:20:44.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 Processor -- start 2024-03-31T23:20:44.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 -- start start 2024-03-31T23:20:44.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584470 0x55897d584850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d58d970 0x55897d58fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55897d4e81b0 con 0x55897d58d970 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55897d490c00 con 0x55897d584470 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.848+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55897d4e4250 con 0x55897d584d90 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb487fff640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fb4880a2610 0x7fb4880a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d58d970 0x55897d58fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:51186/0 (socket says 172.21.15.42:51186) 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 -- 172.21.15.42:0/2166937577 learned_addr learned my addr 172.21.15.42:0/2166937577 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49f59e640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fb4880a2610 0x7fb4880a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49e59c640 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584470 0x55897d584850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb487fff640 1 -- 172.21.15.42:0/2107593333 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fb4980f10e0 con 0x7fb4a01066b0 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 -- 172.21.15.42:0/2166937577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584470 msgr2=0x55897d584850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584470 0x55897d584850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 -- 172.21.15.42:0/2166937577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d58d970 msgr2=0x55897d58fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d58d970 0x55897d58fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 -- 172.21.15.42:0/2166937577 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897d4b03d0 con 0x55897d584d90 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49e59c640 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d58d970 0x55897d58fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49f59e640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fb4880a2610 0x7fb4880a4ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb4980837f0 tx=0x7fb49808c530 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58d430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb490009c70 tx=0x7fb490011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4ec57e13d4ddac server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb4857fa640 1 -- 172.21.15.42:0/2166937577 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490004230 con 0x55897d584d90 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb4857fa640 1 -- 172.21.15.42:0/2166937577 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4900043d0 con 0x55897d584d90 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.849+0000 7fb4857fa640 1 -- 172.21.15.42:0/2166937577 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4900197d0 con 0x55897d584d90 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 -- 172.21.15.42:0/2166937577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 msgr2=0x55897d58d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58d430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb490009c70 tx=0x7fb490011810 comp rx=0 tx=0).stop 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 -- 172.21.15.42:0/2166937577 shutdown_connections 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d58d970 0x55897d58fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58d430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/2166937577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584470 0x55897d584850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 -- 172.21.15.42:0/2166937577 >> 172.21.15.42:0/2166937577 conn(0x55897d57eba0 msgr2=0x55897d57ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 -- 172.21.15.42:0/2166937577 shutdown_connections 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 -- 172.21.15.42:0/2166937577 wait complete. 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.850+0000 7fb4a7c58740 1 -- start start 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 Processor -- start 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d58b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55897d590760 con 0x55897d584470 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55897d486470 con 0x55897d58d970 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55897d5908e0 con 0x55897d584d90 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb4a7c58740 10 client.0 _ll_register_callbacks cb 0x55897d4a3cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39446/0 (socket says 172.21.15.42:39446) 2024-03-31T23:20:44.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 -- 172.21.15.42:0/3675482237 learned_addr learned my addr 172.21.15.42:0/3675482237 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d58b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 -- 172.21.15.42:0/3675482237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 msgr2=0x55897d58ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 -- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 msgr2=0x55897d58b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d58b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 -- 172.21.15.42:0/3675482237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897d1fc3f0 con 0x55897d584470 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58a930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb494009ef0 tx=0x7fb494004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6621a229bbb5cd80 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.851+0000 7fb482ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb482ff5640 1 -- 172.21.15.42:0/3675482237 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494012110 con 0x55897d584470 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb482ff5640 1 -- 172.21.15.42:0/3675482237 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fb494004030 con 0x55897d584470 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4900043d0 con 0x55897d584470 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb482ff5640 1 -- 172.21.15.42:0/3675482237 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb494027050 con 0x55897d584470 2024-03-31T23:20:44.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 10 client.16671 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55897d2c67d0 con 0x55897d584470 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb482ff5640 1 -- 172.21.15.42:0/3675482237 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4900043d0 con 0x55897d584470 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb482ff5640 1 -- 172.21.15.42:0/3675482237 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fb494010430 con 0x55897d584470 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 10 client.16671 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 20 client.16671 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d59da60 0x55897d59feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 4 client.16671 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55897d4f56f0 con 0x55897d59da60 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.852+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d59da60 0x55897d59feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.853+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d59da60 0x55897d59feb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6def0e801b876a02 server_cookie=55de6fa5256f135f in_seq=0 out_seq=0 2024-03-31T23:20:44.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.853+0000 7fb482ff5640 10 client.16671 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:44.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb482ff5640 1 -- 172.21.15.42:0/3675482237 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55897d4f56f0 con 0x55897d59da60 2024-03-31T23:20:44.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb482ff5640 10 client.16671 handle_command_reply: tid=0 2024-03-31T23:20:44.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 client.16671 shutdown 2024-03-31T23:20:44.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 msgr2=0x55897d58a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58a930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb494009ef0 tx=0x7fb494004730 comp rx=0 tx=0).stop 2024-03-31T23:20:44.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 shutdown_connections 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d59da60 0x55897d59feb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d58b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3675482237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58a930 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 >> 172.21.15.42:0/3675482237 conn(0x55897d57eba0 msgr2=0x55897d5808f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb482ff5640 0 client.16671 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 shutdown_connections 2024-03-31T23:20:44.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3675482237 wait complete. 2024-03-31T23:20:44.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.855+0000 7fb4a7c58740 20 client.16671 trim_cache size 0 max 16384 2024-03-31T23:20:44.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 Processor -- start 2024-03-31T23:20:44.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 -- start start 2024-03-31T23:20:44.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d599560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01b0e00 con 0x55897d584470 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01b2c10 con 0x55897d58d970 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01b1590 con 0x55897d584d90 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39462/0 (socket says 172.21.15.42:39462) 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb49e59c640 1 -- 172.21.15.42:0/3004964927 learned_addr learned my addr 172.21.15.42:0/3004964927 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.868+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d599560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb49e59c640 1 -- 172.21.15.42:0/3004964927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 msgr2=0x55897d58a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb49e59c640 1 -- 172.21.15.42:0/3004964927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 msgr2=0x55897d599560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d599560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb49e59c640 1 -- 172.21.15.42:0/3004964927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897d59c530 con 0x55897d584470 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb49e59c640 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58d060 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb494012a80 tx=0x7fb494005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c4fdfb10ea8816 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb484ff9640 1 -- 172.21.15.42:0/3004964927 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494012110 con 0x55897d584470 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb484ff9640 1 -- 172.21.15.42:0/3004964927 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb494010430 con 0x55897d584470 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb484ff9640 1 -- 172.21.15.42:0/3004964927 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494004ae0 con 0x55897d584470 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3004964927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 msgr2=0x55897d58d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.869+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58d060 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb494012a80 tx=0x7fb494005970 comp rx=0 tx=0).stop 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3004964927 shutdown_connections 2024-03-31T23:20:44.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d58d970 0x55897d599560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d584d90 0x55897d58a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/3004964927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d58d060 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3004964927 >> 172.21.15.42:0/3004964927 conn(0x55897d57eba0 msgr2=0x55897d57dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3004964927 shutdown_connections 2024-03-31T23:20:44.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- 172.21.15.42:0/3004964927 wait complete. 2024-03-31T23:20:44.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- start start 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 Processor -- start 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d588130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584d90 0x55897d586ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d58d970 0x55897d5870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01b2480 con 0x55897d584470 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01b1cf0 con 0x55897d584d90 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01aedc0 con 0x55897d58d970 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb4a7c58740 10 client.0 _ll_register_callbacks cb 0x7fb494012970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:44.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d588130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d588130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39468/0 (socket says 172.21.15.42:39468) 2024-03-31T23:20:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb49e59c640 1 -- 172.21.15.42:0/1157388369 learned_addr learned my addr 172.21.15.42:0/1157388369 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584d90 0x55897d586ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.870+0000 7fb49e59c640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d58d970 0x55897d5870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb49e59c640 1 -- 172.21.15.42:0/1157388369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d58d970 msgr2=0x55897d5870e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb49e59c640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d58d970 0x55897d5870e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb49e59c640 1 -- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584d90 msgr2=0x55897d586ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb49e59c640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584d90 0x55897d586ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb49e59c640 1 -- 172.21.15.42:0/1157388369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897d588670 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb49e59c640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d588130 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb4940095f0 tx=0x7fb4940048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a589a0eec725476e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb482ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb482ff5640 1 -- 172.21.15.42:0/1157388369 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4940105e0 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb482ff5640 1 -- 172.21.15.42:0/1157388369 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7fb49401f070 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb494010430 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb482ff5640 1 -- 172.21.15.42:0/1157388369 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb494038460 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 10 client.16677 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55897d6034e0 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb482ff5640 1 -- 172.21.15.42:0/1157388369 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb494010430 con 0x55897d584470 2024-03-31T23:20:44.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb482ff5640 1 -- 172.21.15.42:0/1157388369 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fb49403a7c0 con 0x55897d584470 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 10 client.16677 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 20 client.16677 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d603b70 0x55897d605f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 4 client.16677 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.871+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55897d4efa40 con 0x55897d603b70 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.872+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d603b70 0x55897d605f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.872+0000 7fb482ff5640 10 client.16677 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:44.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.872+0000 7fb49ed9d640 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d603b70 0x55897d605f90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d78383fa9890c376 server_cookie=2dd3e443ad0f3851 in_seq=0 out_seq=0 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.873+0000 7fb482ff5640 1 -- 172.21.15.42:0/1157388369 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55897d4efa40 con 0x55897d603b70 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.873+0000 7fb482ff5640 10 client.16677 handle_command_reply: tid=0 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.873+0000 7fb4a7c58740 1 client.16677 shutdown 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.873+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 msgr2=0x55897d588130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.873+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d588130 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb4940095f0 tx=0x7fb4940048e0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 shutdown_connections 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55897d603b70 0x55897d605f90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55897d58d970 0x55897d5870e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb482ff5640 0 client.16677 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55897d584d90 0x55897d586ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 --2- 172.21.15.42:0/1157388369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55897d584470 0x55897d588130 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 >> 172.21.15.42:0/1157388369 conn(0x55897d57eba0 msgr2=0x55897d58a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 shutdown_connections 2024-03-31T23:20:44.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 1 -- 172.21.15.42:0/1157388369 wait complete. 2024-03-31T23:20:44.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a7c58740 20 client.16677 trim_cache size 0 max 16384 2024-03-31T23:20:44.885 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-03-31T23:20:44.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fb4880a2610 msgr2=0x7fb4880a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fb4880a2610 0x7fb4880a4ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb4980837f0 tx=0x7fb49808c530 comp rx=0 tx=0).stop 2024-03-31T23:20:44.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 msgr2=0x7fb4a019ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:44.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 0x7fb4a019ead0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb498037040 tx=0x7fb498034670 comp rx=0 tx=0).stop 2024-03-31T23:20:44.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 shutdown_connections 2024-03-31T23:20:44.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fb4880a2610 0x7fb4880a4ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4a01066b0 0x7fb4a019ead0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4a0100fb0 0x7fb4a019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 --2- 172.21.15.42:0/2107593333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a0100610 0x7fb4a019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 >> 172.21.15.42:0/2107593333 conn(0x7fb4a00776e0 msgr2=0x7fb4a0069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 shutdown_connections 2024-03-31T23:20:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:20:44.874+0000 7fb4a5076640 1 -- 172.21.15.42:0/2107593333 wait complete. 2024-03-31T23:20:44.889 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 4301020, 'ino': 1099511633016, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt'}, {'damage_type': 'backtrace', 'id': 4625427, 'ino': 1099511632729, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt'}, {'damage_type': 'backtrace', 'id': 32074646, 'ino': 1099511632742, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt'}, {'damage_type': 'backtrace', 'id': 66618238, 'ino': 1099511632736, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt'}, {'damage_type': 'backtrace', 'id': 80448036, 'ino': 1099511632760, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt'}, {'damage_type': 'backtrace', 'id': 125713755, 'ino': 1099511633021, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt'}, {'damage_type': 'backtrace', 'id': 139240011, 'ino': 1099511633133, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt'}, {'damage_type': 'backtrace', 'id': 142148835, 'ino': 1099511633095, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt'}, {'damage_type': 'backtrace', 'id': 143888670, 'ino': 1099511632754, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt'}, {'damage_type': 'backtrace', 'id': 185263699, 'ino': 1099511633143, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt'}, {'damage_type': 'backtrace', 'id': 229468411, 'ino': 1099511633076, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt'}, {'damage_type': 'backtrace', 'id': 232638249, 'ino': 1099511632722, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt'}, {'damage_type': 'backtrace', 'id': 248829660, 'ino': 1099511633073, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt'}, {'damage_type': 'backtrace', 'id': 249513673, 'ino': 1099511633122, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt'}, {'damage_type': 'backtrace', 'id': 257388063, 'ino': 1099511629013, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blockdev/drbd'}, {'damage_type': 'backtrace', 'id': 261676986, 'ino': 1099511632743, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt'}, {'damage_type': 'backtrace', 'id': 348756532, 'ino': 1099511632731, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt'}, {'damage_type': 'backtrace', 'id': 375466605, 'ino': 1099511633011, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt'}, {'damage_type': 'backtrace', 'id': 386007076, 'ino': 1099511633110, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt'}, {'damage_type': 'backtrace', 'id': 408961844, 'ino': 1099511633069, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt'}, {'damage_type': 'backtrace', 'id': 461703833, 'ino': 1099511633161, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt'}, {'damage_type': 'backtrace', 'id': 479362501, 'ino': 1099511633131, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt'}, {'damage_type': 'backtrace', 'id': 494766462, 'ino': 1099511633068, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt'}, {'damage_type': 'backtrace', 'id': 501316179, 'ino': 1099511633091, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt'}, {'damage_type': 'backtrace', 'id': 513178719, 'ino': 1099511633150, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt'}, {'damage_type': 'backtrace', 'id': 518001637, 'ino': 1099511632741, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt'}, {'damage_type': 'backtrace', 'id': 565708603, 'ino': 1099511633006, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt'}, {'damage_type': 'backtrace', 'id': 610812994, 'ino': 1099511633008, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt'}, {'damage_type': 'backtrace', 'id': 683319518, 'ino': 1099511632750, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt'}, {'damage_type': 'backtrace', 'id': 706758514, 'ino': 1099511633107, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt'}, {'damage_type': 'backtrace', 'id': 759462314, 'ino': 1099511633138, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt'}, {'damage_type': 'backtrace', 'id': 802433743, 'ino': 1099511633163, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt'}, {'damage_type': 'backtrace', 'id': 823388627, 'ino': 1099511633058, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt'}, {'damage_type': 'backtrace', 'id': 824987533, 'ino': 1099511633097, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt'}, {'damage_type': 'backtrace', 'id': 871986282, 'ino': 1099511632737, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt'}, {'damage_type': 'backtrace', 'id': 894372181, 'ino': 1099511632723, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt'}, {'damage_type': 'backtrace', 'id': 948273478, 'ino': 1099511633065, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt'}, {'damage_type': 'backtrace', 'id': 954842226, 'ino': 1099511633140, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt'}, {'damage_type': 'backtrace', 'id': 989487781, 'ino': 1099511633152, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt'}, {'damage_type': 'backtrace', 'id': 1014684957, 'ino': 1099511632759, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt'}, {'damage_type': 'backtrace', 'id': 1066879578, 'ino': 1099511633121, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt'}, {'damage_type': 'backtrace', 'id': 1092995563, 'ino': 1099511633120, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt'}, {'damage_type': 'backtrace', 'id': 1093329468, 'ino': 1099511632724, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt'}, {'damage_type': 'backtrace', 'id': 1113531635, 'ino': 1099511632988, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt'}, {'damage_type': 'backtrace', 'id': 1121415419, 'ino': 1099511632755, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt'}, {'damage_type': 'backtrace', 'id': 1149371712, 'ino': 1099511632751, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt'}, {'damage_type': 'backtrace', 'id': 1220491125, 'ino': 1099511632733, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt'}, {'damage_type': 'backtrace', 'id': 1233874400, 'ino': 1099511632993, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt'}, {'damage_type': 'backtrace', 'id': 1267159192, 'ino': 1099511632757, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt'}, {'damage_type': 'backtrace', 'id': 1282492737, 'ino': 1099511633094, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt'}, {'damage_type': 'backtrace', 'id': 1286570856, 'ino': 1099511632728, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt'}, {'damage_type': 'backtrace', 'id': 1307561397, 'ino': 1099511632746, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt'}, {'damage_type': 'backtrace', 'id': 1317696703, 'ino': 1099511633089, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt'}, {'damage_type': 'backtrace', 'id': 1332180438, 'ino': 1099511633137, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt'}, {'damage_type': 'backtrace', 'id': 1349278670, 'ino': 1099511633148, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt'}, {'damage_type': 'backtrace', 'id': 1354288822, 'ino': 1099511633010, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt'}, {'damage_type': 'backtrace', 'id': 1361748053, 'ino': 1099511633087, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt'}, {'damage_type': 'backtrace', 'id': 1367564770, 'ino': 1099511631719, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/powercap'}, {'damage_type': 'backtrace', 'id': 1405035921, 'ino': 1099511633064, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt'}, {'damage_type': 'backtrace', 'id': 1406138008, 'ino': 1099511633126, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt'}, {'damage_type': 'backtrace', 'id': 1406416043, 'ino': 1099511631721, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/power/regulator'}, {'damage_type': 'backtrace', 'id': 1414348456, 'ino': 1099511633105, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt'}, {'damage_type': 'backtrace', 'id': 1425956151, 'ino': 1099511633125, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt'}, {'damage_type': 'backtrace', 'id': 1497827043, 'ino': 1099511633104, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt'}, {'damage_type': 'backtrace', 'id': 1508507842, 'ino': 1099511633130, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt'}, {'damage_type': 'backtrace', 'id': 1518640106, 'ino': 1099511633002, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt'}, {'damage_type': 'backtrace', 'id': 1520391700, 'ino': 1099511633149, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt'}, {'damage_type': 'backtrace', 'id': 1539868378, 'ino': 1099511632745, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt'}, {'damage_type': 'backtrace', 'id': 1544021846, 'ino': 1099511632727, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt'}, {'damage_type': 'backtrace', 'id': 1574939132, 'ino': 1099511632740, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt'}, {'damage_type': 'backtrace', 'id': 1612634008, 'ino': 1099511633151, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt'}, {'damage_type': 'backtrace', 'id': 1662135837, 'ino': 1099511633022, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt'}, {'damage_type': 'backtrace', 'id': 1663969182, 'ino': 1099511633115, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt'}, {'damage_type': 'backtrace', 'id': 1708574425, 'ino': 1099511632994, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt'}, {'damage_type': 'backtrace', 'id': 1747617069, 'ino': 1099511633004, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt'}, {'damage_type': 'backtrace', 'id': 1754922982, 'ino': 1099511633164, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt'}, {'damage_type': 'backtrace', 'id': 1759299844, 'ino': 1099511632730, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt'}, {'damage_type': 'backtrace', 'id': 1812727805, 'ino': 1099511633074, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt'}, {'damage_type': 'backtrace', 'id': 1848161034, 'ino': 1099511632989, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt'}, {'damage_type': 'backtrace', 'id': 1859520005, 'ino': 1099511633093, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt'}, {'damage_type': 'backtrace', 'id': 1874372392, 'ino': 1099511633135, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt'}, {'damage_type': 'backtrace', 'id': 1930531310, 'ino': 1099511632758, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt'}, {'damage_type': 'backtrace', 'id': 1932877010, 'ino': 1099511632998, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt'}, {'damage_type': 'backtrace', 'id': 1952827825, 'ino': 1099511633060, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt'}, {'damage_type': 'backtrace', 'id': 1957578052, 'ino': 1099511633101, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt'}, {'damage_type': 'backtrace', 'id': 2001470038, 'ino': 1099511633154, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2016170389, 'ino': 1099511629736, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen'}, {'damage_type': 'backtrace', 'id': 2050719256, 'ino': 1099511632997, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt'}, {'damage_type': 'backtrace', 'id': 2072056883, 'ino': 1099511633153, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2073692239, 'ino': 1099511633136, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2104535502, 'ino': 1099511633057, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt'}, {'damage_type': 'backtrace', 'id': 2119624882, 'ino': 1099511633128, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt'}, {'damage_type': 'backtrace', 'id': 2164945762, 'ino': 1099511633145, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt'}, {'damage_type': 'backtrace', 'id': 2187604373, 'ino': 1099511633059, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt'}, {'damage_type': 'backtrace', 'id': 2202488865, 'ino': 1099511633159, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt'}, {'damage_type': 'backtrace', 'id': 2214959522, 'ino': 1099511633088, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt'}, {'damage_type': 'backtrace', 'id': 2277526784, 'ino': 1099511633112, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2334212371, 'ino': 1099511632999, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt'}, {'damage_type': 'backtrace', 'id': 2352829770, 'ino': 1099511633142, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2357746035, 'ino': 1099511633082, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt'}, {'damage_type': 'backtrace', 'id': 2365624164, 'ino': 1099511633162, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2390420866, 'ino': 1099511633147, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt'}, {'damage_type': 'backtrace', 'id': 2415262628, 'ino': 1099511633090, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt'}, {'damage_type': 'backtrace', 'id': 2454082273, 'ino': 1099511633108, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt'}, {'damage_type': 'backtrace', 'id': 2478033055, 'ino': 1099511633005, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt'}, {'damage_type': 'backtrace', 'id': 2478853849, 'ino': 1099511632747, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt'}, {'damage_type': 'backtrace', 'id': 2493029267, 'ino': 1099511633070, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt'}, {'damage_type': 'backtrace', 'id': 2519208782, 'ino': 1099511632749, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt'}, {'damage_type': 'backtrace', 'id': 2524276340, 'ino': 1099511633100, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt'}, {'damage_type': 'backtrace', 'id': 2524793656, 'ino': 1099511633015, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt'}, {'damage_type': 'backtrace', 'id': 2555644750, 'ino': 1099511633062, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt'}, {'damage_type': 'backtrace', 'id': 2575887856, 'ino': 1099511633155, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt'}, {'damage_type': 'backtrace', 'id': 2578510967, 'ino': 1099511633080, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt'}, {'damage_type': 'backtrace', 'id': 2611717555, 'ino': 1099511633129, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt'}, {'damage_type': 'backtrace', 'id': 2646459793, 'ino': 1099511633072, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt'}, {'damage_type': 'backtrace', 'id': 2669017695, 'ino': 1099511633067, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt'}, {'damage_type': 'backtrace', 'id': 2674043914, 'ino': 1099511632726, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt'}, {'damage_type': 'backtrace', 'id': 2676789362, 'ino': 1099511633144, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt'}, {'damage_type': 'backtrace', 'id': 2703465015, 'ino': 1099511633102, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt'}, {'damage_type': 'backtrace', 'id': 2718097337, 'ino': 1099511633146, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt'}, {'damage_type': 'backtrace', 'id': 2720299948, 'ino': 1099511633119, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt'}, {'damage_type': 'backtrace', 'id': 2780783023, 'ino': 1099511633117, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt'}, {'damage_type': 'backtrace', 'id': 2790663864, 'ino': 1099511633116, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2796507020, 'ino': 1099511633079, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt'}, {'damage_type': 'backtrace', 'id': 2800965290, 'ino': 1099511633098, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt'}, {'damage_type': 'backtrace', 'id': 2825317495, 'ino': 1099511633123, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt'}, {'damage_type': 'backtrace', 'id': 2837229841, 'ino': 1099511633017, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt'}, {'damage_type': 'backtrace', 'id': 2857068766, 'ino': 1099511633124, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt'}, {'damage_type': 'backtrace', 'id': 2859165870, 'ino': 1099511633013, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt'}, {'damage_type': 'backtrace', 'id': 2949338862, 'ino': 1099511633113, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt'}, {'damage_type': 'backtrace', 'id': 2952466682, 'ino': 1099511633109, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt'}, {'damage_type': 'backtrace', 'id': 2962733100, 'ino': 1099511633141, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt'}, {'damage_type': 'backtrace', 'id': 2982375769, 'ino': 1099511633103, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt'}, {'damage_type': 'backtrace', 'id': 2984825519, 'ino': 1099511633158, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt'}, {'damage_type': 'backtrace', 'id': 2989936707, 'ino': 1099511633157, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt'}, {'damage_type': 'backtrace', 'id': 3010480998, 'ino': 1099511633134, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt'}, {'damage_type': 'backtrace', 'id': 3037750814, 'ino': 1099511633118, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt'}, {'damage_type': 'backtrace', 'id': 3048978256, 'ino': 1099511633009, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt'}, {'damage_type': 'backtrace', 'id': 3062623345, 'ino': 1099511633165, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt'}, {'damage_type': 'backtrace', 'id': 3083924842, 'ino': 1099511633075, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt'}, {'damage_type': 'backtrace', 'id': 3152602966, 'ino': 1099511633099, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt'}, {'damage_type': 'backtrace', 'id': 3166605688, 'ino': 1099511633096, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt'}, {'damage_type': 'backtrace', 'id': 3173081878, 'ino': 1099511633092, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt'}, {'damage_type': 'backtrace', 'id': 3229210515, 'ino': 1099511633003, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3305456135, 'ino': 1099511633078, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt'}, {'damage_type': 'backtrace', 'id': 3305509575, 'ino': 1099511633139, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt'}, {'damage_type': 'backtrace', 'id': 3312714205, 'ino': 1099511633077, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt'}, {'damage_type': 'backtrace', 'id': 3313845763, 'ino': 1099511633014, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3361138963, 'ino': 1099511633081, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt'}, {'damage_type': 'backtrace', 'id': 3437759118, 'ino': 1099511633000, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3447275656, 'ino': 1099511632748, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt'}, {'damage_type': 'backtrace', 'id': 3506865949, 'ino': 1099511632725, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt'}, {'damage_type': 'backtrace', 'id': 3554597811, 'ino': 1099511633111, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt'}, {'damage_type': 'backtrace', 'id': 3565426968, 'ino': 1099511633007, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3599794302, 'ino': 1099511632987, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3630771600, 'ino': 1099511632744, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt'}, {'damage_type': 'backtrace', 'id': 3634156059, 'ino': 1099511632735, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt'}, {'damage_type': 'backtrace', 'id': 3638390518, 'ino': 1099511633132, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt'}, {'damage_type': 'backtrace', 'id': 3672832252, 'ino': 1099511633083, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt'}, {'damage_type': 'backtrace', 'id': 3700569817, 'ino': 1099511632986, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt'}, {'damage_type': 'backtrace', 'id': 3702279170, 'ino': 1099511633019, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3703721097, 'ino': 1099511633127, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt'}, {'damage_type': 'backtrace', 'id': 3719084196, 'ino': 1099511629813, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c'}, {'damage_type': 'backtrace', 'id': 3721850968, 'ino': 1099511633156, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt'}, {'damage_type': 'backtrace', 'id': 3732117081, 'ino': 1099511633114, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt'}, {'damage_type': 'backtrace', 'id': 3763109276, 'ino': 1099511632990, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt'}, {'damage_type': 'backtrace', 'id': 3821907582, 'ino': 1099511632996, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt'}, {'damage_type': 'backtrace', 'id': 3842057212, 'ino': 1099511633020, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt'}, {'damage_type': 'backtrace', 'id': 3857175626, 'ino': 1099511633086, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt'}, {'damage_type': 'backtrace', 'id': 3858020710, 'ino': 1099511632753, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt'}, {'damage_type': 'backtrace', 'id': 3859148367, 'ino': 1099511632992, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3882763851, 'ino': 1099511632738, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt'}, {'damage_type': 'backtrace', 'id': 3896499083, 'ino': 1099511633106, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt'}, {'damage_type': 'backtrace', 'id': 3909353541, 'ino': 1099511633071, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt'}, {'damage_type': 'backtrace', 'id': 3929464718, 'ino': 1099511633085, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt'}, {'damage_type': 'backtrace', 'id': 3967346326, 'ino': 1099511632985, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt'}, {'damage_type': 'backtrace', 'id': 3970816502, 'ino': 1099511633018, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt'}, {'damage_type': 'backtrace', 'id': 3984454166, 'ino': 1099511633084, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt'}, {'damage_type': 'backtrace', 'id': 3986734475, 'ino': 1099511633061, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt'}, {'damage_type': 'backtrace', 'id': 4014967196, 'ino': 1099511632734, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt'}, {'damage_type': 'backtrace', 'id': 4026234777, 'ino': 1099511633012, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt'}, {'damage_type': 'backtrace', 'id': 4042298818, 'ino': 1099511632752, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt'}, {'damage_type': 'backtrace', 'id': 4050007358, 'ino': 1099511632995, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt'}, {'damage_type': 'backtrace', 'id': 4099634174, 'ino': 1099511633001, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt'}, {'damage_type': 'backtrace', 'id': 4158472784, 'ino': 1099511632756, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt'}, {'damage_type': 'backtrace', 'id': 4190383048, 'ino': 1099511632732, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt'}, {'damage_type': 'backtrace', 'id': 4202627650, 'ino': 1099511632739, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt'}, {'damage_type': 'backtrace', 'id': 4204280414, 'ino': 1099511633063, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt'}, {'damage_type': 'backtrace', 'id': 4228711577, 'ino': 1099511632991, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt'}, {'damage_type': 'backtrace', 'id': 4241555617, 'ino': 1099511633160, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt'}, {'damage_type': 'backtrace', 'id': 4257354551, 'ino': 1099511633066, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt'}] 2024-03-31T23:20:44.889 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 38884308, 'ino': 1099511628952, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa'}, {'damage_type': 'backtrace', 'id': 86259726, 'ino': 1099511631365, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/isdn'}, {'damage_type': 'backtrace', 'id': 148043962, 'ino': 1099511628967, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm64'}, {'damage_type': 'backtrace', 'id': 159918336, 'ino': 1099511632306, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/video4linux'}, {'damage_type': 'backtrace', 'id': 245672910, 'ino': 1099511631754, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/prctl'}, {'damage_type': 'backtrace', 'id': 286616219, 'ino': 1099511628854, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi'}, {'damage_type': 'backtrace', 'id': 334448283, 'ino': 1099511628980, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/backlight'}, {'damage_type': 'backtrace', 'id': 349834618, 'ino': 1099511631304, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ide'}, {'damage_type': 'backtrace', 'id': 906521195, 'ino': 1099511630317, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo'}, {'damage_type': 'backtrace', 'id': 999282790, 'ino': 1099511630774, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/bridge'}, {'damage_type': 'backtrace', 'id': 1341651418, 'ino': 1099511628868, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe'}, {'damage_type': 'backtrace', 'id': 1349762113, 'ino': 1099511628954, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti'}, {'damage_type': 'backtrace', 'id': 1398814574, 'ino': 1099511628920, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX'}, {'damage_type': 'backtrace', 'id': 1458712440, 'ino': 1099511630909, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fault-injection'}, {'damage_type': 'backtrace', 'id': 1493388811, 'ino': 1099511628793, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID'}, {'damage_type': 'backtrace', 'id': 1527181522, 'ino': 1099511628878, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel'}, {'damage_type': 'backtrace', 'id': 1615452130, 'ino': 1099511629099, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/development-process'}, {'damage_type': 'backtrace', 'id': 1755660774, 'ino': 1099511628912, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile'}, {'damage_type': 'backtrace', 'id': 1767816383, 'ino': 1099511628992, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/block'}, {'damage_type': 'backtrace', 'id': 1977795076, 'ino': 1099511630767, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/backlight'}, {'damage_type': 'backtrace', 'id': 2128130559, 'ino': 1099511628932, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung'}, {'damage_type': 'backtrace', 'id': 2146056455, 'ino': 1099511628893, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100'}, {'damage_type': 'backtrace', 'id': 2203444678, 'ino': 1099511629080, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cpuidle'}, {'damage_type': 'backtrace', 'id': 2217696050, 'ino': 1099511631465, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/m68k'}, {'damage_type': 'backtrace', 'id': 2290452833, 'ino': 1099511632297, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/filesystems'}, {'damage_type': 'backtrace', 'id': 2304716075, 'ino': 1099511632288, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm'}, {'damage_type': 'backtrace', 'id': 2350042911, 'ino': 1099511628945, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm'}, {'damage_type': 'backtrace', 'id': 2441265911, 'ino': 1099511630262, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx'}, {'damage_type': 'backtrace', 'id': 2491983498, 'ino': 1099511632017, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/tpm'}, {'damage_type': 'backtrace', 'id': 2508309214, 'ino': 1099511632281, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN'}, {'damage_type': 'backtrace', 'id': 2615469995, 'ino': 1099511628960, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi'}, {'damage_type': 'backtrace', 'id': 2861550870, 'ino': 1099511630048, 'path': '~mds3/stray3/100000008e0'}, {'damage_type': 'backtrace', 'id': 2920993612, 'ino': 1099511628885, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell'}, {'damage_type': 'backtrace', 'id': 2924934189, 'ino': 1099511632716, 'path': '~mds3/stray3/1000000134c'}, {'damage_type': 'backtrace', 'id': 2976128837, 'ino': 1099511628918, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr'}, {'damage_type': 'backtrace', 'id': 3049223252, 'ino': 1099511628888, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP'}, {'damage_type': 'backtrace', 'id': 3074510556, 'ino': 1099511630270, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl'}, {'damage_type': 'backtrace', 'id': 3094456807, 'ino': 1099511632191, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vm'}, {'damage_type': 'backtrace', 'id': 3122252642, 'ino': 1099511631682, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/parisc'}, {'damage_type': 'backtrace', 'id': 3273991727, 'ino': 1099511632721, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt'}, {'damage_type': 'backtrace', 'id': 3276281572, 'ino': 1099511631450, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/locking'}, {'damage_type': 'backtrace', 'id': 3389096914, 'ino': 1099511631531, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/netlabel'}, {'damage_type': 'backtrace', 'id': 3515008116, 'ino': 1099511631355, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ioctl'}, {'damage_type': 'backtrace', 'id': 3732401918, 'ino': 1099511628947, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe'}, {'damage_type': 'backtrace', 'id': 3741512943, 'ino': 1099511628937, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP'}, {'damage_type': 'backtrace', 'id': 3830300789, 'ino': 1099511630284, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe'}, {'damage_type': 'backtrace', 'id': 4160080457, 'ino': 1099511632291, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/zh_CN/arm64'}, {'damage_type': 'backtrace', 'id': 4184288873, 'ino': 1099511630068, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc'}, {'damage_type': 'backtrace', 'id': 4233034033, 'ino': 1099511630276, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm'}, {'damage_type': 'backtrace', 'id': 4259745427, 'ino': 1099511630274, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe'}, {'damage_type': 'backtrace', 'id': 4283392829, 'ino': 1099511628855, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei'}] 2024-03-31T23:20:44.889 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 26686829, 'ino': 1099511631423, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/laptops'}, {'damage_type': 'backtrace', 'id': 198129083, 'ino': 1099511631676, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2'}, {'damage_type': 'backtrace', 'id': 209860566, 'ino': 1099511631037, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/pohmelfs'}, {'damage_type': 'backtrace', 'id': 366618619, 'ino': 1099511631785, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/s390'}, {'damage_type': 'backtrace', 'id': 411333611, 'ino': 1099511632030, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace/postprocess'}, {'damage_type': 'backtrace', 'id': 490684355, 'ino': 1099511631738, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/powerpc'}, {'damage_type': 'backtrace', 'id': 733354233, 'ino': 1099511630873, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/driver-model'}, {'damage_type': 'backtrace', 'id': 787911685, 'ino': 1099511628974, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/auxdisplay'}, {'damage_type': 'backtrace', 'id': 870233173, 'ino': 1099511632005, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers'}, {'damage_type': 'backtrace', 'id': 875429055, 'ino': 1099511631474, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/memory-devices'}, {'damage_type': 'backtrace', 'id': 922295830, 'ino': 1099511631996, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/thermal'}, {'damage_type': 'backtrace', 'id': 1098264676, 'ino': 1099511631016, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/nfs'}, {'damage_type': 'backtrace', 'id': 1166910310, 'ino': 1099511631528, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/namespaces'}, {'damage_type': 'backtrace', 'id': 1222872134, 'ino': 1099511632248, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/wimax'}, {'damage_type': 'backtrace', 'id': 1338748727, 'ino': 1099511631065, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/firmware_class'}, {'damage_type': 'backtrace', 'id': 1423555430, 'ino': 1099511631774, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/rapidio'}, {'damage_type': 'backtrace', 'id': 1427977444, 'ino': 1099511631095, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio'}, {'damage_type': 'backtrace', 'id': 1488059514, 'ino': 1099511631764, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pti'}, {'damage_type': 'backtrace', 'id': 1491967418, 'ino': 1099511631886, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial'}, {'damage_type': 'backtrace', 'id': 1856916145, 'ino': 1099511632277, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/xtensa'}, {'damage_type': 'backtrace', 'id': 1915129779, 'ino': 1099511628986, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/blackfin'}, {'damage_type': 'backtrace', 'id': 1961354446, 'ino': 1099511631927, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa/soc'}, {'damage_type': 'backtrace', 'id': 2132267479, 'ino': 1099511630972, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/cifs'}, {'damage_type': 'backtrace', 'id': 2143362119, 'ino': 1099511630980, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/configfs'}, {'damage_type': 'backtrace', 'id': 2170037842, 'ino': 1099511631513, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mmc'}, {'damage_type': 'backtrace', 'id': 2240383973, 'ino': 1099511632019, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/trace'}, {'damage_type': 'backtrace', 'id': 2325688787, 'ino': 1099511632077, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/vDSO'}, {'damage_type': 'backtrace', 'id': 2535417857, 'ino': 1099511631992, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/target'}, {'damage_type': 'backtrace', 'id': 2548473035, 'ino': 1099511631900, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound'}, {'damage_type': 'backtrace', 'id': 2679042563, 'ino': 1099511631964, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/spi'}, {'damage_type': 'backtrace', 'id': 2723671920, 'ino': 1099511631391, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ja_JP'}, {'damage_type': 'backtrace', 'id': 2778980192, 'ino': 1099511632040, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/usb'}, {'damage_type': 'backtrace', 'id': 2901817142, 'ino': 1099511631938, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/oss'}, {'damage_type': 'backtrace', 'id': 3024406236, 'ino': 1099511630964, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems/caching'}, {'damage_type': 'backtrace', 'id': 3067879939, 'ino': 1099511631491, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mips'}, {'damage_type': 'backtrace', 'id': 3118286672, 'ino': 1099511631896, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh'}, {'damage_type': 'backtrace', 'id': 3170097294, 'ino': 1099511631312, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband'}, {'damage_type': 'backtrace', 'id': 3252304207, 'ino': 1099511631800, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scheduler'}, {'damage_type': 'backtrace', 'id': 3292006634, 'ino': 1099511631320, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input'}, {'damage_type': 'backtrace', 'id': 3328252056, 'ino': 1099511632252, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86'}, {'damage_type': 'backtrace', 'id': 3351357155, 'ino': 1099511629041, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cgroups'}, {'damage_type': 'backtrace', 'id': 3656090942, 'ino': 1099511630949, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/filesystems'}, {'damage_type': 'backtrace', 'id': 3710695727, 'ino': 1099511630907, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/extcon'}, {'damage_type': 'backtrace', 'id': 3736793059, 'ino': 1099511632259, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386'}, {'damage_type': 'backtrace', 'id': 3869015510, 'ino': 1099511632266, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64'}, {'damage_type': 'backtrace', 'id': 3908015195, 'ino': 1099511631871, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/security'}, {'damage_type': 'backtrace', 'id': 3930549333, 'ino': 1099511628846, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting'}, {'damage_type': 'backtrace', 'id': 4006744840, 'ino': 1099511631112, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/hwmon'}, {'damage_type': 'backtrace', 'id': 4279229863, 'ino': 1099511631901, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sound/alsa'}] 2024-03-31T23:20:44.889 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 17078459, 'ino': 1099511632219, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/masters'}, {'damage_type': 'backtrace', 'id': 108326420, 'ino': 1099511631081, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/frv'}, {'damage_type': 'backtrace', 'id': 199708860, 'ino': 1099511628820, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU'}, {'damage_type': 'backtrace', 'id': 201352695, 'ino': 1099511630884, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dvb'}, {'damage_type': 'backtrace', 'id': 606546248, 'ino': 1099511629064, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/console'}, {'damage_type': 'backtrace', 'id': 646328528, 'ino': 1099511628302, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed'}, {'damage_type': 'backtrace', 'id': 696579399, 'ino': 1099511631613, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/mac80211_hwsim'}, {'damage_type': 'backtrace', 'id': 777426991, 'ino': 1099511629035, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/cdrom'}, {'damage_type': 'backtrace', 'id': 794180261, 'ino': 1099511632129, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx2341x'}, {'damage_type': 'backtrace', 'id': 953336272, 'ino': 1099511631494, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices'}, {'damage_type': 'backtrace', 'id': 1291204607, 'ino': 1099511631702, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/platform'}, {'damage_type': 'backtrace', 'id': 1350743073, 'ino': 1099511631290, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ia64'}, {'damage_type': 'backtrace', 'id': 1401457630, 'ino': 1099511631416, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ko_KR'}, {'damage_type': 'backtrace', 'id': 1518420608, 'ino': 1099511628812, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI'}, {'damage_type': 'backtrace', 'id': 1710668914, 'ino': 1099511631654, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/timestamping'}, {'damage_type': 'backtrace', 'id': 1729309631, 'ino': 1099511631251, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/busses'}, {'damage_type': 'backtrace', 'id': 1852036597, 'ino': 1099511629058, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/connector'}, {'damage_type': 'backtrace', 'id': 2001560740, 'ino': 1099511631524, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd/nand'}, {'damage_type': 'backtrace', 'id': 2057507626, 'ino': 1099511631752, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/pps'}, {'damage_type': 'backtrace', 'id': 2063114807, 'ino': 1099511630913, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fb'}, {'damage_type': 'backtrace', 'id': 2073072502, 'ino': 1099511632167, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm'}, {'damage_type': 'backtrace', 'id': 2075272106, 'ino': 1099511629031, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/bus-devices'}, {'damage_type': 'backtrace', 'id': 2147471103, 'ino': 1099511631537, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking'}, {'damage_type': 'backtrace', 'id': 2255803278, 'ino': 1099511632109, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/bttv'}, {'damage_type': 'backtrace', 'id': 2329558954, 'ino': 1099511631766, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ptp'}, {'damage_type': 'backtrace', 'id': 2344491472, 'ino': 1099511628295, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete'}, {'damage_type': 'backtrace', 'id': 2401930991, 'ino': 1099511628310, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable'}, {'damage_type': 'backtrace', 'id': 2463177086, 'ino': 1099511628560, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook'}, {'damage_type': 'backtrace', 'id': 2472602542, 'ino': 1099511630900, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/early-userspace'}, {'damage_type': 'backtrace', 'id': 2485290326, 'ino': 1099511631279, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c/muxes'}, {'damage_type': 'backtrace', 'id': 2519037830, 'ino': 1099511631811, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi'}, {'damage_type': 'backtrace', 'id': 2526694931, 'ino': 1099511629089, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/crypto'}, {'damage_type': 'backtrace', 'id': 2653451380, 'ino': 1099511629411, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/st'}, {'damage_type': 'backtrace', 'id': 2785587445, 'ino': 1099511628585, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb'}, {'damage_type': 'backtrace', 'id': 2799590939, 'ino': 1099511632086, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux'}, {'damage_type': 'backtrace', 'id': 3020991579, 'ino': 1099511632171, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/kvm/devices'}, {'damage_type': 'backtrace', 'id': 3126774065, 'ino': 1099511631559, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/networking/caif'}, {'damage_type': 'backtrace', 'id': 3180696723, 'ino': 1099511628293, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI'}, {'damage_type': 'backtrace', 'id': 3205876959, 'ino': 1099511632165, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual'}, {'damage_type': 'backtrace', 'id': 3240715226, 'ino': 1099511629108, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/device-mapper'}, {'damage_type': 'backtrace', 'id': 3296487531, 'ino': 1099511632217, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1'}, {'damage_type': 'backtrace', 'id': 3343746043, 'ino': 1099511631399, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/kbuild'}, {'damage_type': 'backtrace', 'id': 3358378464, 'ino': 1099511628606, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l'}, {'damage_type': 'backtrace', 'id': 3425077258, 'ino': 1099511630867, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/dmaengine'}, {'damage_type': 'backtrace', 'id': 3507129003, 'ino': 1099511631673, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nfc'}, {'damage_type': 'backtrace', 'id': 3515236119, 'ino': 1099511628580, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media'}, {'damage_type': 'backtrace', 'id': 3644704437, 'ino': 1099511632140, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/video4linux/cx88'}, {'damage_type': 'backtrace', 'id': 3661539855, 'ino': 1099511632189, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/virtual/uml'}, {'damage_type': 'backtrace', 'id': 3720177696, 'ino': 1099511631518, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mn10300'}, {'damage_type': 'backtrace', 'id': 3886663783, 'ino': 1099511631250, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/i2c'}, {'damage_type': 'backtrace', 'id': 3958890556, 'ino': 1099511631862, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/scsi/scsi_transport_srp'}, {'damage_type': 'backtrace', 'id': 3979913271, 'ino': 1099511632226, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/w1/slaves'}, {'damage_type': 'backtrace', 'id': 4019574024, 'ino': 1099511628337, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing'}, {'damage_type': 'backtrace', 'id': 4029965908, 'ino': 1099511631477, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/metag'}, {'damage_type': 'backtrace', 'id': 4068313032, 'ino': 1099511631523, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/mtd'}, {'damage_type': 'backtrace', 'id': 4106948464, 'ino': 1099511629424, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ti'}, {'damage_type': 'backtrace', 'id': 4231562831, 'ino': 1099511631069, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/fmc'}, {'damage_type': 'backtrace', 'id': 4268822147, 'ino': 1099511631505, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/misc-devices/mei'}, {'damage_type': 'backtrace', 'id': 4294443766, 'ino': 1099511631437, 'path': '/volumes/qa/sv_1/0197c560-8497-408a-b67e-ff3c1c131db9/client.0/tmp/untar_tar/linux-4.0.5/Documentation/leds'}] 2024-03-31T23:20:44.889 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-03-31T23:20:45.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:44 smithi042 ceph-mon[32380]: pgmap v80: 129 pgs: 129 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 799 op/s 2024-03-31T23:20:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:44 smithi094 ceph-mon[36167]: pgmap v80: 129 pgs: 129 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 799 op/s 2024-03-31T23:20:45.465 INFO:tasks.workunit.client.0.smithi042.stdout:Ok 2024-03-31T23:20:45.466 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo Ok 2024-03-31T23:20:45.466 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-31T23:20:45.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-31T23:20:45.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:44 smithi188 ceph-mon[36068]: pgmap v80: 129 pgs: 129 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 799 op/s 2024-03-31T23:20:47.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:46 smithi042 ceph-mon[32380]: pgmap v81: 129 pgs: 129 active+clean; 197 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 855 op/s 2024-03-31T23:20:47.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:46 smithi094 ceph-mon[36167]: pgmap v81: 129 pgs: 129 active+clean; 197 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 855 op/s 2024-03-31T23:20:47.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:46 smithi188 ceph-mon[36068]: pgmap v81: 129 pgs: 129 active+clean; 197 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 855 op/s 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 -- 172.21.15.42:0/2150923329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738107710 msgr2=0x7f8738107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 --2- 172.21.15.42:0/2150923329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738107710 0x7f8738107af0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8728009cd0 tx=0x7f872802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 -- 172.21.15.42:0/2150923329 shutdown_connections 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 --2- 172.21.15.42:0/2150923329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87381020c0 0x7f873810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 --2- 172.21.15.42:0/2150923329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8738101700 0x7f8738101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 --2- 172.21.15.42:0/2150923329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738107710 0x7f8738107af0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 -- 172.21.15.42:0/2150923329 >> 172.21.15.42:0/2150923329 conn(0x7f87380fd210 msgr2=0x7f87380ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 -- 172.21.15.42:0/2150923329 shutdown_connections 2024-03-31T23:20:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.042+0000 7f873fa14640 1 -- 172.21.15.42:0/2150923329 wait complete. 2024-03-31T23:20:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 Processor -- start 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 -- start start 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 0x7f8738197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87381020c0 0x7f8738198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8738107710 0x7f873819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8738111c00 con 0x7f8738101700 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8738111a80 con 0x7f8738107710 2024-03-31T23:20:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873fa14640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8738111d80 con 0x7f87381020c0 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873d7b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 0x7f8738197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873d7b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 0x7f8738197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39490/0 (socket says 172.21.15.42:39490) 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873d7b0640 1 -- 172.21.15.42:0/1533732638 learned_addr learned my addr 172.21.15.42:0/1533732638 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873dfb1640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8738107710 0x7f873819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.043+0000 7f873cfaf640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87381020c0 0x7f8738198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873d7b0640 1 -- 172.21.15.42:0/1533732638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87381020c0 msgr2=0x7f8738198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873d7b0640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87381020c0 0x7f8738198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873d7b0640 1 -- 172.21.15.42:0/1533732638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8738107710 msgr2=0x7f873819c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873d7b0640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8738107710 0x7f873819c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873d7b0640 1 -- 172.21.15.42:0/1533732638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873819cfd0 con 0x7f8738101700 2024-03-31T23:20:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873d7b0640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 0x7f8738197fe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f872802c700 tx=0x7f8728034440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f87367fc640 1 -- 172.21.15.42:0/1533732638 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728039040 con 0x7f8738101700 2024-03-31T23:20:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873819d260 con 0x7f8738101700 2024-03-31T23:20:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f87367fc640 1 -- 172.21.15.42:0/1533732638 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8728044070 con 0x7f8738101700 2024-03-31T23:20:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f87367fc640 1 -- 172.21.15.42:0/1533732638 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728004500 con 0x7f8738101700 2024-03-31T23:20:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.044+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87381a4b50 con 0x7f8738101700 2024-03-31T23:20:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.046+0000 7f87367fc640 1 -- 172.21.15.42:0/1533732638 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f87280046a0 con 0x7f8738101700 2024-03-31T23:20:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 Processor -- start 2024-03-31T23:20:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 -- start start 2024-03-31T23:20:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 0x55a280bac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a280b038f0 con 0x55a280ba9db0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a280aac8d0 con 0x55a280ba06c0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87425f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a280aff990 con 0x55a280ba0fe0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87367fc640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87200a26b0 0x7f87200a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 0x55a280bac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873dfb1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 0x55a280bac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39504/0 (socket says 172.21.15.42:39504) 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 -- 172.21.15.42:0/2260872371 learned_addr learned my addr 172.21.15.42:0/2260872371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873d7b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873dfb1640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87200a26b0 0x7f87200a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f87367fc640 1 -- 172.21.15.42:0/1533732638 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f87280f1100 con 0x7f8738101700 2024-03-31T23:20:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 -- 172.21.15.42:0/2260872371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 msgr2=0x55a280ba9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 -- 172.21.15.42:0/2260872371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 msgr2=0x55a280ba0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.047+0000 7f873cfaf640 1 -- 172.21.15.42:0/2260872371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a280818210 con 0x55a280ba9db0 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f873dfb1640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87200a26b0 0x7f87200a4b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8730009fd0 tx=0x7f8730005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f873cfaf640 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 0x55a280bac1a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f872c009c90 tx=0x7f872c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c688c30cdf5b233f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f871f7fe640 1 -- 172.21.15.42:0/2260872371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c01e070 con 0x55a280ba9db0 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f871f7fe640 1 -- 172.21.15.42:0/2260872371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f872c019b30 con 0x55a280ba9db0 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f871f7fe640 1 -- 172.21.15.42:0/2260872371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c00eac0 con 0x55a280ba9db0 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 -- 172.21.15.42:0/2260872371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 msgr2=0x55a280bac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 0x55a280bac1a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f872c009c90 tx=0x7f872c011810 comp rx=0 tx=0).stop 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 -- 172.21.15.42:0/2260872371 shutdown_connections 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba9db0 0x55a280bac1a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 --2- 172.21.15.42:0/2260872371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 -- 172.21.15.42:0/2260872371 >> 172.21.15.42:0/2260872371 conn(0x55a280b9afe0 msgr2=0x55a280b9b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 -- 172.21.15.42:0/2260872371 shutdown_connections 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.048+0000 7f87425f0740 1 -- 172.21.15.42:0/2260872371 wait complete. 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 -- start start 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 Processor -- start 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 0x55a280ba6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a280bac9e0 con 0x55a280ba06c0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55a280aa1f80 con 0x55a280ba9db0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a280bacb60 con 0x55a280ba0fe0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f87425f0740 10 client.0 _ll_register_callbacks cb 0x55a280afa290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f873d7b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 0x55a280ba6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f873dfb1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f873d7b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 0x55a280ba6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39516/0 (socket says 172.21.15.42:39516) 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.049+0000 7f873d7b0640 1 -- 172.21.15.42:0/3191460318 learned_addr learned my addr 172.21.15.42:0/3191460318 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f873d7b0640 1 -- 172.21.15.42:0/3191460318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 msgr2=0x55a280ba72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f873d7b0640 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f873d7b0640 1 -- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 msgr2=0x55a280ba7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f873d7b0640 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f873d7b0640 1 -- 172.21.15.42:0/3191460318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2808e4620 con 0x55a280ba06c0 2024-03-31T23:20:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f873d7b0640 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 0x55a280ba6db0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f87280bd2e0 tx=0x7f872808d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636620517e10ba43 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f871cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f871cff9640 1 -- 172.21.15.42:0/3191460318 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87280bcf40 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f871cff9640 1 -- 172.21.15.42:0/3191460318 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f8728003b90 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872c019b30 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f871cff9640 1 -- 172.21.15.42:0/3191460318 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f87280bdce0 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f87425f0740 10 client.16689 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a280bac9e0 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f871cff9640 1 -- 172.21.15.42:0/3191460318 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f872c019b30 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f871cff9640 1 -- 172.21.15.42:0/3191460318 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f872803c030 con 0x55a280ba06c0 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f87425f0740 10 client.16689 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.050+0000 7f87425f0740 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f87425f0740 20 client.16689 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f87425f0740 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280bb9cf0 0x55a280bbc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f87425f0740 4 client.16689 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a280b17120 con 0x55a280bb9cf0 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f873cfaf640 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280bb9cf0 0x55a280bbc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f871cff9640 10 client.16689 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.051+0000 7f873cfaf640 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280bb9cf0 0x55a280bbc150 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0fbcc15023a7fcd server_cookie=3592b2158d8934f7 in_seq=0 out_seq=0 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f871cff9640 1 -- 172.21.15.42:0/3191460318 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a280b17120 con 0x55a280bb9cf0 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f871cff9640 10 client.16689 handle_command_reply: tid=0 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 client.16689 shutdown 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 msgr2=0x55a280ba6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 0x55a280ba6db0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f87280bd2e0 tx=0x7f872808d440 comp rx=0 tx=0).stop 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 shutdown_connections 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280bb9cf0 0x55a280bbc150 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba0fe0 0x55a280ba72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 --2- 172.21.15.42:0/3191460318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba06c0 0x55a280ba6db0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f871cff9640 0 client.16689 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 >> 172.21.15.42:0/3191460318 conn(0x55a280b9afe0 msgr2=0x55a280b9cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 shutdown_connections 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 1 -- 172.21.15.42:0/3191460318 wait complete. 2024-03-31T23:20:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.052+0000 7f87425f0740 20 client.16689 trim_cache size 0 max 16384 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 Processor -- start 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 -- start start 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280bb5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba9db0 0x55a280bc1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87381aebe0 con 0x55a280ba0fe0 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f87381b09f0 con 0x55a280ba06c0 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f87425f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87381af370 con 0x55a280ba9db0 2024-03-31T23:20:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280bb5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280bb5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39520/0 (socket says 172.21.15.42:39520) 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f873cfaf640 1 -- 172.21.15.42:0/2401751311 learned_addr learned my addr 172.21.15.42:0/2401751311 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f873d7b0640 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.067+0000 7f873dfb1640 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba9db0 0x55a280bc1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f873cfaf640 1 -- 172.21.15.42:0/2401751311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba9db0 msgr2=0x55a280bc1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f873cfaf640 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba9db0 0x55a280bc1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f873cfaf640 1 -- 172.21.15.42:0/2401751311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 msgr2=0x55a280ba94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f873cfaf640 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f873cfaf640 1 -- 172.21.15.42:0/2401751311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a280bb5cc0 con 0x55a280ba0fe0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f873cfaf640 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280bb5780 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f872c0098c0 tx=0x7f872c00e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdb4c75c587ee1e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f871effd640 1 -- 172.21.15.42:0/2401751311 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c019e60 con 0x55a280ba0fe0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f871effd640 1 -- 172.21.15.42:0/2401751311 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f872c019430 con 0x55a280ba0fe0 2024-03-31T23:20:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f871effd640 1 -- 172.21.15.42:0/2401751311 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c01e040 con 0x55a280ba0fe0 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f87425f0740 1 -- 172.21.15.42:0/2401751311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 msgr2=0x55a280bb5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.068+0000 7f87425f0740 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280bb5780 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f872c0098c0 tx=0x7f872c00e6e0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- 172.21.15.42:0/2401751311 shutdown_connections 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba9db0 0x55a280bc1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280bb5780 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 --2- 172.21.15.42:0/2401751311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba06c0 0x55a280ba94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- 172.21.15.42:0/2401751311 >> 172.21.15.42:0/2401751311 conn(0x55a280b9afe0 msgr2=0x55a280ba1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- 172.21.15.42:0/2401751311 shutdown_connections 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- 172.21.15.42:0/2401751311 wait complete. 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- start start 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 Processor -- start 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba06c0 0x55a280ba3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280ba3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87381b0260 con 0x55a280ba0fe0 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f87381afad0 con 0x55a280ba9db0 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87381acba0 con 0x55a280ba06c0 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f87425f0740 10 client.0 _ll_register_callbacks cb 0x7f8728009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:20:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.069+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280ba3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873d7b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba06c0 0x55a280ba3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873dfb1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280ba3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39534/0 (socket says 172.21.15.42:39534) 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 -- 172.21.15.42:0/1913968858 learned_addr learned my addr 172.21.15.42:0/1913968858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 -- 172.21.15.42:0/1913968858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba06c0 msgr2=0x55a280ba3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba06c0 0x55a280ba3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 -- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 msgr2=0x55a280ba4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 -- 172.21.15.42:0/1913968858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a280bb0030 con 0x55a280ba0fe0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873d7b0640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba06c0 0x55a280ba3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873dfb1640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f873cfaf640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280ba3fd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f872c011850 tx=0x7f872c00e460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17a3cdc5a7e3712 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f871cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f871cff9640 1 -- 172.21.15.42:0/1913968858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c036020 con 0x55a280ba0fe0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f871cff9640 1 -- 172.21.15.42:0/1913968858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f872c009e40 con 0x55a280ba0fe0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872c019430 con 0x55a280ba0fe0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f871cff9640 1 -- 172.21.15.42:0/1913968858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f872c01e070 con 0x55a280ba0fe0 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f87425f0740 10 client.16695 fetch_fsmap learned FSMap version 42 2024-03-31T23:20:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.070+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a280c28c30 con 0x55a280ba0fe0 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f871cff9640 1 -- 172.21.15.42:0/1913968858 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f872c019430 con 0x55a280ba0fe0 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f871cff9640 1 -- 172.21.15.42:0/1913968858 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f872c02e070 con 0x55a280ba0fe0 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f87425f0740 10 client.16695 fetch_fsmap finished waiting for FSMap version 42 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f87425f0740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f87425f0740 20 client.16695 populate_metadata read hostname 'smithi042' 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f87425f0740 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280c291f0 0x55a280c2b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f87425f0740 4 client.16695 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a280b961d0 con 0x55a280c291f0 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f873d7b0640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280c291f0 0x55a280c2b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f871cff9640 10 client.16695 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:48.071+0000 7f873d7b0640 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280c291f0 0x55a280c2b610 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeeb58447e3551ea server_cookie=3ea5c27dee7175fb in_seq=0 out_seq=0 2024-03-31T23:20:49.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:48 smithi042 ceph-mon[32380]: pgmap v82: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 543 op/s 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f871cff9640 1 -- 172.21.15.42:0/1913968858 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a280b961d0 con 0x55a280c291f0 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f871cff9640 10 client.16695 handle_command_reply: tid=0 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 client.16695 shutdown 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 msgr2=0x55a280ba3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280ba3fd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f872c011850 tx=0x7f872c00e460 comp rx=0 tx=0).stop 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 shutdown_connections 2024-03-31T23:20:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55a280c291f0 0x55a280c2b610 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a280ba9db0 0x55a280ba4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a280ba0fe0 0x55a280ba3fd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 --2- 172.21.15.42:0/1913968858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a280ba06c0 0x55a280ba3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f871cff9640 0 client.16695 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 >> 172.21.15.42:0/1913968858 conn(0x55a280b9afe0 msgr2=0x55a280b996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 shutdown_connections 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 1 -- 172.21.15.42:0/1913968858 wait complete. 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.406+0000 7f87425f0740 20 client.16695 trim_cache size 0 max 16384 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:20:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:20:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:20:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87200a26b0 msgr2=0x7f87200a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87200a26b0 0x7f87200a4b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8730009fd0 tx=0x7f8730005f90 comp rx=0 tx=0).stop 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 msgr2=0x7f8738197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 0x7f8738197fe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f872802c700 tx=0x7f8728034440 comp rx=0 tx=0).stop 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 shutdown_connections 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8738107710 0x7f873819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87381020c0 0x7f8738198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87200a26b0 0x7f87200a4b70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 --2- 172.21.15.42:0/1533732638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8738101700 0x7f8738197fe0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 >> 172.21.15.42:0/1533732638 conn(0x7f87380fd210 msgr2=0x7f87380fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 shutdown_connections 2024-03-31T23:20:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:20:49.407+0000 7f873fa14640 1 -- 172.21.15.42:0/1533732638 wait complete. 2024-03-31T23:20:49.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:48 smithi094 ceph-mon[36167]: pgmap v82: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 543 op/s 2024-03-31T23:20:49.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:48 smithi188 ceph-mon[36068]: pgmap v82: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 543 op/s 2024-03-31T23:20:51.270 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:50 smithi188 ceph-mon[36068]: pgmap v83: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-03-31T23:20:51.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:50 smithi042 ceph-mon[32380]: pgmap v83: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-03-31T23:20:51.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:50 smithi094 ceph-mon[36167]: pgmap v83: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-03-31T23:20:53.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:52 smithi042 ceph-mon[32380]: pgmap v84: 129 pgs: 129 active+clean; 190 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 917 op/s 2024-03-31T23:20:53.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:52 smithi094 ceph-mon[36167]: pgmap v84: 129 pgs: 129 active+clean; 190 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 917 op/s 2024-03-31T23:20:53.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:52 smithi188 ceph-mon[36068]: pgmap v84: 129 pgs: 129 active+clean; 190 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 917 op/s 2024-03-31T23:20:55.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:54 smithi042 ceph-mon[32380]: pgmap v85: 129 pgs: 129 active+clean; 190 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 1.9 MiB/s wr, 888 op/s 2024-03-31T23:20:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:54 smithi094 ceph-mon[36167]: pgmap v85: 129 pgs: 129 active+clean; 190 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 1.9 MiB/s wr, 888 op/s 2024-03-31T23:20:55.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:54 smithi188 ceph-mon[36068]: pgmap v85: 129 pgs: 129 active+clean; 190 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 1.9 MiB/s wr, 888 op/s 2024-03-31T23:20:57.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:57 smithi042 ceph-mon[32380]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 1.9 MiB/s wr, 987 op/s 2024-03-31T23:20:57.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:57 smithi094 ceph-mon[36167]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 1.9 MiB/s wr, 987 op/s 2024-03-31T23:20:57.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:57 smithi188 ceph-mon[36068]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 1.9 MiB/s wr, 987 op/s 2024-03-31T23:20:59.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:20:59 smithi042 ceph-mon[32380]: pgmap v87: 129 pgs: 129 active+clean; 192 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 1.5 MiB/s wr, 1.03k op/s 2024-03-31T23:20:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:20:59 smithi094 ceph-mon[36167]: pgmap v87: 129 pgs: 129 active+clean; 192 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 1.5 MiB/s wr, 1.03k op/s 2024-03-31T23:20:59.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:20:59 smithi188 ceph-mon[36068]: pgmap v87: 129 pgs: 129 active+clean; 192 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 1.5 MiB/s wr, 1.03k op/s 2024-03-31T23:21:01.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:01 smithi042 ceph-mon[32380]: pgmap v88: 129 pgs: 129 active+clean; 192 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1013 KiB/s wr, 965 op/s 2024-03-31T23:21:01.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:01 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:21:01.476 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:01 smithi188 ceph-mon[36068]: pgmap v88: 129 pgs: 129 active+clean; 192 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1013 KiB/s wr, 965 op/s 2024-03-31T23:21:01.476 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:01 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:21:01.476 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:01 smithi094 ceph-mon[36167]: pgmap v88: 129 pgs: 129 active+clean; 192 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1013 KiB/s wr, 965 op/s 2024-03-31T23:21:01.476 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:01 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 -- 172.21.15.42:0/3088410521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624068dd0 msgr2=0x7f5624069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 --2- 172.21.15.42:0/3088410521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624068dd0 0x7f5624069230 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5614009930 tx=0x7f561402bc30 comp rx=0 tx=0).stop 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 -- 172.21.15.42:0/3088410521 shutdown_connections 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 --2- 172.21.15.42:0/3088410521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624069770 0x7f562410e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 --2- 172.21.15.42:0/3088410521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624068dd0 0x7f5624069230 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 --2- 172.21.15.42:0/3088410521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5624107820 0x7f5624107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 -- 172.21.15.42:0/3088410521 >> 172.21.15.42:0/3088410521 conn(0x7f56240774a0 msgr2=0x7f56240778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 -- 172.21.15.42:0/3088410521 shutdown_connections 2024-03-31T23:21:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.497+0000 7f562b7d0640 1 -- 172.21.15.42:0/3088410521 wait complete. 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 Processor -- start 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 -- start start 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624068dd0 0x7f5624198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 0x7f5624198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5624107820 0x7f562419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111c30 con 0x7f5624069770 2024-03-31T23:21:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111ab0 con 0x7f5624068dd0 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562b7d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111db0 con 0x7f5624107820 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f5628d6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 0x7f5624198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562956c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624068dd0 0x7f5624198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f5628d6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 0x7f5624198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33880/0 (socket says 172.21.15.42:33880) 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f5628d6b640 1 -- 172.21.15.42:0/1028809794 learned_addr learned my addr 172.21.15.42:0/1028809794 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f562956c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624068dd0 0x7f5624198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:51096/0 (socket says 172.21.15.42:51096) 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.498+0000 7f5629d6d640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5624107820 0x7f562419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f5628d6b640 1 -- 172.21.15.42:0/1028809794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5624107820 msgr2=0x7f562419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f5628d6b640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5624107820 0x7f562419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f5628d6b640 1 -- 172.21.15.42:0/1028809794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624068dd0 msgr2=0x7f5624198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f5628d6b640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624068dd0 0x7f5624198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f5628d6b640 1 -- 172.21.15.42:0/1028809794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562419cff0 con 0x7f5624069770 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f5628d6b640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 0x7f5624198590 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5614009230 tx=0x7f561402dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:21:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f561a7fc640 1 -- 172.21.15.42:0/1028809794 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614043020 con 0x7f5624069770 2024-03-31T23:21:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562419d280 con 0x7f5624069770 2024-03-31T23:21:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f561a7fc640 1 -- 172.21.15.42:0/1028809794 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5614004250 con 0x7f5624069770 2024-03-31T23:21:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f561a7fc640 1 -- 172.21.15.42:0/1028809794 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614003a10 con 0x7f5624069770 2024-03-31T23:21:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.499+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a4b70 con 0x7f5624069770 2024-03-31T23:21:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 Processor -- start 2024-03-31T23:21:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f561a7fc640 1 -- 172.21.15.42:0/1028809794 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f5614046020 con 0x7f5624069770 2024-03-31T23:21:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 -- start start 2024-03-31T23:21:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63d6c0 0x55b2fd63daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd646870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd6491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b2fd5a08f0 con 0x55b2fd646db0 2024-03-31T23:21:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b2fd5498d0 con 0x55b2fd63dfe0 2024-03-31T23:21:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562e3b5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b2fd59c990 con 0x55b2fd63d6c0 2024-03-31T23:21:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f5628d6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd6491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562956c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd646870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f5629d6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63d6c0 0x55b2fd63daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f5629d6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63d6c0 0x55b2fd63daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:43008/0 (socket says 172.21.15.42:43008) 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f5629d6d640 1 -- 172.21.15.42:0/732562301 learned_addr learned my addr 172.21.15.42:0/732562301 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.502+0000 7f562956c640 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd646870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:51102/0 (socket says 172.21.15.42:51102) 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f561a7fc640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f56100a26b0 0x7f56100a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5628d6b640 1 -- 172.21.15.42:0/732562301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63d6c0 msgr2=0x55b2fd63daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5628d6b640 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63d6c0 0x55b2fd63daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5628d6b640 1 -- 172.21.15.42:0/732562301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 msgr2=0x55b2fd646870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5628d6b640 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd646870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5628d6b640 1 -- 172.21.15.42:0/732562301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2fd2b5210 con 0x55b2fd646db0 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f562956c640 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd646870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5629d6d640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f56100a26b0 0x7f56100a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f561a7fc640 1 -- 172.21.15.42:0/1028809794 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f56140f0d00 con 0x7f5624069770 2024-03-31T23:21:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5628d6b640 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd6491a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f56140ee1f0 tx=0x7f5614088240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa07c7f9a1973638 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f5629d6d640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f56100a26b0 0x7f56100a4b70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f561c009fd0 tx=0x7f561c004a40 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f560f7fe640 1 -- 172.21.15.42:0/732562301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140bce80 con 0x55b2fd646db0 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f560f7fe640 1 -- 172.21.15.42:0/732562301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5614088750 con 0x55b2fd646db0 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.503+0000 7f560f7fe640 1 -- 172.21.15.42:0/732562301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140bcca0 con 0x55b2fd646db0 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 -- 172.21.15.42:0/732562301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 msgr2=0x55b2fd6491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd6491a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f56140ee1f0 tx=0x7f5614088240 comp rx=0 tx=0).stop 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 -- 172.21.15.42:0/732562301 shutdown_connections 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd6491a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd646870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 --2- 172.21.15.42:0/732562301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63d6c0 0x55b2fd63daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 -- 172.21.15.42:0/732562301 >> 172.21.15.42:0/732562301 conn(0x55b2fd637fe0 msgr2=0x55b2fd6383c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 -- 172.21.15.42:0/732562301 shutdown_connections 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.504+0000 7f562e3b5740 1 -- 172.21.15.42:0/732562301 wait complete. 2024-03-31T23:21:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 -- start start 2024-03-31T23:21:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 Processor -- start 2024-03-31T23:21:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd643dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 0x55b2fd644310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd644850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b2fd6497a0 con 0x55b2fd63dfe0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b2fd53ef80 con 0x55b2fd63d6c0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b2fd649920 con 0x55b2fd646db0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562e3b5740 10 client.0 _ll_register_callbacks cb 0x55b2fd597290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f5628d6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 0x55b2fd644310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f562956c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd643dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f5628d6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 0x55b2fd644310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33898/0 (socket says 172.21.15.42:33898) 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f5628d6b640 1 -- 172.21.15.42:0/2021658250 learned_addr learned my addr 172.21.15.42:0/2021658250 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.505+0000 7f5629d6d640 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd644850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f5628d6b640 1 -- 172.21.15.42:0/2021658250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 msgr2=0x55b2fd644850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f5628d6b640 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd644850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f5628d6b640 1 -- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 msgr2=0x55b2fd643dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f5628d6b640 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd643dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f5628d6b640 1 -- 172.21.15.42:0/2021658250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2fd381620 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f5628d6b640 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 0x55b2fd644310 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5614009900 tx=0x7f5614004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858debc3baad858c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f560cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f560cff9640 1 -- 172.21.15.42:0/2021658250 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140bcca0 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f560cff9640 1 -- 172.21.15.42:0/2021658250 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f56140c1150 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5614088750 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f560cff9640 1 -- 172.21.15.42:0/2021658250 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f56140bce80 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f562e3b5740 10 client.16707 fetch_fsmap learned FSMap version 43 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55b2fd6497a0 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f560cff9640 1 -- 172.21.15.42:0/2021658250 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5614088750 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f560cff9640 1 -- 172.21.15.42:0/2021658250 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 43) ==== 8438+0+0 (secure 0 0 0) 0x7f56140b99b0 con 0x55b2fd63dfe0 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f562e3b5740 10 client.16707 fetch_fsmap finished waiting for FSMap version 43 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.506+0000 7f562e3b5740 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f562e3b5740 20 client.16707 populate_metadata read hostname 'smithi042' 2024-03-31T23:21:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6567b0 0x55b2fd658bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f562e3b5740 4 client.16707 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2fd5b4120 con 0x55b2fd6567b0 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f562956c640 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6567b0 0x55b2fd658bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f562956c640 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6567b0 0x55b2fd658bf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6813b56a2bbd705 server_cookie=514e691920738639 in_seq=0 out_seq=0 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.507+0000 7f560cff9640 10 client.16707 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f560cff9640 1 -- 172.21.15.42:0/2021658250 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b2fd5b4120 con 0x55b2fd6567b0 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f560cff9640 10 client.16707 handle_command_reply: tid=0 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 client.16707 shutdown 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 msgr2=0x55b2fd644310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 0x55b2fd644310 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5614009900 tx=0x7f5614004c00 comp rx=0 tx=0).stop 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 shutdown_connections 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6567b0 0x55b2fd658bf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd644850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63dfe0 0x55b2fd644310 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2021658250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd643dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 >> 172.21.15.42:0/2021658250 conn(0x55b2fd637fe0 msgr2=0x55b2fd639d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:21:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f560cff9640 0 client.16707 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:21:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 shutdown_connections 2024-03-31T23:21:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 1 -- 172.21.15.42:0/2021658250 wait complete. 2024-03-31T23:21:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.510+0000 7f562e3b5740 20 client.16707 trim_cache size 0 max 16384 2024-03-31T23:21:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 Processor -- start 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 -- start start 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 0x55b2fd646500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd652440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd65e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f56241aeb20 con 0x55b2fd63d6c0 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b0930 con 0x55b2fd63dfe0 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562e3b5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f56241af2b0 con 0x55b2fd646db0 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 0x55b2fd646500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 0x55b2fd646500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33906/0 (socket says 172.21.15.42:33906) 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 -- 172.21.15.42:0/2250216021 learned_addr learned my addr 172.21.15.42:0/2250216021 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f5628d6b640 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd652440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f5629d6d640 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd65e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 -- 172.21.15.42:0/2250216021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 msgr2=0x55b2fd65e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd65e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 -- 172.21.15.42:0/2250216021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 msgr2=0x55b2fd652440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd652440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.525+0000 7f562956c640 1 -- 172.21.15.42:0/2250216021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2fd6491a0 con 0x55b2fd63d6c0 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.526+0000 7f562956c640 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 0x55b2fd646500 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5620009d10 tx=0x7f5620005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69f0c22ad333a3a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.526+0000 7f560effd640 1 -- 172.21.15.42:0/2250216021 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562001f630 con 0x55b2fd63d6c0 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.526+0000 7f560effd640 1 -- 172.21.15.42:0/2250216021 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f562001f7d0 con 0x55b2fd63d6c0 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.526+0000 7f560effd640 1 -- 172.21.15.42:0/2250216021 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562001e3b0 con 0x55b2fd63d6c0 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.526+0000 7f562e3b5740 1 -- 172.21.15.42:0/2250216021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 msgr2=0x55b2fd646500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.526+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 0x55b2fd646500 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5620009d10 tx=0x7f5620005f90 comp rx=0 tx=0).stop 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- 172.21.15.42:0/2250216021 shutdown_connections 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd646db0 0x55b2fd65e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63dfe0 0x55b2fd652440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 --2- 172.21.15.42:0/2250216021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd63d6c0 0x55b2fd646500 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- 172.21.15.42:0/2250216021 >> 172.21.15.42:0/2250216021 conn(0x55b2fd637fe0 msgr2=0x55b2fd63e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:21:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- 172.21.15.42:0/2250216021 shutdown_connections 2024-03-31T23:21:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- 172.21.15.42:0/2250216021 wait complete. 2024-03-31T23:21:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- start start 2024-03-31T23:21:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 Processor -- start 2024-03-31T23:21:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd641130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63dfe0 0x55b2fd641670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd640040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b01a0 con 0x55b2fd646db0 2024-03-31T23:21:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f56241afa10 con 0x55b2fd63d6c0 2024-03-31T23:21:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f56241acae0 con 0x55b2fd63dfe0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562e3b5740 10 client.0 _ll_register_callbacks cb 0x7f5620009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f5629d6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd640040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f5629d6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd640040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33912/0 (socket says 172.21.15.42:33912) 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f5629d6d640 1 -- 172.21.15.42:0/49905999 learned_addr learned my addr 172.21.15.42:0/49905999 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f562956c640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd641130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.527+0000 7f5628d6b640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63dfe0 0x55b2fd641670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f5629d6d640 1 -- 172.21.15.42:0/49905999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63dfe0 msgr2=0x55b2fd641670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f5629d6d640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63dfe0 0x55b2fd641670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f5629d6d640 1 -- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 msgr2=0x55b2fd641130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f5629d6d640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd641130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f5629d6d640 1 -- 172.21.15.42:0/49905999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2fd64ef30 con 0x55b2fd646db0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f5629d6d640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd640040 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f561c011e30 tx=0x7f561c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721e869d9bb73f54 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f560cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-03-31T23:21:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f560cff9640 1 -- 172.21.15.42:0/49905999 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c02f060 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f560cff9640 1 -- 172.21.15.42:0/49905999 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9408+0+0 (secure 0 0 0) 0x7f561c020620 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562001f7d0 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f560cff9640 1 -- 172.21.15.42:0/49905999 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f561c020820 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f562e3b5740 10 client.16713 fetch_fsmap learned FSMap version 43 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.528+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55b2fd6bbea0 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f560cff9640 1 -- 172.21.15.42:0/49905999 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f562001f7d0 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f560cff9640 1 -- 172.21.15.42:0/49905999 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 43) ==== 8438+0+0 (secure 0 0 0) 0x7f561c029030 con 0x55b2fd646db0 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562e3b5740 10 client.16713 fetch_fsmap finished waiting for FSMap version 43 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562e3b5740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562e3b5740 20 client.16713 populate_metadata read hostname 'smithi042' 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562e3b5740 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6bc740 0x55b2fd6beb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562e3b5740 4 client.16713 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 --> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2fd5ade30 con 0x55b2fd6bc740 2024-03-31T23:21:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562956c640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6bc740 0x55b2fd6beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:21:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f562956c640 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6bc740 0x55b2fd6beb60 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98efc496e6ed534 server_cookie=99d1b69847113ae8 in_seq=0 out_seq=0 2024-03-31T23:21:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.529+0000 7f560cff9640 10 client.16713 ms_handle_connect on v2:172.21.15.94:6838/1375958649 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f560cff9640 1 -- 172.21.15.42:0/49905999 <== mds.0 v2:172.21.15.94:6838/1375958649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2fd5ade30 con 0x55b2fd6bc740 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f560cff9640 10 client.16713 handle_command_reply: tid=0 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 client.16713 shutdown 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 msgr2=0x55b2fd640040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd640040 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f561c011e30 tx=0x7f561c004ab0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 shutdown_connections 2024-03-31T23:21:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:6838/1375958649,v1:172.21.15.94:6839/1375958649] conn(0x55b2fd6bc740 0x55b2fd6beb60 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2fd646db0 0x55b2fd640040 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f560cff9640 0 client.16713 ms_handle_reset on v2:172.21.15.94:6838/1375958649 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b2fd63dfe0 0x55b2fd641670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 --2- 172.21.15.42:0/49905999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b2fd63d6c0 0x55b2fd641130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 >> 172.21.15.42:0/49905999 conn(0x55b2fd637fe0 msgr2=0x55b2fd6426a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 shutdown_connections 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.765+0000 7f562e3b5740 1 -- 172.21.15.42:0/49905999 wait complete. 2024-03-31T23:21:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562e3b5740 20 client.16713 trim_cache size 0 max 16384 2024-03-31T23:21:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-03-31T23:21:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-03-31T23:21:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-03-31T23:21:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f56100a26b0 msgr2=0x7f56100a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f56100a26b0 0x7f56100a4b70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f561c009fd0 tx=0x7f561c004a40 comp rx=0 tx=0).stop 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 msgr2=0x7f5624198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 0x7f5624198590 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5614009230 tx=0x7f561402dc80 comp rx=0 tx=0).stop 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 shutdown_connections 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5624107820 0x7f562419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f56100a26b0 0x7f56100a4b70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5624069770 0x7f5624198590 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 --2- 172.21.15.42:0/1028809794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5624068dd0 0x7f5624198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 >> 172.21.15.42:0/1028809794 conn(0x7f56240774a0 msgr2=0x7f56240fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 shutdown_connections 2024-03-31T23:21:02.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-03-31T23:21:02.766+0000 7f562b7d0640 1 -- 172.21.15.42:0/1028809794 wait complete. 2024-03-31T23:21:03.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:03 smithi042 ceph-mon[32380]: pgmap v89: 129 pgs: 129 active+clean; 188 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.20k op/s 2024-03-31T23:21:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:03 smithi094 ceph-mon[36167]: pgmap v89: 129 pgs: 129 active+clean; 188 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.20k op/s 2024-03-31T23:21:03.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:03 smithi188 ceph-mon[36068]: pgmap v89: 129 pgs: 129 active+clean; 188 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.20k op/s 2024-03-31T23:21:03.655 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-03-31T23:21:03.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-31T23:21:04.085 DEBUG:teuthology.parallel:result is None 2024-03-31T23:21:04.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-31T23:21:04.127 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-31T23:21:04.127 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-03-31T23:21:04.139 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:21:04.175 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-03-31T23:21:04.185 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-03-31T23:21:04.185 INFO:teuthology.task.exec:Executing custom commands... 2024-03-31T23:21:04.186 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:21:04.186 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-03-31T23:21:04.274 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:04 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:21:04.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-03-31T23:21:04.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:04 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:21:04.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:04 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:21:05.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:05 smithi042 ceph-mon[32380]: pgmap v90: 129 pgs: 129 active+clean; 188 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1011 KiB/s wr, 428 op/s 2024-03-31T23:21:05.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:05 smithi094 ceph-mon[36167]: pgmap v90: 129 pgs: 129 active+clean; 188 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1011 KiB/s wr, 428 op/s 2024-03-31T23:21:05.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:05 smithi188 ceph-mon[36068]: pgmap v90: 129 pgs: 129 active+clean; 188 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1011 KiB/s wr, 428 op/s 2024-03-31T23:21:07.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:07 smithi042 ceph-mon[32380]: pgmap v91: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 559 op/s 2024-03-31T23:21:07.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:07 smithi094 ceph-mon[36167]: pgmap v91: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 559 op/s 2024-03-31T23:21:07.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:07 smithi188 ceph-mon[36068]: pgmap v91: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 559 op/s 2024-03-31T23:21:09.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:09 smithi042 ceph-mon[32380]: pgmap v92: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 568 op/s 2024-03-31T23:21:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:09 smithi094 ceph-mon[36167]: pgmap v92: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 568 op/s 2024-03-31T23:21:09.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:09 smithi188 ceph-mon[36068]: pgmap v92: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 568 op/s 2024-03-31T23:21:11.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:11 smithi042 ceph-mon[32380]: pgmap v93: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 966 KiB/s wr, 472 op/s 2024-03-31T23:21:11.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:11 smithi094 ceph-mon[36167]: pgmap v93: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 966 KiB/s wr, 472 op/s 2024-03-31T23:21:11.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:11 smithi188 ceph-mon[36068]: pgmap v93: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 966 KiB/s wr, 472 op/s 2024-03-31T23:21:13.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:13 smithi042 ceph-mon[32380]: pgmap v94: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 978 KiB/s wr, 487 op/s 2024-03-31T23:21:13.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:13 smithi094 ceph-mon[36167]: pgmap v94: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 978 KiB/s wr, 487 op/s 2024-03-31T23:21:13.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:13 smithi188 ceph-mon[36068]: pgmap v94: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 978 KiB/s wr, 487 op/s 2024-03-31T23:21:15.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:15 smithi042 ceph-mon[32380]: pgmap v95: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 413 KiB/s wr, 254 op/s 2024-03-31T23:21:15.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:15 smithi094 ceph-mon[36167]: pgmap v95: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 413 KiB/s wr, 254 op/s 2024-03-31T23:21:15.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:15 smithi188 ceph-mon[36068]: pgmap v95: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 413 KiB/s wr, 254 op/s 2024-03-31T23:21:17.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:17 smithi042 ceph-mon[32380]: pgmap v96: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 413 KiB/s wr, 258 op/s 2024-03-31T23:21:17.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:17 smithi094 ceph-mon[36167]: pgmap v96: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 413 KiB/s wr, 258 op/s 2024-03-31T23:21:17.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:17 smithi188 ceph-mon[36068]: pgmap v96: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 413 KiB/s wr, 258 op/s 2024-03-31T23:21:18.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:18 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:21:18.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:18 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:21:18.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:18 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:21:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:19 smithi042 ceph-mon[32380]: pgmap v97: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 102 KiB/s wr, 128 op/s 2024-03-31T23:21:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:21:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:21:19.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:21:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:19 smithi094 ceph-mon[36167]: pgmap v97: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 102 KiB/s wr, 128 op/s 2024-03-31T23:21:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:21:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:21:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:21:19.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:19 smithi188 ceph-mon[36068]: pgmap v97: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 102 KiB/s wr, 128 op/s 2024-03-31T23:21:19.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:21:19.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:21:19.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:21:21.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:21 smithi042 ceph-mon[32380]: pgmap v98: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-03-31T23:21:21.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:21 smithi094 ceph-mon[36167]: pgmap v98: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-03-31T23:21:21.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:21 smithi188 ceph-mon[36068]: pgmap v98: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-03-31T23:21:23.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:23 smithi042 ceph-mon[32380]: pgmap v99: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 KiB/s wr, 25 op/s 2024-03-31T23:21:23.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:23 smithi094 ceph-mon[36167]: pgmap v99: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 KiB/s wr, 25 op/s 2024-03-31T23:21:23.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:23 smithi188 ceph-mon[36068]: pgmap v99: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 KiB/s wr, 25 op/s 2024-03-31T23:21:25.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:25 smithi042 ceph-mon[32380]: pgmap v100: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-31T23:21:25.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:25 smithi094 ceph-mon[36167]: pgmap v100: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-31T23:21:25.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:25 smithi188 ceph-mon[36068]: pgmap v100: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-31T23:21:27.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:27 smithi042 ceph-mon[32380]: pgmap v101: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-03-31T23:21:27.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:27 smithi094 ceph-mon[36167]: pgmap v101: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-03-31T23:21:27.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:27 smithi188 ceph-mon[36068]: pgmap v101: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-03-31T23:21:29.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:29 smithi042 ceph-mon[32380]: pgmap v102: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-31T23:21:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:29 smithi094 ceph-mon[36167]: pgmap v102: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-31T23:21:29.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:29 smithi188 ceph-mon[36068]: pgmap v102: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-31T23:21:31.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:31 smithi042 ceph-mon[32380]: pgmap v103: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-31T23:21:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:31 smithi094 ceph-mon[36167]: pgmap v103: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-31T23:21:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:31 smithi188 ceph-mon[36068]: pgmap v103: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-31T23:21:33.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:33 smithi042 ceph-mon[32380]: pgmap v104: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-03-31T23:21:33.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:33 smithi094 ceph-mon[36167]: pgmap v104: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-03-31T23:21:33.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:33 smithi188 ceph-mon[36068]: pgmap v104: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-03-31T23:21:35.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:35 smithi042 ceph-mon[32380]: pgmap v105: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-31T23:21:35.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:35 smithi094 ceph-mon[36167]: pgmap v105: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-31T23:21:35.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:35 smithi188 ceph-mon[36068]: pgmap v105: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-31T23:21:37.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:37 smithi042 ceph-mon[32380]: pgmap v106: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-31T23:21:37.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:37 smithi094 ceph-mon[36167]: pgmap v106: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-31T23:21:37.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:37 smithi188 ceph-mon[36068]: pgmap v106: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-31T23:21:39.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:39 smithi042 ceph-mon[32380]: pgmap v107: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-31T23:21:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:39 smithi094 ceph-mon[36167]: pgmap v107: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-31T23:21:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:39 smithi188 ceph-mon[36068]: pgmap v107: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-31T23:21:41.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:41 smithi042 ceph-mon[32380]: pgmap v108: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-31T23:21:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:41 smithi094 ceph-mon[36167]: pgmap v108: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-31T23:21:41.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:41 smithi188 ceph-mon[36068]: pgmap v108: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-31T23:21:43.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:43 smithi094 ceph-mon[36167]: pgmap v109: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-31T23:21:43.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:43 smithi188 ceph-mon[36068]: pgmap v109: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-31T23:21:43.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:43 smithi042 ceph-mon[32380]: pgmap v109: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-31T23:21:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:45 smithi094 ceph-mon[36167]: pgmap v110: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-03-31T23:21:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:45 smithi188 ceph-mon[36068]: pgmap v110: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-03-31T23:21:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:45 smithi042 ceph-mon[32380]: pgmap v110: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-03-31T23:21:47.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:47 smithi094 ceph-mon[36167]: pgmap v111: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-31T23:21:47.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:47 smithi188 ceph-mon[36068]: pgmap v111: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-31T23:21:47.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:47 smithi042 ceph-mon[32380]: pgmap v111: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-31T23:21:49.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:49 smithi094 ceph-mon[36167]: pgmap v112: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-03-31T23:21:49.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:49 smithi188 ceph-mon[36068]: pgmap v112: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-03-31T23:21:49.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:49 smithi042 ceph-mon[32380]: pgmap v112: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-03-31T23:21:51.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:51 smithi094 ceph-mon[36167]: pgmap v113: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-03-31T23:21:51.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:51 smithi188 ceph-mon[36068]: pgmap v113: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-03-31T23:21:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:51 smithi042 ceph-mon[32380]: pgmap v113: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-03-31T23:21:53.427 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:53 smithi094 ceph-mon[36167]: pgmap v114: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-31T23:21:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:53 smithi188 ceph-mon[36068]: pgmap v114: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-31T23:21:53.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:53 smithi042 ceph-mon[32380]: pgmap v114: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-31T23:21:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:55 smithi094 ceph-mon[36167]: pgmap v115: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:21:55.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:55 smithi188 ceph-mon[36068]: pgmap v115: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:21:55.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:55 smithi042 ceph-mon[32380]: pgmap v115: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:21:57.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:57 smithi094 ceph-mon[36167]: pgmap v116: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:21:57.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:57 smithi188 ceph-mon[36068]: pgmap v116: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:21:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:57 smithi042 ceph-mon[32380]: pgmap v116: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:21:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:21:59 smithi094 ceph-mon[36167]: pgmap v117: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:21:59.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:21:59 smithi188 ceph-mon[36068]: pgmap v117: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:21:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:21:59 smithi042 ceph-mon[32380]: pgmap v117: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:01.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:01 smithi094 ceph-mon[36167]: pgmap v118: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:01.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:01 smithi188 ceph-mon[36068]: pgmap v118: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:01.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:01 smithi042 ceph-mon[32380]: pgmap v118: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:03.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:03 smithi094 ceph-mon[36167]: pgmap v119: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-03-31T23:22:03.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:03 smithi188 ceph-mon[36068]: pgmap v119: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-03-31T23:22:03.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:03 smithi042 ceph-mon[32380]: pgmap v119: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-03-31T23:22:05.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:05 smithi094 ceph-mon[36167]: pgmap v120: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-03-31T23:22:05.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:05 smithi188 ceph-mon[36068]: pgmap v120: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-03-31T23:22:05.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:05 smithi042 ceph-mon[32380]: pgmap v120: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-03-31T23:22:07.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:07 smithi094 ceph-mon[36167]: pgmap v121: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-31T23:22:07.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:07 smithi188 ceph-mon[36068]: pgmap v121: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-31T23:22:07.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:07 smithi042 ceph-mon[32380]: pgmap v121: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-31T23:22:09.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:09 smithi094 ceph-mon[36167]: pgmap v122: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:22:09.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:09 smithi188 ceph-mon[36068]: pgmap v122: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:22:09.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:09 smithi042 ceph-mon[32380]: pgmap v122: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:22:11.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:11 smithi094 ceph-mon[36167]: pgmap v123: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:22:11.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:11 smithi188 ceph-mon[36068]: pgmap v123: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:22:11.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:11 smithi042 ceph-mon[32380]: pgmap v123: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:22:13.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:13 smithi094 ceph-mon[36167]: pgmap v124: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:22:13.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:13 smithi188 ceph-mon[36068]: pgmap v124: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:22:13.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:13 smithi042 ceph-mon[32380]: pgmap v124: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:22:15.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:15 smithi042 ceph-mon[32380]: pgmap v125: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2024-03-31T23:22:15.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:15 smithi094 ceph-mon[36167]: pgmap v125: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2024-03-31T23:22:15.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:15 smithi188 ceph-mon[36068]: pgmap v125: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2024-03-31T23:22:17.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:17 smithi094 ceph-mon[36167]: pgmap v126: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-03-31T23:22:17.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:17 smithi188 ceph-mon[36068]: pgmap v126: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-03-31T23:22:17.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:17 smithi042 ceph-mon[32380]: pgmap v126: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-03-31T23:22:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:19 smithi094 ceph-mon[36167]: pgmap v127: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-31T23:22:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:22:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:22:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:22:19.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:22:19.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:19 smithi188 ceph-mon[36068]: pgmap v127: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-31T23:22:19.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:22:19.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:22:19.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:22:19.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:22:19.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:19 smithi042 ceph-mon[32380]: pgmap v127: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-31T23:22:19.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:22:19.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:22:19.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:22:19.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:22:21.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:21 smithi094 ceph-mon[36167]: pgmap v128: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:22:21.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:21 smithi188 ceph-mon[36068]: pgmap v128: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:22:21.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:21 smithi042 ceph-mon[32380]: pgmap v128: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:22:23.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:23 smithi094 ceph-mon[36167]: pgmap v129: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:22:23.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:23 smithi188 ceph-mon[36068]: pgmap v129: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:22:23.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:23 smithi042 ceph-mon[32380]: pgmap v129: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:22:25.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:25 smithi094 ceph-mon[36167]: pgmap v130: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:25.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:25 smithi188 ceph-mon[36068]: pgmap v130: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:25.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:25 smithi042 ceph-mon[32380]: pgmap v130: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:27.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:27 smithi094 ceph-mon[36167]: pgmap v131: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:27.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:27 smithi188 ceph-mon[36068]: pgmap v131: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:27 smithi042 ceph-mon[32380]: pgmap v131: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:29 smithi094 ceph-mon[36167]: pgmap v132: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:29.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:29 smithi188 ceph-mon[36068]: pgmap v132: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:29.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:29 smithi042 ceph-mon[32380]: pgmap v132: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:31 smithi094 ceph-mon[36167]: pgmap v133: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:31 smithi188 ceph-mon[36068]: pgmap v133: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:31.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:31 smithi042 ceph-mon[32380]: pgmap v133: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:33.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:33 smithi094 ceph-mon[36167]: pgmap v134: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:33.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:33 smithi188 ceph-mon[36068]: pgmap v134: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:33.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:33 smithi042 ceph-mon[32380]: pgmap v134: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:35.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:35 smithi094 ceph-mon[36167]: pgmap v135: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:35.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:35 smithi188 ceph-mon[36068]: pgmap v135: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:35.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:35 smithi042 ceph-mon[32380]: pgmap v135: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:37.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:37 smithi094 ceph-mon[36167]: pgmap v136: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:37.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:37 smithi188 ceph-mon[36068]: pgmap v136: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:37.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:37 smithi042 ceph-mon[32380]: pgmap v136: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:39 smithi094 ceph-mon[36167]: pgmap v137: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:39 smithi188 ceph-mon[36068]: pgmap v137: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:39.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:39 smithi042 ceph-mon[32380]: pgmap v137: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:41 smithi094 ceph-mon[36167]: pgmap v138: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:41.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:41 smithi188 ceph-mon[36068]: pgmap v138: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:41.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:41 smithi042 ceph-mon[32380]: pgmap v138: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:22:43.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:43 smithi094 ceph-mon[36167]: pgmap v139: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:43.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:43 smithi188 ceph-mon[36068]: pgmap v139: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:43.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:43 smithi042 ceph-mon[32380]: pgmap v139: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:45 smithi094 ceph-mon[36167]: pgmap v140: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:45 smithi188 ceph-mon[36068]: pgmap v140: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:45 smithi042 ceph-mon[32380]: pgmap v140: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:47.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:47 smithi094 ceph-mon[36167]: pgmap v141: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:47.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:47 smithi188 ceph-mon[36068]: pgmap v141: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:47.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:47 smithi042 ceph-mon[32380]: pgmap v141: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:49.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:49 smithi094 ceph-mon[36167]: pgmap v142: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:49.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:49 smithi188 ceph-mon[36068]: pgmap v142: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:49.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:49 smithi042 ceph-mon[32380]: pgmap v142: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:51.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:51 smithi094 ceph-mon[36167]: pgmap v143: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:51.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:51 smithi188 ceph-mon[36068]: pgmap v143: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:51 smithi042 ceph-mon[32380]: pgmap v143: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:53.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:53 smithi094 ceph-mon[36167]: pgmap v144: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:53 smithi188 ceph-mon[36068]: pgmap v144: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:53.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:53 smithi042 ceph-mon[32380]: pgmap v144: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:22:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:55 smithi094 ceph-mon[36167]: pgmap v145: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:55.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:55 smithi188 ceph-mon[36068]: pgmap v145: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:55.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:55 smithi042 ceph-mon[32380]: pgmap v145: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:57.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:57 smithi094 ceph-mon[36167]: pgmap v146: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:57.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:57 smithi188 ceph-mon[36068]: pgmap v146: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:57.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:57 smithi042 ceph-mon[32380]: pgmap v146: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:22:59.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:22:59 smithi094 ceph-mon[36167]: pgmap v147: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:59.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:22:59 smithi188 ceph-mon[36068]: pgmap v147: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:22:59.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:22:59 smithi042 ceph-mon[32380]: pgmap v147: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:01 smithi188 ceph-mon[36068]: pgmap v148: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:01.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:01 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:01.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:01 smithi042 ceph-mon[32380]: pgmap v148: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:01.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:01 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:01 smithi094 ceph-mon[36167]: pgmap v148: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:01.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:01 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:03.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:03 smithi188 ceph-mon[36068]: pgmap v149: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 op/s 2024-03-31T23:23:03.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:03 smithi042 ceph-mon[32380]: pgmap v149: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 op/s 2024-03-31T23:23:03.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:03 smithi094 ceph-mon[36167]: pgmap v149: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 op/s 2024-03-31T23:23:04.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:04 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:04.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:04 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:04.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:04 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:05.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:05 smithi188 ceph-mon[36068]: pgmap v150: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:05.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:05 smithi042 ceph-mon[32380]: pgmap v150: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:05.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:05 smithi094 ceph-mon[36167]: pgmap v150: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:06.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:06 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:06.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:06 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:06.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:06 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:07.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:07 smithi188 ceph-mon[36068]: pgmap v151: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-03-31T23:23:07.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:07 smithi042 ceph-mon[32380]: pgmap v151: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-03-31T23:23:07.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:07 smithi094 ceph-mon[36167]: pgmap v151: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-03-31T23:23:09.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:09 smithi188 ceph-mon[36068]: pgmap v152: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:23:09.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:09 smithi042 ceph-mon[32380]: pgmap v152: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:23:09.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:09 smithi094 ceph-mon[36167]: pgmap v152: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:23:11.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:11 smithi188 ceph-mon[36068]: pgmap v153: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:23:11.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:11 smithi042 ceph-mon[32380]: pgmap v153: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:23:11.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:11 smithi094 ceph-mon[36167]: pgmap v153: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:23:13.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:13 smithi188 ceph-mon[36068]: pgmap v154: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:23:13.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:13 smithi042 ceph-mon[32380]: pgmap v154: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:23:13.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:13 smithi094 ceph-mon[36167]: pgmap v154: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:23:15.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:15 smithi188 ceph-mon[36068]: pgmap v155: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:23:15.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:15 smithi042 ceph-mon[32380]: pgmap v155: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:23:15.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:15 smithi094 ceph-mon[36167]: pgmap v155: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:23:16.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:16 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:16.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:16 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:16.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:16 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:17.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:17 smithi042 ceph-mon[32380]: pgmap v156: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:23:17.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:17 smithi094 ceph-mon[36167]: pgmap v156: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:23:17.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:17 smithi188 ceph-mon[36068]: pgmap v156: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:23:19.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:19 smithi042 ceph-mon[32380]: pgmap v157: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-03-31T23:23:19.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:19 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:23:19.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:19 smithi094 ceph-mon[36167]: pgmap v157: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-03-31T23:23:19.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:19 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:23:19.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:19 smithi188 ceph-mon[36068]: pgmap v157: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-03-31T23:23:19.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:19 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:23:20.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:20 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:23:20.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:20 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:23:20.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:20 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:23:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:20 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:23:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:20 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:23:20.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:20 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:23:20.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:20 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:23:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:20 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:23:20.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:20 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:23:21.573 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:21 smithi094 ceph-mon[36167]: pgmap v158: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:23:21.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:21 smithi042 ceph-mon[32380]: pgmap v158: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:23:21.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:21 smithi188 ceph-mon[36068]: pgmap v158: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:23:23.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:23 smithi042 ceph-mon[32380]: pgmap v159: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:23:23.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:23 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:23.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:23 smithi094 ceph-mon[36167]: pgmap v159: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:23:23.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:23 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:23.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:23 smithi188 ceph-mon[36068]: pgmap v159: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:23:23.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:23 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:24.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:24 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:24.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:24 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:24.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:24 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:25.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:25 smithi042 ceph-mon[32380]: pgmap v160: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:25.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:25 smithi094 ceph-mon[36167]: pgmap v160: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:25.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:25 smithi188 ceph-mon[36068]: pgmap v160: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:26.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:26 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:26.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:26 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:26 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:27.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:27 smithi042 ceph-mon[32380]: pgmap v161: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:27.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:27 smithi094 ceph-mon[36167]: pgmap v161: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:27.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:27 smithi188 ceph-mon[36068]: pgmap v161: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:29.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:29 smithi042 ceph-mon[32380]: pgmap v162: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:29.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:29 smithi094 ceph-mon[36167]: pgmap v162: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:29.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:29 smithi188 ceph-mon[36068]: pgmap v162: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:31.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:31 smithi042 ceph-mon[32380]: pgmap v163: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:31.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:31 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:31.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:31 smithi094 ceph-mon[36167]: pgmap v163: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:31.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:31 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:31.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:31 smithi188 ceph-mon[36068]: pgmap v163: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:31.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:31 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:33.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:33 smithi042 ceph-mon[32380]: pgmap v164: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:33.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:33 smithi094 ceph-mon[36167]: pgmap v164: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:33.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:33 smithi188 ceph-mon[36068]: pgmap v164: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:35.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:35 smithi042 ceph-mon[32380]: pgmap v165: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:35.674 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:35 smithi094 ceph-mon[36167]: pgmap v165: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:35.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:35 smithi188 ceph-mon[36068]: pgmap v165: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:37.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:37 smithi042 ceph-mon[32380]: pgmap v166: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:37.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:37 smithi094 ceph-mon[36167]: pgmap v166: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:37.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:37 smithi188 ceph-mon[36068]: pgmap v166: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:38.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:38 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:38.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:38 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:38.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:38 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:39.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:39 smithi042 ceph-mon[32380]: pgmap v167: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:39.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:39 smithi094 ceph-mon[36167]: pgmap v167: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:39.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:39 smithi188 ceph-mon[36068]: pgmap v167: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:40.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:40 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:40.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:40 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:40.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:40 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:41.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:41 smithi042 ceph-mon[32380]: pgmap v168: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:41.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:41 smithi094 ceph-mon[36167]: pgmap v168: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:41.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:41 smithi188 ceph-mon[36068]: pgmap v168: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:43.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:43 smithi042 ceph-mon[32380]: pgmap v169: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:43.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:43 smithi094 ceph-mon[36167]: pgmap v169: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:43.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:43 smithi188 ceph-mon[36068]: pgmap v169: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:45 smithi042 ceph-mon[32380]: pgmap v170: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:45.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:45 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:45.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:45 smithi094 ceph-mon[36167]: pgmap v170: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:45.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:45 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:45.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:45 smithi188 ceph-mon[36068]: pgmap v170: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:45.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:45 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:47.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:47 smithi042 ceph-mon[32380]: pgmap v171: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:47.672 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:47 smithi094 ceph-mon[36167]: pgmap v171: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:47.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:47 smithi188 ceph-mon[36068]: pgmap v171: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:49.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:49 smithi042 ceph-mon[32380]: pgmap v172: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:49 smithi094 ceph-mon[36167]: pgmap v172: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:49.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:49 smithi188 ceph-mon[36068]: pgmap v172: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:51.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:51 smithi042 ceph-mon[32380]: pgmap v173: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:51.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:51 smithi094 ceph-mon[36167]: pgmap v173: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:51.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:51 smithi188 ceph-mon[36068]: pgmap v173: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:52.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:52 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:52.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:52 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:52.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:52 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:53.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:53 smithi042 ceph-mon[32380]: pgmap v174: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:53.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:53 smithi094 ceph-mon[36167]: pgmap v174: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:53 smithi188 ceph-mon[36068]: pgmap v174: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:23:55.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:55 smithi042 ceph-mon[32380]: pgmap v175: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:55.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:55 smithi042 ceph-mon[32380]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:55.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:55 smithi094 ceph-mon[36167]: pgmap v175: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:55.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:55 smithi094 ceph-mon[36167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:55 smithi188 ceph-mon[36068]: pgmap v175: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:55.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:55 smithi188 ceph-mon[36068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-31T23:23:57.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:57 smithi042 ceph-mon[32380]: pgmap v176: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:57.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:57 smithi094 ceph-mon[36167]: pgmap v176: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:57 smithi188 ceph-mon[36068]: pgmap v176: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:23:59.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:23:59 smithi042 ceph-mon[32380]: pgmap v177: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:23:59 smithi094 ceph-mon[36167]: pgmap v177: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:23:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:23:59 smithi188 ceph-mon[36068]: pgmap v177: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:01.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:01 smithi094 ceph-mon[36167]: pgmap v178: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:01 smithi188 ceph-mon[36068]: pgmap v178: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:02.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:01 smithi042 ceph-mon[32380]: pgmap v178: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:03.878 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:03 smithi042 ceph-mon[32380]: pgmap v179: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:24:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:03 smithi094 ceph-mon[36167]: pgmap v179: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:24:03.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:03 smithi188 ceph-mon[36068]: pgmap v179: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:24:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:05 smithi094 ceph-mon[36167]: pgmap v180: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:24:05.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:05 smithi188 ceph-mon[36068]: pgmap v180: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:24:06.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:05 smithi042 ceph-mon[32380]: pgmap v180: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:24:07.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:07 smithi094 ceph-mon[36167]: pgmap v181: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-31T23:24:07.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:07 smithi188 ceph-mon[36068]: pgmap v181: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-31T23:24:08.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:07 smithi042 ceph-mon[32380]: pgmap v181: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-31T23:24:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:09 smithi094 ceph-mon[36167]: pgmap v182: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:24:09.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:09 smithi188 ceph-mon[36068]: pgmap v182: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:24:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:09 smithi042 ceph-mon[32380]: pgmap v182: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-03-31T23:24:11.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:11 smithi094 ceph-mon[36167]: pgmap v183: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:24:11.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:11 smithi188 ceph-mon[36068]: pgmap v183: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:24:12.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:11 smithi042 ceph-mon[32380]: pgmap v183: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-31T23:24:13.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:13 smithi094 ceph-mon[36167]: pgmap v184: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:24:13.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:13 smithi188 ceph-mon[36068]: pgmap v184: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:24:14.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:13 smithi042 ceph-mon[32380]: pgmap v184: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-03-31T23:24:15.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:15 smithi094 ceph-mon[36167]: pgmap v185: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-03-31T23:24:15.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:15 smithi188 ceph-mon[36068]: pgmap v185: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-03-31T23:24:16.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:15 smithi042 ceph-mon[32380]: pgmap v185: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-03-31T23:24:17.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:17 smithi094 ceph-mon[36167]: pgmap v186: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-03-31T23:24:17.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:17 smithi188 ceph-mon[36068]: pgmap v186: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-03-31T23:24:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:17 smithi042 ceph-mon[32380]: pgmap v186: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-03-31T23:24:19.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:19 smithi094 ceph-mon[36167]: pgmap v187: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-31T23:24:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:19 smithi188 ceph-mon[36068]: pgmap v187: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-31T23:24:20.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:19 smithi042 ceph-mon[32380]: pgmap v187: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-31T23:24:20.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:20 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:24:20.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:20 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:24:21.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:20 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:24:21.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:21 smithi188 ceph-mon[36068]: pgmap v188: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:24:21.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:24:21.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:24:21.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:24:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:21 smithi094 ceph-mon[36167]: pgmap v188: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:24:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:24:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:24:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:24:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:21 smithi042 ceph-mon[32380]: pgmap v188: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-31T23:24:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:24:22.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:24:22.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:24:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:23 smithi094 ceph-mon[36167]: pgmap v189: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:24:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:23 smithi188 ceph-mon[36068]: pgmap v189: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:24:24.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:23 smithi042 ceph-mon[32380]: pgmap v189: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:24:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:25 smithi094 ceph-mon[36167]: pgmap v190: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:25.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:25 smithi188 ceph-mon[36068]: pgmap v190: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:26.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:25 smithi042 ceph-mon[32380]: pgmap v190: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:27 smithi094 ceph-mon[36167]: pgmap v191: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:27.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:27 smithi188 ceph-mon[36068]: pgmap v191: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:27 smithi042 ceph-mon[32380]: pgmap v191: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:29.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:29 smithi094 ceph-mon[36167]: pgmap v192: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:29.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:29 smithi188 ceph-mon[36068]: pgmap v192: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:29 smithi042 ceph-mon[32380]: pgmap v192: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:31.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:31 smithi094 ceph-mon[36167]: pgmap v193: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:31.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:31 smithi188 ceph-mon[36068]: pgmap v193: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:31 smithi042 ceph-mon[32380]: pgmap v193: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:33.878 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:33 smithi042 ceph-mon[32380]: pgmap v194: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:33.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:33 smithi094 ceph-mon[36167]: pgmap v194: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:33.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:33 smithi188 ceph-mon[36068]: pgmap v194: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:35.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:35 smithi094 ceph-mon[36167]: pgmap v195: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:35.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:35 smithi188 ceph-mon[36068]: pgmap v195: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:35 smithi042 ceph-mon[32380]: pgmap v195: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:37.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:37 smithi094 ceph-mon[36167]: pgmap v196: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:37.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:37 smithi188 ceph-mon[36068]: pgmap v196: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:37 smithi042 ceph-mon[32380]: pgmap v196: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:39.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:39 smithi094 ceph-mon[36167]: pgmap v197: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:39.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:39 smithi188 ceph-mon[36068]: pgmap v197: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:39 smithi042 ceph-mon[32380]: pgmap v197: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:41.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:41 smithi094 ceph-mon[36167]: pgmap v198: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:41 smithi188 ceph-mon[36068]: pgmap v198: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:42.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:41 smithi042 ceph-mon[32380]: pgmap v198: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:43.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:43 smithi094 ceph-mon[36167]: pgmap v199: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:43 smithi188 ceph-mon[36068]: pgmap v199: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:43 smithi042 ceph-mon[32380]: pgmap v199: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:45.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:45 smithi094 ceph-mon[36167]: pgmap v200: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:45.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:45 smithi188 ceph-mon[36068]: pgmap v200: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:46.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:45 smithi042 ceph-mon[32380]: pgmap v200: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:47.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:47 smithi094 ceph-mon[36167]: pgmap v201: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:47.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:47 smithi188 ceph-mon[36068]: pgmap v201: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:47 smithi042 ceph-mon[32380]: pgmap v201: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:49 smithi094 ceph-mon[36167]: pgmap v202: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:49.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:49 smithi188 ceph-mon[36068]: pgmap v202: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:49 smithi042 ceph-mon[32380]: pgmap v202: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:51.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:51 smithi094 ceph-mon[36167]: pgmap v203: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:51.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:51 smithi188 ceph-mon[36068]: pgmap v203: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:52.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:51 smithi042 ceph-mon[32380]: pgmap v203: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:53.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:53 smithi094 ceph-mon[36167]: pgmap v204: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:53 smithi188 ceph-mon[36068]: pgmap v204: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:53 smithi042 ceph-mon[32380]: pgmap v204: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:24:55.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:55 smithi094 ceph-mon[36167]: pgmap v205: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:55 smithi188 ceph-mon[36068]: pgmap v205: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:55 smithi042 ceph-mon[32380]: pgmap v205: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:57.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:57 smithi094 ceph-mon[36167]: pgmap v206: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:57 smithi188 ceph-mon[36068]: pgmap v206: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:58.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:57 smithi042 ceph-mon[32380]: pgmap v206: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:24:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:24:59 smithi094 ceph-mon[36167]: pgmap v207: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:24:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:24:59 smithi188 ceph-mon[36068]: pgmap v207: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:24:59 smithi042 ceph-mon[32380]: pgmap v207: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:01.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:01 smithi094 ceph-mon[36167]: pgmap v208: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:01 smithi188 ceph-mon[36068]: pgmap v208: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:02.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:01 smithi042 ceph-mon[32380]: pgmap v208: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:03 smithi094 ceph-mon[36167]: pgmap v209: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:25:03.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:03 smithi188 ceph-mon[36068]: pgmap v209: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:25:04.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:03 smithi042 ceph-mon[32380]: pgmap v209: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:25:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:05 smithi094 ceph-mon[36167]: pgmap v210: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:25:05.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:05 smithi188 ceph-mon[36068]: pgmap v210: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:25:06.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:05 smithi042 ceph-mon[32380]: pgmap v210: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:25:07.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:07 smithi094 ceph-mon[36167]: pgmap v211: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:25:07.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:07 smithi188 ceph-mon[36068]: pgmap v211: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:25:08.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:07 smithi042 ceph-mon[32380]: pgmap v211: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:25:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:09 smithi094 ceph-mon[36167]: pgmap v212: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:25:09.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:09 smithi188 ceph-mon[36068]: pgmap v212: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:25:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:09 smithi042 ceph-mon[32380]: pgmap v212: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:25:10.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:10 smithi188 ceph-mon[36068]: osdmap e95: 12 total, 12 up, 12 in 2024-03-31T23:25:11.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:10 smithi042 ceph-mon[32380]: osdmap e95: 12 total, 12 up, 12 in 2024-03-31T23:25:11.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:10 smithi094 ceph-mon[36167]: osdmap e95: 12 total, 12 up, 12 in 2024-03-31T23:25:11.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:11 smithi188 ceph-mon[36068]: pgmap v214: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:25:12.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:11 smithi042 ceph-mon[32380]: pgmap v214: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:25:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:11 smithi094 ceph-mon[36167]: pgmap v214: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:25:13.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:13 smithi188 ceph-mon[36068]: pgmap v215: 129 pgs: 21 active+clean+snaptrim, 52 active+clean, 56 active+clean+snaptrim_wait; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:14.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:13 smithi042 ceph-mon[32380]: pgmap v215: 129 pgs: 21 active+clean+snaptrim, 52 active+clean, 56 active+clean+snaptrim_wait; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:14.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:13 smithi094 ceph-mon[36167]: pgmap v215: 129 pgs: 21 active+clean+snaptrim, 52 active+clean, 56 active+clean+snaptrim_wait; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:15.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:15 smithi188 ceph-mon[36068]: pgmap v216: 129 pgs: 21 active+clean+snaptrim, 52 active+clean, 56 active+clean+snaptrim_wait; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:16.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:15 smithi042 ceph-mon[32380]: pgmap v216: 129 pgs: 21 active+clean+snaptrim, 52 active+clean, 56 active+clean+snaptrim_wait; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:16.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:15 smithi094 ceph-mon[36167]: pgmap v216: 129 pgs: 21 active+clean+snaptrim, 52 active+clean, 56 active+clean+snaptrim_wait; 179 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:17.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:17 smithi188 ceph-mon[36068]: pgmap v217: 129 pgs: 8 active+clean+snaptrim, 95 active+clean, 26 active+clean+snaptrim_wait; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:17 smithi042 ceph-mon[32380]: pgmap v217: 129 pgs: 8 active+clean+snaptrim, 95 active+clean, 26 active+clean+snaptrim_wait; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:17 smithi094 ceph-mon[36167]: pgmap v217: 129 pgs: 8 active+clean+snaptrim, 95 active+clean, 26 active+clean+snaptrim_wait; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:19 smithi188 ceph-mon[36068]: pgmap v218: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:20.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:19 smithi042 ceph-mon[32380]: pgmap v218: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:20.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:19 smithi094 ceph-mon[36167]: pgmap v218: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:25:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:21 smithi188 ceph-mon[36068]: pgmap v219: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 198 B/s wr, 11 op/s 2024-03-31T23:25:21.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:25:21.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:25:21.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:25:21.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:25:21.972 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:21 smithi094 ceph-mon[36167]: pgmap v219: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 198 B/s wr, 11 op/s 2024-03-31T23:25:21.973 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:25:21.973 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:25:21.973 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:25:21.973 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:25:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:21 smithi042 ceph-mon[32380]: pgmap v219: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 198 B/s wr, 11 op/s 2024-03-31T23:25:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:25:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:25:22.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:25:22.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:25:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:23 smithi188 ceph-mon[36068]: pgmap v220: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-03-31T23:25:23.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:23 smithi188 ceph-mon[36068]: osdmap e96: 12 total, 12 up, 12 in 2024-03-31T23:25:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:23 smithi042 ceph-mon[32380]: pgmap v220: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-03-31T23:25:24.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:23 smithi042 ceph-mon[32380]: osdmap e96: 12 total, 12 up, 12 in 2024-03-31T23:25:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:23 smithi094 ceph-mon[36167]: pgmap v220: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-03-31T23:25:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:23 smithi094 ceph-mon[36167]: osdmap e96: 12 total, 12 up, 12 in 2024-03-31T23:25:25.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:25 smithi188 ceph-mon[36068]: pgmap v222: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:25:26.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:25 smithi042 ceph-mon[32380]: pgmap v222: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:25:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:25 smithi094 ceph-mon[36167]: pgmap v222: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:25:27.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:27 smithi188 ceph-mon[36068]: pgmap v223: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:27 smithi042 ceph-mon[32380]: pgmap v223: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:28.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:27 smithi094 ceph-mon[36167]: pgmap v223: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:29.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:29 smithi188 ceph-mon[36068]: pgmap v224: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:29 smithi042 ceph-mon[32380]: pgmap v224: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:30.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:29 smithi094 ceph-mon[36167]: pgmap v224: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:31.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:31 smithi188 ceph-mon[36068]: pgmap v225: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:31 smithi042 ceph-mon[32380]: pgmap v225: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:32.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:31 smithi094 ceph-mon[36167]: pgmap v225: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:33.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:33 smithi188 ceph-mon[36068]: pgmap v226: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:34.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:33 smithi042 ceph-mon[32380]: pgmap v226: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:33 smithi094 ceph-mon[36167]: pgmap v226: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:25:35.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:35 smithi188 ceph-mon[36068]: pgmap v227: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-03-31T23:25:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:35 smithi042 ceph-mon[32380]: pgmap v227: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-03-31T23:25:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:35 smithi094 ceph-mon[36167]: pgmap v227: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-03-31T23:25:37.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:37 smithi188 ceph-mon[36068]: pgmap v228: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:37 smithi042 ceph-mon[32380]: pgmap v228: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:38.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:37 smithi094 ceph-mon[36167]: pgmap v228: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:39.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:39 smithi188 ceph-mon[36068]: pgmap v229: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:39 smithi042 ceph-mon[32380]: pgmap v229: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:40.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:39 smithi094 ceph-mon[36167]: pgmap v229: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:41.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:41 smithi188 ceph-mon[36068]: pgmap v230: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:42.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:41 smithi042 ceph-mon[32380]: pgmap v230: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:41 smithi094 ceph-mon[36167]: pgmap v230: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:43.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:43 smithi188 ceph-mon[36068]: pgmap v231: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:25:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:43 smithi042 ceph-mon[32380]: pgmap v231: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:25:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:43 smithi094 ceph-mon[36167]: pgmap v231: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:25:46.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:45 smithi042 ceph-mon[32380]: pgmap v232: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:45 smithi094 ceph-mon[36167]: pgmap v232: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:46.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:45 smithi188 ceph-mon[36068]: pgmap v232: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:48.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:47 smithi042 ceph-mon[32380]: pgmap v233: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:47 smithi094 ceph-mon[36167]: pgmap v233: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:48.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:47 smithi188 ceph-mon[36068]: pgmap v233: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:49 smithi042 ceph-mon[32380]: pgmap v234: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:50.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:49 smithi094 ceph-mon[36167]: pgmap v234: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:50.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:49 smithi188 ceph-mon[36068]: pgmap v234: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:52.021 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:51 smithi188 ceph-mon[36068]: pgmap v235: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:52.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:51 smithi042 ceph-mon[32380]: pgmap v235: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:52.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:51 smithi094 ceph-mon[36167]: pgmap v235: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:25:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:53 smithi042 ceph-mon[32380]: pgmap v236: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:25:54.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:53 smithi094 ceph-mon[36167]: pgmap v236: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:25:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:53 smithi188 ceph-mon[36068]: pgmap v236: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:25:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:55 smithi042 ceph-mon[32380]: pgmap v237: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:55 smithi094 ceph-mon[36167]: pgmap v237: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:56.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:55 smithi188 ceph-mon[36068]: pgmap v237: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:25:58.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:57 smithi042 ceph-mon[32380]: pgmap v238: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:58.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:57 smithi094 ceph-mon[36167]: pgmap v238: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:25:58.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:57 smithi188 ceph-mon[36068]: pgmap v238: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:25:59 smithi042 ceph-mon[32380]: pgmap v239: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:25:59 smithi094 ceph-mon[36167]: pgmap v239: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:00.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:25:59 smithi188 ceph-mon[36068]: pgmap v239: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:02.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:01 smithi042 ceph-mon[32380]: pgmap v240: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:02.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:01 smithi094 ceph-mon[36167]: pgmap v240: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:02.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:01 smithi188 ceph-mon[36068]: pgmap v240: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:04.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:03 smithi042 ceph-mon[32380]: pgmap v241: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:26:04.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:03 smithi094 ceph-mon[36167]: pgmap v241: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:26:04.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:03 smithi188 ceph-mon[36068]: pgmap v241: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:26:06.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:05 smithi042 ceph-mon[32380]: pgmap v242: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:26:06.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:05 smithi094 ceph-mon[36167]: pgmap v242: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:26:06.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:05 smithi188 ceph-mon[36068]: pgmap v242: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:26:08.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:07 smithi042 ceph-mon[32380]: pgmap v243: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:26:08.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:07 smithi094 ceph-mon[36167]: pgmap v243: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:26:08.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:07 smithi188 ceph-mon[36068]: pgmap v243: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:26:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:09 smithi042 ceph-mon[32380]: pgmap v244: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:26:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:09 smithi042 ceph-mon[32380]: osdmap e97: 12 total, 12 up, 12 in 2024-03-31T23:26:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:09 smithi094 ceph-mon[36167]: pgmap v244: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:26:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:09 smithi094 ceph-mon[36167]: osdmap e97: 12 total, 12 up, 12 in 2024-03-31T23:26:10.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:09 smithi188 ceph-mon[36068]: pgmap v244: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:26:10.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:09 smithi188 ceph-mon[36068]: osdmap e97: 12 total, 12 up, 12 in 2024-03-31T23:26:12.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:11 smithi042 ceph-mon[32380]: pgmap v246: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:26:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:11 smithi094 ceph-mon[36167]: pgmap v246: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:26:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:11 smithi188 ceph-mon[36068]: pgmap v246: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:26:14.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:13 smithi042 ceph-mon[32380]: pgmap v247: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 151 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:14.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:13 smithi094 ceph-mon[36167]: pgmap v247: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 151 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:14.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:13 smithi188 ceph-mon[36068]: pgmap v247: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 151 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:16.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:15 smithi042 ceph-mon[32380]: pgmap v248: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 151 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:16.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:15 smithi094 ceph-mon[36167]: pgmap v248: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 151 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:16.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:15 smithi188 ceph-mon[36068]: pgmap v248: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 151 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:18.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:17 smithi042 ceph-mon[32380]: pgmap v249: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 104 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:17 smithi094 ceph-mon[36167]: pgmap v249: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 104 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:18.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:17 smithi188 ceph-mon[36068]: pgmap v249: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 104 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:20.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:19 smithi042 ceph-mon[32380]: pgmap v250: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:20.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:19 smithi094 ceph-mon[36167]: pgmap v250: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:20.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:19 smithi188 ceph-mon[36068]: pgmap v250: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:26:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:21 smithi042 ceph-mon[32380]: pgmap v251: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 196 B/s wr, 10 op/s 2024-03-31T23:26:22.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:21 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:26:22.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:21 smithi094 ceph-mon[36167]: pgmap v251: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 196 B/s wr, 10 op/s 2024-03-31T23:26:22.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:21 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:26:22.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:21 smithi188 ceph-mon[36068]: pgmap v251: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 196 B/s wr, 10 op/s 2024-03-31T23:26:22.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:21 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:26:23.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:22 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:26:23.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:22 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:26:23.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:22 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:26:23.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:22 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:26:23.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:22 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:26:23.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:22 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:26:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:22 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:26:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:22 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:26:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:22 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:26:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:23 smithi042 ceph-mon[32380]: pgmap v252: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-03-31T23:26:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:23 smithi042 ceph-mon[32380]: osdmap e98: 12 total, 12 up, 12 in 2024-03-31T23:26:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:23 smithi094 ceph-mon[36167]: pgmap v252: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-03-31T23:26:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:23 smithi094 ceph-mon[36167]: osdmap e98: 12 total, 12 up, 12 in 2024-03-31T23:26:24.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:23 smithi188 ceph-mon[36068]: pgmap v252: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-03-31T23:26:24.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:23 smithi188 ceph-mon[36068]: osdmap e98: 12 total, 12 up, 12 in 2024-03-31T23:26:26.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:25 smithi042 ceph-mon[32380]: pgmap v254: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:26:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:25 smithi094 ceph-mon[36167]: pgmap v254: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:26:26.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:25 smithi188 ceph-mon[36068]: pgmap v254: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:26:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:27 smithi042 ceph-mon[32380]: pgmap v255: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:28.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:27 smithi094 ceph-mon[36167]: pgmap v255: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:28.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:27 smithi188 ceph-mon[36068]: pgmap v255: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:30.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:29 smithi042 ceph-mon[32380]: pgmap v256: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:30.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:29 smithi094 ceph-mon[36167]: pgmap v256: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:30.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:29 smithi188 ceph-mon[36068]: pgmap v256: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:32.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:31 smithi042 ceph-mon[32380]: pgmap v257: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:32.174 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:31 smithi094 ceph-mon[36167]: pgmap v257: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:32.233 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:31 smithi188 ceph-mon[36068]: pgmap v257: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:34.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:33 smithi042 ceph-mon[32380]: pgmap v258: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:34.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:33 smithi094 ceph-mon[36167]: pgmap v258: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:34.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:33 smithi188 ceph-mon[36068]: pgmap v258: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-31T23:26:36.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:35 smithi042 ceph-mon[32380]: pgmap v259: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-03-31T23:26:36.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:35 smithi094 ceph-mon[36167]: pgmap v259: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-03-31T23:26:36.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:35 smithi188 ceph-mon[36068]: pgmap v259: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-03-31T23:26:38.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:37 smithi042 ceph-mon[32380]: pgmap v260: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:38.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:37 smithi094 ceph-mon[36167]: pgmap v260: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:38.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:37 smithi188 ceph-mon[36068]: pgmap v260: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:40.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:39 smithi042 ceph-mon[32380]: pgmap v261: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:40.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:39 smithi094 ceph-mon[36167]: pgmap v261: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:40.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:39 smithi188 ceph-mon[36068]: pgmap v261: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:42.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:41 smithi042 ceph-mon[32380]: pgmap v262: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:42.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:41 smithi094 ceph-mon[36167]: pgmap v262: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:42.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:41 smithi188 ceph-mon[36068]: pgmap v262: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:44.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:43 smithi042 ceph-mon[32380]: pgmap v263: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:26:44.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:43 smithi094 ceph-mon[36167]: pgmap v263: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:26:44.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:43 smithi188 ceph-mon[36068]: pgmap v263: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:26:46.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:45 smithi042 ceph-mon[32380]: pgmap v264: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:46.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:45 smithi094 ceph-mon[36167]: pgmap v264: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:46.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:45 smithi188 ceph-mon[36068]: pgmap v264: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:48.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:47 smithi042 ceph-mon[32380]: pgmap v265: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:48.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:47 smithi094 ceph-mon[36167]: pgmap v265: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:48.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:47 smithi188 ceph-mon[36068]: pgmap v265: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:49 smithi042 ceph-mon[32380]: pgmap v266: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:50.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:49 smithi094 ceph-mon[36167]: pgmap v266: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:50.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:49 smithi188 ceph-mon[36068]: pgmap v266: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:52.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:51 smithi042 ceph-mon[32380]: pgmap v267: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:52.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:51 smithi094 ceph-mon[36167]: pgmap v267: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:52.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:51 smithi188 ceph-mon[36068]: pgmap v267: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:53 smithi042 ceph-mon[32380]: pgmap v268: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:26:54.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:53 smithi094 ceph-mon[36167]: pgmap v268: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:26:54.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:53 smithi188 ceph-mon[36068]: pgmap v268: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:26:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:55 smithi042 ceph-mon[32380]: pgmap v269: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:56.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:55 smithi094 ceph-mon[36167]: pgmap v269: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:56.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:55 smithi188 ceph-mon[36068]: pgmap v269: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:26:58.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:57 smithi042 ceph-mon[32380]: pgmap v270: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:58.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:57 smithi094 ceph-mon[36167]: pgmap v270: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:26:58.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:57 smithi188 ceph-mon[36068]: pgmap v270: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:26:59 smithi042 ceph-mon[32380]: pgmap v271: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:26:59 smithi094 ceph-mon[36167]: pgmap v271: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:00.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:26:59 smithi188 ceph-mon[36068]: pgmap v271: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:02.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:01 smithi094 ceph-mon[36167]: pgmap v272: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:02.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:01 smithi188 ceph-mon[36068]: pgmap v272: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:02.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:01 smithi042 ceph-mon[32380]: pgmap v272: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:04.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:03 smithi042 ceph-mon[32380]: pgmap v273: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:27:04.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:03 smithi094 ceph-mon[36167]: pgmap v273: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:27:04.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:03 smithi188 ceph-mon[36068]: pgmap v273: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:27:06.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:05 smithi094 ceph-mon[36167]: pgmap v274: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:27:06.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:05 smithi188 ceph-mon[36068]: pgmap v274: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:27:06.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:05 smithi042 ceph-mon[32380]: pgmap v274: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:27:08.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:07 smithi094 ceph-mon[36167]: pgmap v275: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:27:08.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:07 smithi188 ceph-mon[36068]: pgmap v275: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:27:08.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:07 smithi042 ceph-mon[32380]: pgmap v275: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:27:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:09 smithi094 ceph-mon[36167]: pgmap v276: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:27:10.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:09 smithi094 ceph-mon[36167]: osdmap e99: 12 total, 12 up, 12 in 2024-03-31T23:27:10.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:09 smithi188 ceph-mon[36068]: pgmap v276: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:27:10.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:09 smithi188 ceph-mon[36068]: osdmap e99: 12 total, 12 up, 12 in 2024-03-31T23:27:10.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:09 smithi042 ceph-mon[32380]: pgmap v276: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:27:10.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:09 smithi042 ceph-mon[32380]: osdmap e99: 12 total, 12 up, 12 in 2024-03-31T23:27:12.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:11 smithi094 ceph-mon[36167]: pgmap v278: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:27:12.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:11 smithi188 ceph-mon[36068]: pgmap v278: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:27:12.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:11 smithi042 ceph-mon[32380]: pgmap v278: 129 pgs: 129 active+clean; 59 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:27:14.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:13 smithi094 ceph-mon[36167]: pgmap v279: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:27:14.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:13 smithi094 ceph-mon[36167]: osdmap e100: 12 total, 12 up, 12 in 2024-03-31T23:27:14.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:13 smithi188 ceph-mon[36068]: pgmap v279: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:27:14.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:13 smithi188 ceph-mon[36068]: osdmap e100: 12 total, 12 up, 12 in 2024-03-31T23:27:14.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:13 smithi042 ceph-mon[32380]: pgmap v279: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:27:14.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:13 smithi042 ceph-mon[32380]: osdmap e100: 12 total, 12 up, 12 in 2024-03-31T23:27:16.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:15 smithi094 ceph-mon[36167]: pgmap v281: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2024-03-31T23:27:16.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:15 smithi188 ceph-mon[36068]: pgmap v281: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2024-03-31T23:27:16.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:15 smithi042 ceph-mon[32380]: pgmap v281: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2024-03-31T23:27:18.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:17 smithi094 ceph-mon[36167]: pgmap v282: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-31T23:27:18.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:17 smithi188 ceph-mon[36068]: pgmap v282: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-31T23:27:18.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:17 smithi042 ceph-mon[32380]: pgmap v282: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-31T23:27:20.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:19 smithi094 ceph-mon[36167]: pgmap v283: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 13 op/s 2024-03-31T23:27:20.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:19 smithi188 ceph-mon[36068]: pgmap v283: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 13 op/s 2024-03-31T23:27:20.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:19 smithi042 ceph-mon[32380]: pgmap v283: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 13 op/s 2024-03-31T23:27:22.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:21 smithi094 ceph-mon[36167]: pgmap v284: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:27:22.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:21 smithi188 ceph-mon[36068]: pgmap v284: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:27:22.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:21 smithi042 ceph-mon[32380]: pgmap v284: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:27:23.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:22 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:27:23.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:22 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:27:23.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:22 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:27:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:23 smithi094 ceph-mon[36167]: pgmap v285: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:27:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:23 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:27:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:23 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:27:24.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:23 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:27:24.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:23 smithi188 ceph-mon[36068]: pgmap v285: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:27:24.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:23 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:27:24.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:23 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:27:24.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:23 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:27:24.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:23 smithi042 ceph-mon[32380]: pgmap v285: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-03-31T23:27:24.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:23 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:27:24.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:23 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:27:24.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:23 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:27:26.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:25 smithi094 ceph-mon[36167]: pgmap v286: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 10 op/s 2024-03-31T23:27:26.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:25 smithi188 ceph-mon[36068]: pgmap v286: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 10 op/s 2024-03-31T23:27:26.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:25 smithi042 ceph-mon[32380]: pgmap v286: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 10 op/s 2024-03-31T23:27:27.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:26 smithi094 ceph-mon[36167]: pgmap v287: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:27:27.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:26 smithi188 ceph-mon[36068]: pgmap v287: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:27:27.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:26 smithi042 ceph-mon[32380]: pgmap v287: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-03-31T23:27:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:29 smithi042 ceph-mon[32380]: pgmap v288: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:29.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:29 smithi094 ceph-mon[36167]: pgmap v288: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:29.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:29 smithi188 ceph-mon[36068]: pgmap v288: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:31.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:31 smithi042 ceph-mon[32380]: pgmap v289: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:31.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:31 smithi094 ceph-mon[36167]: pgmap v289: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:31 smithi188 ceph-mon[36068]: pgmap v289: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:33.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:33 smithi042 ceph-mon[32380]: pgmap v290: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:33.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:33 smithi094 ceph-mon[36167]: pgmap v290: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:33.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:33 smithi188 ceph-mon[36068]: pgmap v290: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:35.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:35 smithi094 ceph-mon[36167]: pgmap v291: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:35.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:35 smithi188 ceph-mon[36068]: pgmap v291: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:35.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:35 smithi042 ceph-mon[32380]: pgmap v291: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:37.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:37 smithi094 ceph-mon[36167]: pgmap v292: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:37.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:37 smithi188 ceph-mon[36068]: pgmap v292: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:37.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:37 smithi042 ceph-mon[32380]: pgmap v292: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:39 smithi094 ceph-mon[36167]: pgmap v293: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:39 smithi188 ceph-mon[36068]: pgmap v293: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:39.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:39 smithi042 ceph-mon[32380]: pgmap v293: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:41 smithi094 ceph-mon[36167]: pgmap v294: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:41.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:41 smithi188 ceph-mon[36068]: pgmap v294: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:41.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:41 smithi042 ceph-mon[32380]: pgmap v294: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:43.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:43 smithi094 ceph-mon[36167]: pgmap v295: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:43.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:43 smithi188 ceph-mon[36068]: pgmap v295: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:43.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:43 smithi042 ceph-mon[32380]: pgmap v295: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:45 smithi094 ceph-mon[36167]: pgmap v296: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:45 smithi188 ceph-mon[36068]: pgmap v296: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:45 smithi042 ceph-mon[32380]: pgmap v296: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:47.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:47 smithi094 ceph-mon[36167]: pgmap v297: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:47.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:47 smithi188 ceph-mon[36068]: pgmap v297: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:47.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:47 smithi042 ceph-mon[32380]: pgmap v297: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:49.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:49 smithi094 ceph-mon[36167]: pgmap v298: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:49.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:49 smithi188 ceph-mon[36068]: pgmap v298: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:50.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:49 smithi042 ceph-mon[32380]: pgmap v298: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:51.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:51 smithi094 ceph-mon[36167]: pgmap v299: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:51.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:51 smithi188 ceph-mon[36068]: pgmap v299: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:52.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:51 smithi042 ceph-mon[32380]: pgmap v299: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:53.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:53 smithi094 ceph-mon[36167]: pgmap v300: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:53.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:53 smithi188 ceph-mon[36068]: pgmap v300: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:54.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:53 smithi042 ceph-mon[32380]: pgmap v300: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:27:55.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:55 smithi094 ceph-mon[36167]: pgmap v301: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:55.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:55 smithi188 ceph-mon[36068]: pgmap v301: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:55 smithi042 ceph-mon[32380]: pgmap v301: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:27:57.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:57 smithi094 ceph-mon[36167]: pgmap v302: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:57.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:57 smithi188 ceph-mon[36068]: pgmap v302: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:58.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:57 smithi042 ceph-mon[32380]: pgmap v302: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:27:59.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:27:59 smithi094 ceph-mon[36167]: pgmap v303: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:27:59.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:27:59 smithi188 ceph-mon[36068]: pgmap v303: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:28:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:27:59 smithi042 ceph-mon[32380]: pgmap v303: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:28:01.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:01 smithi094 ceph-mon[36167]: pgmap v304: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:28:01.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:01 smithi188 ceph-mon[36068]: pgmap v304: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:28:02.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:01 smithi042 ceph-mon[32380]: pgmap v304: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-03-31T23:28:03.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:03 smithi094 ceph-mon[36167]: pgmap v305: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:28:03.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:03 smithi188 ceph-mon[36068]: pgmap v305: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:28:04.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:03 smithi042 ceph-mon[32380]: pgmap v305: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:28:05.878 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:05 smithi042 ceph-mon[32380]: pgmap v306: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:28:05.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:05 smithi094 ceph-mon[36167]: pgmap v306: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:28:05.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:05 smithi188 ceph-mon[36068]: pgmap v306: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-31T23:28:07.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:07 smithi094 ceph-mon[36167]: pgmap v307: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:28:07.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:07 smithi188 ceph-mon[36068]: pgmap v307: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:28:08.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:07 smithi042 ceph-mon[32380]: pgmap v307: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-03-31T23:28:09.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:09 smithi094 ceph-mon[36167]: pgmap v308: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:28:09.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:09 smithi188 ceph-mon[36068]: pgmap v308: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:28:10.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:09 smithi042 ceph-mon[32380]: pgmap v308: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-03-31T23:28:10.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:10 smithi094 ceph-mon[36167]: osdmap e101: 12 total, 12 up, 12 in 2024-03-31T23:28:10.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:10 smithi188 ceph-mon[36068]: osdmap e101: 12 total, 12 up, 12 in 2024-03-31T23:28:11.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:10 smithi042 ceph-mon[32380]: osdmap e101: 12 total, 12 up, 12 in 2024-03-31T23:28:11.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:11 smithi094 ceph-mon[36167]: pgmap v310: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:28:11.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:11 smithi188 ceph-mon[36068]: pgmap v310: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:28:12.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:11 smithi042 ceph-mon[32380]: pgmap v310: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-03-31T23:28:12.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-31T23:28:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 -- 172.21.15.42:0/3239063275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 msgr2=0x7f969010d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 --2- 172.21.15.42:0/3239063275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f969010d480 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9688009ca0 tx=0x7f968802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 -- 172.21.15.42:0/3239063275 shutdown_connections 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 --2- 172.21.15.42:0/3239063275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f969010d480 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 --2- 172.21.15.42:0/3239063275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 0x7f9690100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 --2- 172.21.15.42:0/3239063275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96901055f0 0x7f96901059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.436+0000 7f9694e8f640 1 -- 172.21.15.42:0/3239063275 >> 172.21.15.42:0/3239063275 conn(0x7f96900774a0 msgr2=0x7f96900778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 -- 172.21.15.42:0/3239063275 shutdown_connections 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 -- 172.21.15.42:0/3239063275 wait complete. 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 Processor -- start 2024-03-31T23:28:12.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 -- start start 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 0x7f9690196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f9690197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96901055f0 0x7f969019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9690110c30 con 0x7f9690101260 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9690110ab0 con 0x7f96901008a0 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.437+0000 7f9694e8f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9690110db0 con 0x7f96901055f0 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f9690197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f9690197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50816/0 (socket says 172.21.15.42:50816) 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 -- 172.21.15.42:0/2158787727 learned_addr learned my addr 172.21.15.42:0/2158787727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f968e59c640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 0x7f9690196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f968ed9d640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96901055f0 0x7f969019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 -- 172.21.15.42:0/2158787727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96901055f0 msgr2=0x7f969019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96901055f0 0x7f969019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 -- 172.21.15.42:0/2158787727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 msgr2=0x7f9690196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 0x7f9690196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 -- 172.21.15.42:0/2158787727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969019bf90 con 0x7f9690101260 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f968e59c640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 0x7f9690196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9687fff640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f9690197530 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f967800ea60 tx=0x7f967800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967800cde0 con 0x7f9690101260 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f96780035f0 con 0x7f9690101260 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969019c280 con 0x7f9690101260 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678010720 con 0x7f9690101260 2024-03-31T23:28:12.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.438+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96901a3b10 con 0x7f9690101260 2024-03-31T23:28:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.440+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969004f4b0 con 0x7f9690101260 2024-03-31T23:28:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.440+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f96780037a0 con 0x7f9690101260 2024-03-31T23:28:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.441+0000 7f96877fe640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f967c0a26b0 0x7f967c0a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.441+0000 7f968e59c640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f967c0a26b0 0x7f967c0a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.441+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9584+0+0 (secure 0 0 0) 0x7f96780cf240 con 0x7f9690101260 2024-03-31T23:28:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.441+0000 7f968e59c640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f967c0a26b0 0x7f967c0a4b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9680009f40 tx=0x7f9680005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:12.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.446+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f967809bca0 con 0x7f9690101260 2024-03-31T23:28:12.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.652+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 --> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f96900fef60 con 0x7f967c0a26b0 2024-03-31T23:28:12.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.660+0000 7f96877fe640 1 -- 172.21.15.42:0/2158787727 <== mgr.15714 v2:172.21.15.42:6800/4058163900 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f96900fef60 con 0x7f967c0a26b0 2024-03-31T23:28:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-31T00:00:00", "created": "2024-03-31T23:18:10", "first": "2024-03-31T23:19:00", "last": "2024-03-31T23:28:00", "last_pruned": "2024-03-31T23:28:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-03-31T23:28:12.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f967c0a26b0 msgr2=0x7f967c0a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f967c0a26b0 0x7f967c0a4b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9680009f40 tx=0x7f9680005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 msgr2=0x7f9690197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f9690197530 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f967800ea60 tx=0x7f967800ef20 comp rx=0 tx=0).stop 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 shutdown_connections 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96901055f0 0x7f969019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f967c0a26b0 0x7f967c0a4b70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9690101260 0x7f9690197530 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 --2- 172.21.15.42:0/2158787727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96901008a0 0x7f9690196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 >> 172.21.15.42:0/2158787727 conn(0x7f96900774a0 msgr2=0x7f96900fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 shutdown_connections 2024-03-31T23:28:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.662+0000 7f9694e8f640 1 -- 172.21.15.42:0/2158787727 wait complete. 2024-03-31T23:28:12.673 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-31T23:28:12.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 -- 172.21.15.42:0/4244804144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef54069f70 msgr2=0x7fef5406a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/4244804144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef54069f70 0x7fef5406a3f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fef44009930 tx=0x7fef4402bcd0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 -- 172.21.15.42:0/4244804144 shutdown_connections 2024-03-31T23:28:12.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/4244804144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef5406a930 0x7fef5410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/4244804144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef54069f70 0x7fef5406a3f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/4244804144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef541077c0 0x7fef54107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 -- 172.21.15.42:0/4244804144 >> 172.21.15.42:0/4244804144 conn(0x7fef540774b0 msgr2=0x7fef540778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 -- 172.21.15.42:0/4244804144 shutdown_connections 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.776+0000 7fef5b9ac640 1 -- 172.21.15.42:0/4244804144 wait complete. 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 Processor -- start 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 -- start start 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef54069f70 0x7fef54197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 0x7fef541984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef541077c0 0x7fef5419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef54111c30 con 0x7fef5406a930 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef54111ab0 con 0x7fef541077c0 2024-03-31T23:28:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef5b9ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef54111db0 con 0x7fef54069f70 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef58f47640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 0x7fef541984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef58f47640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 0x7fef541984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50832/0 (socket says 172.21.15.42:50832) 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef58f47640 1 -- 172.21.15.42:0/1320952107 learned_addr learned my addr 172.21.15.42:0/1320952107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef59748640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef54069f70 0x7fef54197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.777+0000 7fef59f49640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef541077c0 0x7fef5419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef58f47640 1 -- 172.21.15.42:0/1320952107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef54069f70 msgr2=0x7fef54197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef58f47640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef54069f70 0x7fef54197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef58f47640 1 -- 172.21.15.42:0/1320952107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef541077c0 msgr2=0x7fef5419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef58f47640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef541077c0 0x7fef5419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef58f47640 1 -- 172.21.15.42:0/1320952107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5419cfa0 con 0x7fef5406a930 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef58f47640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 0x7fef541984f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fef44009230 tx=0x7fef44004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44043020 con 0x7fef5406a930 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef44004250 con 0x7fef5406a930 2024-03-31T23:28:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5419d230 con 0x7fef5406a930 2024-03-31T23:28:12.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44003b50 con 0x7fef5406a930 2024-03-31T23:28:12.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.778+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541a4b20 con 0x7fef5406a930 2024-03-31T23:28:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.779+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef54102e50 con 0x7fef5406a930 2024-03-31T23:28:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.780+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fef44046020 con 0x7fef5406a930 2024-03-31T23:28:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.781+0000 7fef4a7fc640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef400a26b0 0x7fef400a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.781+0000 7fef59748640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef400a26b0 0x7fef400a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.781+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9584+0+0 (secure 0 0 0) 0x7fef440f1110 con 0x7fef5406a930 2024-03-31T23:28:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.781+0000 7fef59748640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef400a26b0 0x7fef400a4b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef500095f0 tx=0x7fef50005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.785+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fef4404d020 con 0x7fef5406a930 2024-03-31T23:28:12.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.990+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 --> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fef540ff980 con 0x7fef400a26b0 2024-03-31T23:28:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.996+0000 7fef4a7fc640 1 -- 172.21.15.42:0/1320952107 <== mgr.15714 v2:172.21.15.42:6800/4058163900 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fef540ff980 con 0x7fef400a26b0 2024-03-31T23:28:12.997 INFO:teuthology.orchestra.run.smithi042.stdout:/ 1m 6m3h 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef400a26b0 msgr2=0x7fef400a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef400a26b0 0x7fef400a4b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef500095f0 tx=0x7fef50005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 msgr2=0x7fef541984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 0x7fef541984f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fef44009230 tx=0x7fef44004970 comp rx=0 tx=0).stop 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 shutdown_connections 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef541077c0 0x7fef5419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fef400a26b0 0x7fef400a4b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef5406a930 0x7fef541984f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 --2- 172.21.15.42:0/1320952107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef54069f70 0x7fef54197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 >> 172.21.15.42:0/1320952107 conn(0x7fef540774b0 msgr2=0x7fef540ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 shutdown_connections 2024-03-31T23:28:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:12.998+0000 7fef5b9ac640 1 -- 172.21.15.42:0/1320952107 wait complete. 2024-03-31T23:28:13.009 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-03-31T23:28:13.021 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-03-31T23:28:13.021 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-31T23:28:13.022 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-31T23:28:13.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3691086234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf00ffd00 msgr2=0x7f7cf0100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3691086234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf00ffd00 0x7f7cf0100160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009900 tx=0x7f7ce002bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3691086234 shutdown_connections 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3691086234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0100890 0x7f7cf0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3691086234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf00ffd00 0x7f7cf0100160 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3691086234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf0102600 0x7f7cf01029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3691086234 >> 172.21.15.42:0/3691086234 conn(0x7f7cf0076be0 msgr2=0x7f7cf00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3691086234 shutdown_connections 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.140+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3691086234 wait complete. 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 Processor -- start 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 -- start start 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf00ffd00 0x7f7cf019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0102600 0x7f7cf019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 0x7f7cf019f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0113de0 con 0x7f7cf019ec00 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0113c60 con 0x7f7cf0102600 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf86c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0113f60 con 0x7f7cf00ffd00 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf6c5d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 0x7f7cf019f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf645c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf00ffd00 0x7f7cf019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf6c5d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 0x7f7cf019f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50844/0 (socket says 172.21.15.42:50844) 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf6c5d640 1 -- 172.21.15.42:0/3773433672 learned_addr learned my addr 172.21.15.42:0/3773433672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:13.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.141+0000 7f7cf5c5b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0102600 0x7f7cf019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf6c5d640 1 -- 172.21.15.42:0/3773433672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf00ffd00 msgr2=0x7f7cf019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf6c5d640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf00ffd00 0x7f7cf019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf6c5d640 1 -- 172.21.15.42:0/3773433672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0102600 msgr2=0x7f7cf019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf6c5d640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0102600 0x7f7cf019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf6c5d640 1 -- 172.21.15.42:0/3773433672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf019f6f0 con 0x7f7cf019ec00 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf5c5b640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0102600 0x7f7cf019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf645c640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf00ffd00 0x7f7cf019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf6c5d640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 0x7f7cf019f0b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800eb40 tx=0x7f7ce800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8004b20 con 0x7f7cf019ec00 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ce8004cc0 con 0x7f7cf019ec00 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf019f9e0 con 0x7f7cf019ec00 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80108f0 con 0x7f7cf019ec00 2024-03-31T23:28:13.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.142+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf01a7150 con 0x7f7cf019ec00 2024-03-31T23:28:13.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.143+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf019b690 con 0x7f7cf019ec00 2024-03-31T23:28:13.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.144+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f7ce8005020 con 0x7f7cf019ec00 2024-03-31T23:28:13.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.144+0000 7f7ce77fe640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7cdc0a2610 0x7f7cdc0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.145+0000 7f7cf645c640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7cdc0a2610 0x7f7cdc0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.145+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9584+0+0 (secure 0 0 0) 0x7f7ce80cf700 con 0x7f7cf019ec00 2024-03-31T23:28:13.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.145+0000 7f7cf645c640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7cdc0a2610 0x7f7cdc0a4ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009f40 tx=0x7f7cec005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:13.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.149+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7ce809c120 con 0x7f7cf019ec00 2024-03-31T23:28:13.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.333+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cf002d280 con 0x7f7cf019ec00 2024-03-31T23:28:13.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.334+0000 7f7ce77fe640 1 -- 172.21.15.42:0/3773433672 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+25382 (secure 0 0 0) 0x7f7ce809ba20 con 0x7f7cf019ec00 2024-03-31T23:28:13.335 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:28:13.336 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":101,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:28:09.630845+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1986563449":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/1673984370":"2024-04-01T23:18:09.837578+0000","172.21.15.42:6800/2637331812":"2024-04-01T23:18:09.837578+0000","172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6801/2637331812":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3564928943":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/2338905125":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:28:13.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7cdc0a2610 msgr2=0x7f7cdc0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7cdc0a2610 0x7f7cdc0a4ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009f40 tx=0x7f7cec005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:13.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 msgr2=0x7f7cf019f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 0x7f7cf019f0b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800eb40 tx=0x7f7ce800c2d0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 shutdown_connections 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f7cdc0a2610 0x7f7cdc0a4ad0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cf019ec00 0x7f7cf019f0b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cf0102600 0x7f7cf019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 --2- 172.21.15.42:0/3773433672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf00ffd00 0x7f7cf019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.336+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 >> 172.21.15.42:0/3773433672 conn(0x7f7cf0076be0 msgr2=0x7f7cf00fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.337+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 shutdown_connections 2024-03-31T23:28:13.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.337+0000 7f7cf86c0640 1 -- 172.21.15.42:0/3773433672 wait complete. 2024-03-31T23:28:13.348 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:28:13.348 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 -- 172.21.15.42:0/4231493438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc100f90 msgr2=0x7f0dcc10d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/4231493438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc100f90 0x7f0dcc10d4a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009cd0 tx=0x7f0dc402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 -- 172.21.15.42:0/4231493438 shutdown_connections 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/4231493438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc100f90 0x7f0dcc10d4a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/4231493438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0dcc1005d0 0x7f0dcc100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/4231493438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc106670 0x7f0dcc106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.453+0000 7f0dd23c9640 1 -- 172.21.15.42:0/4231493438 >> 172.21.15.42:0/4231493438 conn(0x7f0dcc077800 msgr2=0x7f0dcc077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 -- 172.21.15.42:0/4231493438 shutdown_connections 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 -- 172.21.15.42:0/4231493438 wait complete. 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 Processor -- start 2024-03-31T23:28:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 -- start start 2024-03-31T23:28:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc1005d0 0x7f0dcc197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0dcc100f90 0x7f0dcc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 0x7f0dcc19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.454+0000 7f0dd23c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc110b10 con 0x7f0dcc106670 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd23c9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc110990 con 0x7f0dcc1005d0 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd23c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc110c90 con 0x7f0dcc100f90 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd0966640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 0x7f0dcc19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc1005d0 0x7f0dcc197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd0966640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 0x7f0dcc19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50860/0 (socket says 172.21.15.42:50860) 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd0966640 1 -- 172.21.15.42:0/111910925 learned_addr learned my addr 172.21.15.42:0/111910925 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcb7fe640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0dcc100f90 0x7f0dcc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 -- 172.21.15.42:0/111910925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0dcc100f90 msgr2=0x7f0dcc198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0dcc100f90 0x7f0dcc198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 -- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 msgr2=0x7f0dcc19c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 0x7f0dcc19c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 -- 172.21.15.42:0/111910925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc19cfd0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd0966640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 0x7f0dcc19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dcbfff640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc1005d0 0x7f0dcc197fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e9c0 tx=0x7f0dbc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00ccc0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc19d2c0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0dbc0035f0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00ce60 con 0x7f0dcc1005d0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.455+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1a4b50 con 0x7f0dcc1005d0 2024-03-31T23:28:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.456+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc068540 con 0x7f0dcc1005d0 2024-03-31T23:28:13.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.457+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f0dbc0037a0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.458+0000 7f0dc97fa640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0db80a2610 0x7f0db80a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.458+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9584+0+0 (secure 0 0 0) 0x7f0dbc0cf2f0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.458+0000 7f0dcb7fe640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0db80a2610 0x7f0db80a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.458+0000 7f0dcb7fe640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0db80a2610 0x7f0db80a4ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc105c50 tx=0x7f0db4005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.462+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0dbc09bd10 con 0x7f0dcc1005d0 2024-03-31T23:28:13.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.646+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0dcc1a4de0 con 0x7f0dcc1005d0 2024-03-31T23:28:13.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.647+0000 7f0dc97fa640 1 -- 172.21.15.42:0/111910925 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) ==== 93+0+10 (secure 0 0 0) 0x7f0dbc09b610 con 0x7f0dcc1005d0 2024-03-31T23:28:13.648 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0db80a2610 msgr2=0x7f0db80a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0db80a2610 0x7f0db80a4ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc105c50 tx=0x7f0db4005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc1005d0 msgr2=0x7f0dcc197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc1005d0 0x7f0dcc197fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e9c0 tx=0x7f0dbc00ee80 comp rx=0 tx=0).stop 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 shutdown_connections 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f0db80a2610 0x7f0db80a4ad0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dcc106670 0x7f0dcc19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0dcc100f90 0x7f0dcc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 --2- 172.21.15.42:0/111910925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dcc1005d0 0x7f0dcc197fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 >> 172.21.15.42:0/111910925 conn(0x7f0dcc077800 msgr2=0x7f0dcc0ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 shutdown_connections 2024-03-31T23:28:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.649+0000 7f0dd23c9640 1 -- 172.21.15.42:0/111910925 wait complete. 2024-03-31T23:28:13.660 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:28:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 -- 172.21.15.42:0/1445830997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87881077c0 msgr2=0x7f8788107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 --2- 172.21.15.42:0/1445830997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87881077c0 0x7f8788107ba0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8784009930 tx=0x7f878402bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 -- 172.21.15.42:0/1445830997 shutdown_connections 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 --2- 172.21.15.42:0/1445830997 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f878806a7c0 0x7f878810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 --2- 172.21.15.42:0/1445830997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8788069e00 0x7f878806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 --2- 172.21.15.42:0/1445830997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87881077c0 0x7f8788107ba0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 -- 172.21.15.42:0/1445830997 >> 172.21.15.42:0/1445830997 conn(0x7f8788077720 msgr2=0x7f8788077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 -- 172.21.15.42:0/1445830997 shutdown_connections 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 -- 172.21.15.42:0/1445830997 wait complete. 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 Processor -- start 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.767+0000 7f878fa64640 1 -- start start 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 0x7f87881980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 0x7f8788198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87881077c0 0x7f878819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8788111c30 con 0x7f878806a7c0 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8788111ab0 con 0x7f8788069e00 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8788111db0 con 0x7f87881077c0 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 0x7f8788198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 0x7f87881980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 0x7f87881980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.42:52120/0 (socket says 172.21.15.42:52120) 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878d800640 1 -- 172.21.15.42:0/2223849302 learned_addr learned my addr 172.21.15.42:0/2223849302 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878e001640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87881077c0 0x7f878819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 0x7f8788198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36680/0 (socket says 172.21.15.42:36680) 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 -- 172.21.15.42:0/2223849302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87881077c0 msgr2=0x7f878819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87881077c0 0x7f878819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 -- 172.21.15.42:0/2223849302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 msgr2=0x7f87881980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 0x7f87881980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 -- 172.21.15.42:0/2223849302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878819d070 con 0x7f878806a7c0 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878d800640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 0x7f87881980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878cfff640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 0x7f8788198610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f877800e9f0 tx=0x7f877800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877800ccc0 con 0x7f878806a7c0 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8778005020 con 0x7f878806a7c0 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878819d360 con 0x7f878806a7c0 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.768+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778004b40 con 0x7f878806a7c0 2024-03-31T23:28:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.769+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87881a4bf0 con 0x7f878806a7c0 2024-03-31T23:28:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.770+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8788102e40 con 0x7f878806a7c0 2024-03-31T23:28:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.771+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f8778004ce0 con 0x7f878806a7c0 2024-03-31T23:28:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.771+0000 7f877e7fc640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87740a2610 0x7f87740a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.771+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f87780cee70 con 0x7f878806a7c0 2024-03-31T23:28:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.771+0000 7f878d800640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87740a2610 0x7f87740a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.772+0000 7f878d800640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87740a2610 0x7f87740a4ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8784000c00 tx=0x7f87840058d0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.776+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f877809b920 con 0x7f878806a7c0 2024-03-31T23:28:13.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:13 smithi094 ceph-mon[36167]: pgmap v311: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:28:13.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:13 smithi094 ceph-mon[36167]: from='client.16719 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:28:13.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:13 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3773433672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:13.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:13 smithi094 ceph-mon[36167]: osdmap e102: 12 total, 12 up, 12 in 2024-03-31T23:28:13.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.965+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8788109ca0 con 0x7f878806a7c0 2024-03-31T23:28:13.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.965+0000 7f877e7fc640 1 -- 172.21.15.42:0/2223849302 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) ==== 104+0+11 (secure 0 0 0) 0x7f877809b220 con 0x7f878806a7c0 2024-03-31T23:28:13.966 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:28:13.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87740a2610 msgr2=0x7f87740a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87740a2610 0x7f87740a4ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8784000c00 tx=0x7f87840058d0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 msgr2=0x7f8788198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 0x7f8788198610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f877800e9f0 tx=0x7f877800eeb0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 shutdown_connections 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87881077c0 0x7f878819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f87740a2610 0x7f87740a4ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f878806a7c0 0x7f8788198610 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.967+0000 7f878fa64640 1 --2- 172.21.15.42:0/2223849302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8788069e00 0x7f87881980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.968+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 >> 172.21.15.42:0/2223849302 conn(0x7f8788077720 msgr2=0x7f87880fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.968+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 shutdown_connections 2024-03-31T23:28:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:13.968+0000 7f878fa64640 1 -- 172.21.15.42:0/2223849302 wait complete. 2024-03-31T23:28:13.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:13 smithi188 ceph-mon[36068]: pgmap v311: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:28:13.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:13 smithi188 ceph-mon[36068]: from='client.16719 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:28:13.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:13 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3773433672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:13.970 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:13 smithi188 ceph-mon[36068]: osdmap e102: 12 total, 12 up, 12 in 2024-03-31T23:28:13.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:13 smithi042 ceph-mon[32380]: pgmap v311: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-31T23:28:13.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:13 smithi042 ceph-mon[32380]: from='client.16719 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:28:13.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:13 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3773433672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:13.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:13 smithi042 ceph-mon[32380]: osdmap e102: 12 total, 12 up, 12 in 2024-03-31T23:28:13.979 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:28:14.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 -- 172.21.15.42:0/909318868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c006a720 msgr2=0x7f58c010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 --2- 172.21.15.42:0/909318868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c006a720 0x7f58c010e530 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ca0 tx=0x7f58b802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 -- 172.21.15.42:0/909318868 shutdown_connections 2024-03-31T23:28:14.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 --2- 172.21.15.42:0/909318868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c006a720 0x7f58c010e530 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 --2- 172.21.15.42:0/909318868 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58c0069d80 0x7f58c006a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 --2- 172.21.15.42:0/909318868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58c01076e0 0x7f58c0107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 -- 172.21.15.42:0/909318868 >> 172.21.15.42:0/909318868 conn(0x7f58c00773f0 msgr2=0x7f58c0077800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 -- 172.21.15.42:0/909318868 shutdown_connections 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.087+0000 7f58c858a640 1 -- 172.21.15.42:0/909318868 wait complete. 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 Processor -- start 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 -- start start 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58c0069d80 0x7f58c0198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58c006a720 0x7f58c0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 0x7f58c019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0111bf0 con 0x7f58c01076e0 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0111a70 con 0x7f58c006a720 2024-03-31T23:28:14.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c858a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0111d70 con 0x7f58c0069d80 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 0x7f58c019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 0x7f58c019c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36696/0 (socket says 172.21.15.42:36696) 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 -- 172.21.15.42:0/2802781593 learned_addr learned my addr 172.21.15.42:0/2802781593 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6326640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58c0069d80 0x7f58c0198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c5b25640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58c006a720 0x7f58c0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 -- 172.21.15.42:0/2802781593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58c0069d80 msgr2=0x7f58c0198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58c0069d80 0x7f58c0198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 -- 172.21.15.42:0/2802781593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58c006a720 msgr2=0x7f58c0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58c006a720 0x7f58c0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.088+0000 7f58c6b27640 1 -- 172.21.15.42:0/2802781593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c019cff0 con 0x7f58c01076e0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.089+0000 7f58c6b27640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 0x7f58c019c8c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f58b802c700 tx=0x7f58b80325d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.089+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8039040 con 0x7f58c01076e0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.089+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f58b8044070 con 0x7f58c01076e0 2024-03-31T23:28:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.089+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c019d280 con 0x7f58c01076e0 2024-03-31T23:28:14.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.089+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8004440 con 0x7f58c01076e0 2024-03-31T23:28:14.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.089+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01a4b70 con 0x7f58c01076e0 2024-03-31T23:28:14.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.090+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c0102e00 con 0x7f58c01076e0 2024-03-31T23:28:14.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.091+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f58b8003b00 con 0x7f58c01076e0 2024-03-31T23:28:14.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.091+0000 7f58b77fe640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58ac0a2690 0x7f58ac0a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.092+0000 7f58c6326640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58ac0a2690 0x7f58ac0a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.092+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f58b80f1260 con 0x7f58c01076e0 2024-03-31T23:28:14.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.092+0000 7f58c6326640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58ac0a2690 0x7f58ac0a4b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58bc005d00 tx=0x7f58bc00b410 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:14.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.096+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f58b80bde20 con 0x7f58c01076e0 2024-03-31T23:28:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.281+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f58c0199350 con 0x7f58c01076e0 2024-03-31T23:28:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.281+0000 7f58b77fe640 1 -- 172.21.15.42:0/2802781593 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) ==== 100+0+11 (secure 0 0 0) 0x7f58b80bd720 con 0x7f58c01076e0 2024-03-31T23:28:14.282 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:28:14.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58ac0a2690 msgr2=0x7f58ac0a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58ac0a2690 0x7f58ac0a4b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58bc005d00 tx=0x7f58bc00b410 comp rx=0 tx=0).stop 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 msgr2=0x7f58c019c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 0x7f58c019c8c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f58b802c700 tx=0x7f58b80325d0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 shutdown_connections 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f58ac0a2690 0x7f58ac0a4b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58c01076e0 0x7f58c019c8c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58c006a720 0x7f58c0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 --2- 172.21.15.42:0/2802781593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58c0069d80 0x7f58c0198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 >> 172.21.15.42:0/2802781593 conn(0x7f58c00773f0 msgr2=0x7f58c00ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 shutdown_connections 2024-03-31T23:28:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.283+0000 7f58c858a640 1 -- 172.21.15.42:0/2802781593 wait complete. 2024-03-31T23:28:14.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:28:14.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.401+0000 7fc602793640 1 -- 172.21.15.42:0/1374838367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc1077a0 msgr2=0x7fc5fc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.401+0000 7fc602793640 1 --2- 172.21.15.42:0/1374838367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc1077a0 0x7fc5fc107b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009930 tx=0x7fc5ec02bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 -- 172.21.15.42:0/1374838367 shutdown_connections 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 --2- 172.21.15.42:0/1374838367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5fc069310 0x7fc5fc10e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 --2- 172.21.15.42:0/1374838367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 0x7fc5fc068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 --2- 172.21.15.42:0/1374838367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc1077a0 0x7fc5fc107b80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 -- 172.21.15.42:0/1374838367 >> 172.21.15.42:0/1374838367 conn(0x7fc5fc077750 msgr2=0x7fc5fc077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 -- 172.21.15.42:0/1374838367 shutdown_connections 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 -- 172.21.15.42:0/1374838367 wait complete. 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 Processor -- start 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 -- start start 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.402+0000 7fc602793640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 0x7fc5fc1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc602793640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 0x7fc5fc1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc602793640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5fc1077a0 0x7fc5fc19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc602793640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc111bd0 con 0x7fc5fc069310 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc602793640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc111a50 con 0x7fc5fc1077a0 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc602793640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc111d50 con 0x7fc5fc068950 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 0x7fc5fc1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 0x7fc5fc1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 0x7fc5fc1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36718/0 (socket says 172.21.15.42:36718) 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fb7fe640 1 -- 172.21.15.42:0/1748928783 learned_addr learned my addr 172.21.15.42:0/1748928783 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc600d30640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5fc1077a0 0x7fc5fc19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 -- 172.21.15.42:0/1748928783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5fc1077a0 msgr2=0x7fc5fc19c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5fc1077a0 0x7fc5fc19c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 -- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 msgr2=0x7fc5fc1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 0x7fc5fc1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 -- 172.21.15.42:0/1748928783 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc19d0a0 con 0x7fc5fc068950 2024-03-31T23:28:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fb7fe640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 0x7fc5fc1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5fbfff640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 0x7fc5fc1980b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009230 tx=0x7fc5ec02dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec043020 con 0x7fc5fc068950 2024-03-31T23:28:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5fc19d330 con 0x7fc5fc068950 2024-03-31T23:28:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc5ec004e50 con 0x7fc5fc068950 2024-03-31T23:28:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.403+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec003850 con 0x7fc5fc068950 2024-03-31T23:28:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.404+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5fc1a4c20 con 0x7fc5fc068950 2024-03-31T23:28:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.404+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5fc068540 con 0x7fc5fc068950 2024-03-31T23:28:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.406+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fc5ec046020 con 0x7fc5fc068950 2024-03-31T23:28:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.406+0000 7fc5f97fa640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc5e40a2610 0x7fc5e40a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.407+0000 7fc5fb7fe640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc5e40a2610 0x7fc5e40a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.407+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7fc5ec0f10f0 con 0x7fc5fc068950 2024-03-31T23:28:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.407+0000 7fc5fb7fe640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc5e40a2610 0x7fc5e40a4ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00095f0 tx=0x7fc5f0005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:14.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.410+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc5ec04d020 con 0x7fc5fc068950 2024-03-31T23:28:14.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.593+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc5fc109c50 con 0x7fc5fc068950 2024-03-31T23:28:14.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.593+0000 7fc5f97fa640 1 -- 172.21.15.42:0/1748928783 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v102) ==== 103+0+11 (secure 0 0 0) 0x7fc5ec0bdc50 con 0x7fc5fc068950 2024-03-31T23:28:14.594 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:28:14.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.595+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc5e40a2610 msgr2=0x7fc5e40a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.595+0000 7fc602793640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc5e40a2610 0x7fc5e40a4ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00095f0 tx=0x7fc5f0005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:14.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.595+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 msgr2=0x7fc5fc1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.595+0000 7fc602793640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 0x7fc5fc1980b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009230 tx=0x7fc5ec02dc00 comp rx=0 tx=0).stop 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 shutdown_connections 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5fc1077a0 0x7fc5fc19c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc5e40a2610 0x7fc5e40a4ad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5fc069310 0x7fc5fc1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 --2- 172.21.15.42:0/1748928783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5fc068950 0x7fc5fc1980b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 >> 172.21.15.42:0/1748928783 conn(0x7fc5fc077750 msgr2=0x7fc5fc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 shutdown_connections 2024-03-31T23:28:14.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.596+0000 7fc602793640 1 -- 172.21.15.42:0/1748928783 wait complete. 2024-03-31T23:28:14.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-31T23:28:14.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 -- 172.21.15.42:0/1261826281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 msgr2=0x7fe0d4106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 --2- 172.21.15.42:0/1261826281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d4106a80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009930 tx=0x7fe0c402bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 -- 172.21.15.42:0/1261826281 shutdown_connections 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 --2- 172.21.15.42:0/1261826281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100fc0 0x7fe0d410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 --2- 172.21.15.42:0/1261826281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100600 0x7fe0d4100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 --2- 172.21.15.42:0/1261826281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d4106a80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 -- 172.21.15.42:0/1261826281 >> 172.21.15.42:0/1261826281 conn(0x7fe0d40769d0 msgr2=0x7fe0d4076de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 -- 172.21.15.42:0/1261826281 shutdown_connections 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.710+0000 7fe0d9702640 1 -- 172.21.15.42:0/1261826281 wait complete. 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 Processor -- start 2024-03-31T23:28:14.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 -- start start 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 0x7fe0d4198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100fc0 0x7fe0d4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d41a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4110af0 con 0x7fe0d41066a0 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4110970 con 0x7fe0d4100fc0 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d9702640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4110c70 con 0x7fe0d4100600 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d2ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 0x7fe0d4198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d41a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d2ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 0x7fe0d4198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:52178/0 (socket says 172.21.15.42:52178) 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d41a3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36732/0 (socket says 172.21.15.42:36732) 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0d2ffd640 1 -- 172.21.15.42:0/590742057 learned_addr learned my addr 172.21.15.42:0/590742057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.711+0000 7fe0cbfff640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100fc0 0x7fe0d4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0cbfff640 1 -- 172.21.15.42:0/590742057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 msgr2=0x7fe0d4198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0cbfff640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 0x7fe0d4198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0cbfff640 1 -- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 msgr2=0x7fe0d41a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0cbfff640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d41a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0cbfff640 1 -- 172.21.15.42:0/590742057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d41a4490 con 0x7fe0d4100fc0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d2ffd640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 0x7fe0d4198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d37fe640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d41a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0cbfff640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100fc0 0x7fe0d4199410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00e9f0 tx=0x7fe0bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00cd80 con 0x7fe0d4100fc0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0bc0035f0 con 0x7fe0d4100fc0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d41a4660 con 0x7fe0d4100fc0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc010650 con 0x7fe0d4100fc0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.712+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d41a4b80 con 0x7fe0d4100fc0 2024-03-31T23:28:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.713+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d4101d40 con 0x7fe0d4100fc0 2024-03-31T23:28:14.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.714+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fe0bc0037a0 con 0x7fe0d4100fc0 2024-03-31T23:28:14.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.714+0000 7fe0d0ff9640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fe0c00a2610 0x7fe0c00a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:14.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.715+0000 7fe0d2ffd640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fe0c00a2610 0x7fe0c00a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:14.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.715+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7fe0bc0cf200 con 0x7fe0d4100fc0 2024-03-31T23:28:14.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.715+0000 7fe0d2ffd640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fe0c00a2610 0x7fe0c00a4ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4005ec0 tx=0x7fe0c4009620 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:14.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.719+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe0bc09bcb0 con 0x7fe0d4100fc0 2024-03-31T23:28:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:14 smithi094 ceph-mon[36167]: from='client.16725 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:28:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:14 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/111910925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:28:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:14 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2223849302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:28:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:14 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2802781593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:28:14.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:14 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1748928783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:28:14.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.949+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe0d4068990 con 0x7fe0d4100fc0 2024-03-31T23:28:14.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.957+0000 7fe0d0ff9640 1 -- 172.21.15.42:0/590742057 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+738940 (secure 0 0 0) 0x7fe0d4068990 con 0x7fe0d4100fc0 2024-03-31T23:28:14.968 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:28:14.968 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:28:14.968 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 25, 2024-03-31T23:28:14.968 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:14.968 INFO:teuthology.orchestra.run.smithi042.stdout: "active_gid": 15714, 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "active_name": "x", 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "active_addrs": { 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6800", 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 4058163900 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6801", 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 4058163900 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:14.969 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "active_addr": "172.21.15.42:6801/4058163900", 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "active_change": "2024-03-31T23:18:09.837803+0000", 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "active_mgr_features": 4540701547738038271, 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "available": true, 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "standbys": [ 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "gid": 15708, 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "z", 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_features": 4540701547738038271, 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-03-31T23:28:14.970 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.971 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:14.972 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:14.973 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.975 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-03-31T23:28:14.976 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-03-31T23:28:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.978 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.979 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.980 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.981 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.982 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:14.983 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:14.985 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.986 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-31T23:28:14.987 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-31T23:28:14.988 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.989 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.990 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.991 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:14.994 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.995 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.996 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:14.997 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:14.998 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:14.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.001 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.002 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-03-31T23:28:15.003 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.004 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.005 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.006 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.007 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.010 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.012 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.014 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-03-31T23:28:15.015 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-03-31T23:28:15.016 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.017 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.019 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.020 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.021 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.022 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.023 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-31T23:28:15.024 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.025 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-03-31T23:28:15.027 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.028 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.029 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.030 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.033 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.034 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-03-31T23:28:15.035 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.036 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.037 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.038 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.039 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.040 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.041 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.042 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.043 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.044 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-31T23:28:15.045 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-31T23:28:15.046 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-03-31T23:28:15.047 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.048 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.050 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.051 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.054 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-03-31T23:28:15.055 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-03-31T23:28:15.056 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-03-31T23:28:15.057 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-03-31T23:28:15.058 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-03-31T23:28:15.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-03-31T23:28:15.061 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.062 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.063 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.064 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.066 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.067 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.068 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.069 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.070 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.071 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.073 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.074 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.075 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.076 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.077 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.078 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.079 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.080 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.081 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.082 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.085 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-31T23:28:15.086 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-03-31T23:28:15.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.088 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.089 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.090 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.092 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.093 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.094 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.095 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.096 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.097 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.098 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.099 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.100 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.101 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.102 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.105 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.106 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.108 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-03-31T23:28:15.109 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-31T23:28:15.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-31T23:28:15.111 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.112 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.114 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-03-31T23:28:15.115 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.118 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.118 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.118 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.118 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.118 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.118 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.119 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.120 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.121 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.122 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.123 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.124 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.125 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.127 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.128 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.129 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.130 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.131 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.132 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.135 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.136 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.137 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.138 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.139 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.140 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-03-31T23:28:15.141 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-03-31T23:28:15.142 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.144 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.145 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.146 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-03-31T23:28:15.147 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.148 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.149 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.150 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.151 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-03-31T23:28:15.153 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.154 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-03-31T23:28:15.155 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.157 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.158 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.160 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.161 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.162 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.165 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-03-31T23:28:15.166 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.167 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.168 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.169 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.173 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.174 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.175 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.176 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.177 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.178 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.180 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.181 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.182 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.183 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.184 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.185 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.186 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.188 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.189 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.190 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.191 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.192 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.193 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.194 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.195 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-03-31T23:28:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.199 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.200 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.201 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.204 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.205 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.206 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.207 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.208 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.209 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.211 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.212 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.213 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-03-31T23:28:15.214 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.215 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.216 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.217 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.218 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.219 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.220 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.222 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.223 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.224 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.225 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.227 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.228 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.229 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.230 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.231 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.233 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.235 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.236 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.237 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.238 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.239 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.240 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.242 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.244 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.245 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.246 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.247 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-03-31T23:28:15.248 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.249 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.250 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.251 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.252 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.253 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.254 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-03-31T23:28:15.255 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.256 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.258 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.259 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.260 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.261 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-03-31T23:28:15.262 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.263 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.264 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.265 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.266 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-03-31T23:28:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-03-31T23:28:15.270 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.271 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.272 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.274 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.275 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.277 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.279 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.281 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.282 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.283 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.284 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.285 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.286 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.287 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.288 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.289 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.290 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.291 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.292 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.293 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.294 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.295 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.296 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.297 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.298 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.299 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.300 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.301 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.302 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.304 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.305 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.306 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.309 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.310 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.311 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.312 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.313 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.314 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.315 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.316 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.317 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.318 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.319 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.320 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.322 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.322 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.322 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.322 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.322 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.323 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.324 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.326 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.327 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.329 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.330 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.331 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.332 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.333 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.335 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.336 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-31T23:28:15.337 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.338 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.339 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-03-31T23:28:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-03-31T23:28:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.346 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.347 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.348 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.350 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.351 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.352 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.353 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.354 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.355 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.356 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.357 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.358 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.359 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.360 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.361 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.362 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.363 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.364 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-03-31T23:28:15.366 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-03-31T23:28:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-03-31T23:28:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.371 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.372 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.374 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.375 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.376 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-03-31T23:28:15.379 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-31T23:28:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "gid": 25535, 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "y", 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_features": 4540701547738038271, 2024-03-31T23:28:15.381 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.382 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.383 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.384 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.385 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.386 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.387 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.389 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-03-31T23:28:15.390 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-03-31T23:28:15.391 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.393 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.395 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-03-31T23:28:15.396 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-03-31T23:28:15.397 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-31T23:28:15.398 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-31T23:28:15.399 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.400 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.401 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.403 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.404 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.407 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.408 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.409 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.410 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-31T23:28:15.411 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-31T23:28:15.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.414 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-03-31T23:28:15.415 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.416 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.417 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-31T23:28:15.418 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.419 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-03-31T23:28:15.420 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.421 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.422 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-31T23:28:15.423 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.424 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-31T23:28:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-31T23:28:15.427 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.428 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-31T23:28:15.429 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-31T23:28:15.431 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.432 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.433 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.434 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.435 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.437 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.438 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.439 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.440 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.442 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.443 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.444 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.445 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.446 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.447 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.448 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.449 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.450 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.451 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.452 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.453 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.454 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.455 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.456 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.458 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-03-31T23:28:15.459 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-03-31T23:28:15.460 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-03-31T23:28:15.461 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.462 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-03-31T23:28:15.463 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-03-31T23:28:15.464 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.465 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.466 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.467 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.468 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.471 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.472 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.473 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.474 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.475 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.476 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.478 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.479 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.480 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.481 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.482 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.483 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-03-31T23:28:15.484 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.485 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.486 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.487 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.488 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-31T23:28:15.491 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-31T23:28:15.492 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-31T23:28:15.493 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-31T23:28:15.494 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.495 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.498 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.499 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.500 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.501 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.502 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.503 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.504 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.505 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.507 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.508 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.509 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.510 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.511 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.512 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.513 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.514 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.515 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.516 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.517 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.518 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-03-31T23:28:15.519 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-31T23:28:15.520 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-03-31T23:28:15.521 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-31T23:28:15.522 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.523 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.527 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.528 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.529 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.530 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.531 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.533 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.534 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.535 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.536 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.537 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.538 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.539 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-03-31T23:28:15.540 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.541 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.542 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.543 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.544 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.546 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.547 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.549 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.550 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.552 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.553 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.554 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.555 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.556 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-03-31T23:28:15.557 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.559 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.560 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.561 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.564 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.566 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.567 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.568 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.569 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-03-31T23:28:15.570 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-03-31T23:28:15.572 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.573 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.574 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.575 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.576 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.577 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.578 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-03-31T23:28:15.579 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-03-31T23:28:15.580 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.581 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.582 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.584 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.585 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.586 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.587 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.588 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.589 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.590 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.591 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.592 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.593 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.594 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.595 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.596 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.597 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.598 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.599 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.600 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.601 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.602 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.603 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.604 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-03-31T23:28:15.605 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-31T23:28:15.606 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.607 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.608 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.610 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.611 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.612 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.613 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.614 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.616 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.617 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.618 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.620 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.622 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.623 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.624 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.625 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.626 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.627 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.628 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.629 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.630 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.631 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.634 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.635 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.636 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.637 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.638 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.646 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.647 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.648 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.649 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.650 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.651 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.653 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.654 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.655 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.656 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.657 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.658 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-03-31T23:28:15.659 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.661 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.662 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.665 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.666 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.667 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.668 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.671 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.672 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.674 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.675 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.677 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.678 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.679 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-31T23:28:15.680 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.681 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-03-31T23:28:15.682 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-03-31T23:28:15.683 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.684 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.685 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.686 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.687 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.688 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-03-31T23:28:15.689 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-03-31T23:28:15.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.691 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-03-31T23:28:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.693 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.694 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.695 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.696 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.697 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.698 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.700 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.702 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.703 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.704 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.705 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.706 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.707 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.708 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.709 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.711 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-31T23:28:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.713 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.714 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.715 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.716 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.717 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.718 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.719 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.720 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.722 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.724 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.725 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.726 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.727 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-03-31T23:28:15.728 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-03-31T23:28:15.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-03-31T23:28:15.734 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.735 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.736 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.739 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.741 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.742 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.744 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.746 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.747 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.749 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.750 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-03-31T23:28:15.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.752 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.753 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.754 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.755 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.756 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.757 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.758 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.760 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.762 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-03-31T23:28:15.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.764 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.765 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.766 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.767 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.768 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.769 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.770 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.771 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.772 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.773 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.774 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.775 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.776 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.777 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.778 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.779 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.780 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.781 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.782 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.783 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-03-31T23:28:15.784 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.785 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.786 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.787 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.788 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-03-31T23:28:15.789 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-03-31T23:28:15.790 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.791 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.792 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.793 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.794 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.795 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.796 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.797 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.798 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.799 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.800 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.802 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-03-31T23:28:15.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.804 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:15.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "modules": [ 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "dashboard", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "iostat", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "nfs", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "restful", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_schedule" 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.806 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.807 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.808 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.809 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.810 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.811 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.812 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.814 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.815 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.816 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.817 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.818 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.819 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-03-31T23:28:15.820 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.821 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.822 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.823 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.824 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-03-31T23:28:15.825 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.826 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-03-31T23:28:15.827 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.828 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.829 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.830 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.831 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.832 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-03-31T23:28:15.833 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-03-31T23:28:15.834 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-03-31T23:28:15.835 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.836 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.837 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-03-31T23:28:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-03-31T23:28:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-03-31T23:28:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.843 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.844 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:15.845 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-03-31T23:28:15.846 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-03-31T23:28:15.847 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.848 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.849 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-03-31T23:28:15.850 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.851 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.852 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.853 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.854 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-03-31T23:28:15.855 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.857 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-31T23:28:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.859 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.860 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-03-31T23:28:15.861 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-03-31T23:28:15.863 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.864 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.865 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.866 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-03-31T23:28:15.868 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.870 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.874 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.876 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-03-31T23:28:15.877 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-03-31T23:28:15.878 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.879 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.880 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-31T23:28:15.881 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.882 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.883 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.884 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.885 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.886 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.887 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-03-31T23:28:15.888 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.889 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-03-31T23:28:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.891 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-03-31T23:28:15.892 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.893 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.894 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.895 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.896 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.897 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.898 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.899 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.900 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-03-31T23:28:15.901 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-31T23:28:15.902 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.903 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.904 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.908 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.909 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.910 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.911 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.912 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.913 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-03-31T23:28:15.914 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.916 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.917 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.918 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.919 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.920 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.921 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.922 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.923 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.924 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.925 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.926 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.927 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.928 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.930 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-31T23:28:15.931 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-03-31T23:28:15.932 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.934 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.935 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.938 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.938 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.938 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.938 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.938 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.938 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.939 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.940 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.941 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-03-31T23:28:15.942 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.944 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.945 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-31T23:28:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.948 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.949 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.951 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.952 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-31T23:28:15.953 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.955 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.956 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.957 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-31T23:28:15.958 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.960 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.961 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.962 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.963 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-31T23:28:15.964 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.965 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.966 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.967 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.968 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.969 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-03-31T23:28:15.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.971 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.972 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.973 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.974 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.975 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.976 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.977 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.978 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.980 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.981 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.982 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.983 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-03-31T23:28:15.985 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.986 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.987 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.988 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.990 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-03-31T23:28:15.990 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-03-31T23:28:15.990 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.990 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.990 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.990 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-03-31T23:28:15.991 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.992 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-03-31T23:28:15.993 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-03-31T23:28:15.995 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-03-31T23:28:15.996 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:15.997 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:15.998 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:15.999 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.000 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.001 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.002 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.004 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.005 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.008 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-03-31T23:28:16.010 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.013 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.014 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:16.015 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.017 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-03-31T23:28:16.018 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.020 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.021 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.023 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.024 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.025 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-03-31T23:28:16.026 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.027 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.030 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-03-31T23:28:16.031 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-31T23:28:16.032 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.033 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.033 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.033 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-03-31T23:28:16.033 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-03-31T23:28:16.033 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.034 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.035 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:16.036 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.037 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.038 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.039 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.040 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.041 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.042 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.043 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.045 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.046 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-03-31T23:28:16.047 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.048 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.049 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-03-31T23:28:16.050 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.051 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.052 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.053 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.055 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.056 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.057 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.058 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.059 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.060 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.061 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.062 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.063 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.064 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.065 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.070 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-03-31T23:28:16.070 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.070 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.070 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-31T23:28:16.071 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.072 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.075 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.076 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.079 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.081 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.082 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.083 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.084 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.085 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.086 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.087 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-03-31T23:28:16.088 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-31T23:28:16.089 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.090 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.091 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.092 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.093 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.094 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.095 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.096 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.097 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.098 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.099 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.101 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.102 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.103 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.104 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.105 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-31T23:28:16.107 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.108 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.110 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.111 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-03-31T23:28:16.113 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.114 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.115 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.116 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.117 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.118 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-03-31T23:28:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.120 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.121 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.122 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.123 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.125 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.126 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.128 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.129 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.131 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.132 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.133 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.134 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.136 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.137 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.138 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.139 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.140 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.141 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.142 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.143 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.144 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.145 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.147 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.148 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.149 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.150 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.151 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.153 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.154 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.155 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.156 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.157 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.158 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.159 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.160 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.161 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-03-31T23:28:16.162 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-03-31T23:28:16.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-03-31T23:28:16.164 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.165 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.166 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.167 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.168 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.169 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.170 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-03-31T23:28:16.172 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-03-31T23:28:16.173 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.175 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.176 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.177 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.178 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.181 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.182 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.183 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.184 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.185 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-31T23:28:16.186 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.187 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.188 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.190 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.191 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.192 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.193 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.194 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-03-31T23:28:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-03-31T23:28:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-03-31T23:28:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-03-31T23:28:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-03-31T23:28:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "services": { 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "dashboard": "https://172.21.15.42:8443/" 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "always_on_modules": { 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "octopus": [ 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-03-31T23:28:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "pacific": [ 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "quincy": [ 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "reef": [ 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-03-31T23:28:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "squid": [ 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-03-31T23:28:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "last_failure_osd_epoch": 94, 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "active_clients": [ 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-03-31T23:28:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1787092972 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "libcephsqlite", 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 197807802 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-03-31T23:28:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 335670640 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-03-31T23:28:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2489719740 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3904716589 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-03-31T23:28:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2184992218 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-03-31T23:28:16.288 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:15 smithi094 ceph-mon[36167]: pgmap v313: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:15 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/590742057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:14 smithi188 ceph-mon[36068]: from='client.16725 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:14 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/111910925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:14 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2223849302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:14 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2802781593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:14 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1748928783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:15 smithi188 ceph-mon[36068]: pgmap v313: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2024-03-31T23:28:16.290 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:15 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/590742057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fe0c00a2610 msgr2=0x7fe0c00a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fe0c00a2610 0x7fe0c00a4ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4005ec0 tx=0x7fe0c4009620 comp rx=0 tx=0).stop 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100fc0 msgr2=0x7fe0d4199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100fc0 0x7fe0d4199410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00e9f0 tx=0x7fe0bc00eeb0 comp rx=0 tx=0).stop 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 shutdown_connections 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fe0c00a2610 0x7fe0c00a4ad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d41066a0 0x7fe0d41a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0d4100fc0 0x7fe0d4199410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 --2- 172.21.15.42:0/590742057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d4100600 0x7fe0d4198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 >> 172.21.15.42:0/590742057 conn(0x7fe0d40769d0 msgr2=0x7fe0d40fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 shutdown_connections 2024-03-31T23:28:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:14.962+0000 7fe0d9702640 1 -- 172.21.15.42:0/590742057 wait complete. 2024-03-31T23:28:16.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:14 smithi042 ceph-mon[32380]: from='client.16725 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-31T23:28:16.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:14 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/111910925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:14 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2223849302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:14 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2802781593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:14 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1748928783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:28:16.299 DEBUG:tasks.check_counter:Getting stats from a 2024-03-31T23:28:16.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.a perf dump 2024-03-31T23:28:16.299 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:15 smithi042 ceph-mon[32380]: pgmap v313: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2024-03-31T23:28:16.299 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:15 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/590742057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-31T23:28:16.553 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:28:17.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:17 smithi042 ceph-mon[32380]: pgmap v314: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 16 op/s 2024-03-31T23:28:17.921 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:17 smithi094 ceph-mon[36167]: pgmap v314: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 16 op/s 2024-03-31T23:28:17.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:17 smithi188 ceph-mon[36068]: pgmap v314: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 16 op/s 2024-03-31T23:28:18.308 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1021, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1021, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 4517877, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 323855, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.104582415, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.036603811, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.027943313, 2024-03-31T23:28:18.309 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.029788397, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1020, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.044981369, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000044099 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 448 2024-03-31T23:28:18.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 947, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 908, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 6030088, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 347968, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.105298927, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.034280480, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.054107053, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.021756475, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 907, 2024-03-31T23:28:18.311 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.034443772, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000037975 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1659680, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 131024 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 473, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 630, 2024-03-31T23:28:18.312 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 212529, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 587698, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 7, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.056179728, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.025986468, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.012476463, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.011719509, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 627, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.028224765, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000045015 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:18.313 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 437920 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3583, 2024-03-31T23:28:18.314 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.098246639, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000027420 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 0, 2024-03-31T23:28:18.315 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 1709, 2024-03-31T23:28:18.316 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 1709, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 1709, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 1, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2024-03-31T23:28:18.317 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:18.318 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 0, 2024-03-31T23:28:18.319 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 0 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:18.320 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 3827, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 6, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 2, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-03-31T23:28:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 12672241, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 12670153, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 3827 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 372, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 1681, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 1309, 2024-03-31T23:28:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 58, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 113, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 55, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 1709, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 2649, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 940, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 0, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 0, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 0, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 55128, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 215420 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 0, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-03-31T23:28:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 0, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 0, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.325 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:18.326 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:18.327 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.328 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-03-31T23:28:18.329 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.329 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.329 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.331 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.332 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.333 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-03-31T23:28:18.334 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.335 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 2, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 3, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 1, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 2, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 0, 2024-03-31T23:28:18.336 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 1744, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:18.337 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:18.338 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 213666, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 474, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:18.339 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 182, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 2203057, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 26076, 2024-03-31T23:28:18.340 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 2170, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 21, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 3, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 2170, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2170, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.827984978, 2024-03-31T23:28:18.341 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000842389 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2170, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2171 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 2170, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 2170, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 0, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 1399, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 0, 2024-03-31T23:28:18.342 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 769, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:18.343 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-03-31T23:28:18.344 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 102, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 13, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 6, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 6, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-03-31T23:28:18.345 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 0, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 0 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 0, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "osd-slow-ops": { 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-03-31T23:28:18.346 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 2437, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 10524709, 2024-03-31T23:28:18.347 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 2437, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2437, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 10524709, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-03-31T23:28:18.348 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2170, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 8477942, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2170, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8477942, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.349 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2170, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 2170, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2170, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 2170, 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:18.350 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:18.351 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x55c890f8e6e0": { 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:18.352 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:18.353 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:18.982 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:18.982 DEBUG:tasks.check_counter:Getting stats from d 2024-03-31T23:28:18.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.d perf dump 2024-03-31T23:28:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:28:19.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:19 smithi094 ceph-mon[36167]: pgmap v315: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 243 B/s wr, 17 op/s 2024-03-31T23:28:19.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:19 smithi188 ceph-mon[36068]: pgmap v315: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 243 B/s wr, 17 op/s 2024-03-31T23:28:20.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:19 smithi042 ceph-mon[32380]: pgmap v315: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 243 B/s wr, 17 op/s 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 228, 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 216, 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1441568, 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 131712, 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-03-31T23:28:20.952 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.047085911, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.014718952, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.035257443, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.004437497, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 216, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011017043, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000051004 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.953 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1441568, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 131712 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 164, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 320, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 184304, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.014721104, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.009859601, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.002431530, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:20.954 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 161, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.014701922, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000091316 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 184304 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-03-31T23:28:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.000271059, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000190027, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:20.956 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:20.957 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:20.958 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:20.959 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 148731, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 31, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 226, 2024-03-31T23:28:20.961 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 1406973, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 226, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 226, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 1406973, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:20.962 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-03-31T23:28:21.605 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-03-31T23:28:21.605 DEBUG:tasks.check_counter:Getting stats from g 2024-03-31T23:28:21.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.g perf dump 2024-03-31T23:28:21.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:21 smithi042 ceph-mon[32380]: pgmap v316: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 204 B/s wr, 14 op/s 2024-03-31T23:28:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:28:21.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:21 smithi094 ceph-mon[36167]: pgmap v316: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 204 B/s wr, 14 op/s 2024-03-31T23:28:21.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:21 smithi188 ceph-mon[36068]: pgmap v316: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 204 B/s wr, 14 op/s 2024-03-31T23:28:23.605 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:28:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 737, 2024-03-31T23:28:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 739, 2024-03-31T23:28:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 247577, 2024-03-31T23:28:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 234367, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.081094298, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.034642765, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.017044887, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.020880057, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 737, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.038067512, 2024-03-31T23:28:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000051651 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1669, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1628, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 9893189, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 577215, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.132626324, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.036088654, 2024-03-31T23:28:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.064260678, 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.036647957, 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1628, 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.048376425, 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000029715 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1663584, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 132912 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 5, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 163, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1668, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 440677, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 7, 2024-03-31T23:28:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.012905009, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.008297239, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.002463267, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000065812, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 160, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.010965988, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000068537 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 439712 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3555, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.084589943, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000023794 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 0, 2024-03-31T23:28:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 1511, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 1511, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 1511, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 1, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 1, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-03-31T23:28:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-03-31T23:28:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 0 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 0, 2024-03-31T23:28:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 0, 2024-03-31T23:28:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 3452, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-03-31T23:28:23.621 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 0, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 5, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 2, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 12068311, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 12066223, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.622 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 3452 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 247, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 2123, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 1876, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 44, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 165, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 121, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 1511, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 3324, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 1813, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 0, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 0, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 0, 2024-03-31T23:28:23.623 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 55336, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 215420 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.624 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.626 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.628 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-03-31T23:28:23.628 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.628 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.628 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.631 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:23.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 3, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 2, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 3, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 0, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 0, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 4031, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.635 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:23.636 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 207836, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 335, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 182, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 1743474, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 19494, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-03-31T23:28:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 2137, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 21, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 3, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 2137, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2137, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 6.670944945, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003121640 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-03-31T23:28:23.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2137, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2138 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 2137, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 2137, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 1361, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 774, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-03-31T23:28:23.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-03-31T23:28:23.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-03-31T23:28:23.643 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 102, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 13, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 6, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 6, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 0, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 0 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-03-31T23:28:23.644 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "osd-slow-ops": { 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 0, 2024-03-31T23:28:23.645 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 2407, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 9909193, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 2407, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2407, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 9909193, 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:23.646 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2137, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 7874012, 2024-03-31T23:28:23.647 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2137, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 7874012, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:23.648 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2137, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 2137, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2137, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 2137, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:23.649 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x5561566b46e0": { 2024-03-31T23:28:23.650 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.651 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:23.652 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:28:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:23 smithi094 ceph-mon[36167]: pgmap v317: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 14 op/s 2024-03-31T23:28:23.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:23 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:28:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:23 smithi188 ceph-mon[36068]: pgmap v317: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 14 op/s 2024-03-31T23:28:23.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:23 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:28:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:23 smithi042 ceph-mon[32380]: pgmap v317: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 14 op/s 2024-03-31T23:28:24.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:23 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:24.398 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:24.399 DEBUG:tasks.check_counter:Getting stats from j 2024-03-31T23:28:24.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.j perf dump 2024-03-31T23:28:25.212 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-31T23:28:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: pgmap v318: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 98 B/s wr, 13 op/s 2024-03-31T23:28:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.923 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:25 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: pgmap v318: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 98 B/s wr, 13 op/s 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:25.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:25 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: pgmap v318: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 98 B/s wr, 13 op/s 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:25 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:26 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi094 to 174.1M 2024-03-31T23:28:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:26 smithi094 ceph-mon[36167]: Unable to set osd_memory_target on smithi094 to 182619136: error parsing value: Value '182619136' is below minimum 939524096 2024-03-31T23:28:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:26 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:26 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:26 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:26 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.932 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:26 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi094 to 174.1M 2024-03-31T23:28:26.932 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:26 smithi042 ceph-mon[32380]: Unable to set osd_memory_target on smithi094 to 182619136: error parsing value: Value '182619136' is below minimum 939524096 2024-03-31T23:28:26.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:26 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:26 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:26 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.933 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:26 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:26 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi094 to 174.1M 2024-03-31T23:28:26.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:26 smithi188 ceph-mon[36068]: Unable to set osd_memory_target on smithi094 to 182619136: error parsing value: Value '182619136' is below minimum 939524096 2024-03-31T23:28:26.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:26 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:26 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:26 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:26.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:26 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:27.074 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.001125785, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000267160, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:27.075 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.076 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 165, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 320, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 184480, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.014584330, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.010341545, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.001732799, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 162, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011263291, 2024-03-31T23:28:27.077 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000069526 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 184480 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 230, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 218, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1442112, 2024-03-31T23:28:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 132992, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.041626610, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.013979415, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.032277051, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.004250865, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 218, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011115629, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000050989 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:27.079 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1442112, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 132992 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:27.080 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:27.081 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 149745, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 31, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:27.083 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-03-31T23:28:27.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 228, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 1407233, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 228, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 228, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 1407233, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-03-31T23:28:27.085 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-03-31T23:28:27.086 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-03-31T23:28:27.086 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:27.086 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-03-31T23:28:27.086 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-03-31T23:28:27.770 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-03-31T23:28:27.771 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-03-31T23:28:27.771 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-03-31T23:28:27.771 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-03-31T23:28:27.771 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-03-31T23:28:27.771 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-03-31T23:28:27.771 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-03-31T23:28:27.771 DEBUG:tasks.check_counter:Getting stats from b 2024-03-31T23:28:27.771 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.b perf dump 2024-03-31T23:28:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:27 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi188 to 174.1M 2024-03-31T23:28:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:27 smithi094 ceph-mon[36167]: Unable to set osd_memory_target on smithi188 to 182618419: error parsing value: Value '182618419' is below minimum 939524096 2024-03-31T23:28:27.922 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:27 smithi094 ceph-mon[36167]: pgmap v319: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 85 B/s wr, 15 op/s 2024-03-31T23:28:27.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:27 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi188 to 174.1M 2024-03-31T23:28:27.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:27 smithi188 ceph-mon[36068]: Unable to set osd_memory_target on smithi188 to 182618419: error parsing value: Value '182618419' is below minimum 939524096 2024-03-31T23:28:27.969 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:27 smithi188 ceph-mon[36068]: pgmap v319: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 85 B/s wr, 15 op/s 2024-03-31T23:28:28.022 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:28:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:27 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi188 to 174.1M 2024-03-31T23:28:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:27 smithi042 ceph-mon[32380]: Unable to set osd_memory_target on smithi188 to 182618419: error parsing value: Value '182618419' is below minimum 939524096 2024-03-31T23:28:28.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:27 smithi042 ceph-mon[32380]: pgmap v319: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 85 B/s wr, 15 op/s 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: pgmap v320: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: Adjusting osd_memory_target on smithi042 to 177.2M 2024-03-31T23:28:29.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: Unable to set osd_memory_target on smithi042 to 185897779: error parsing value: Value '185897779' is below minimum 939524096 2024-03-31T23:28:29.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:28:29.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:28:29.173 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:28 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: pgmap v320: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: Adjusting osd_memory_target on smithi042 to 177.2M 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: Unable to set osd_memory_target on smithi042 to 185897779: error parsing value: Value '185897779' is below minimum 939524096 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:28:29.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:28 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: pgmap v320: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: Adjusting osd_memory_target on smithi042 to 177.2M 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: Unable to set osd_memory_target on smithi042 to 185897779: error parsing value: Value '185897779' is below minimum 939524096 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-31T23:28:29.326 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:28 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' 2024-03-31T23:28:30.138 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 28222, 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 34332, 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 9108876, 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 51269855, 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 13, 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-03-31T23:28:30.139 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 2.035304476, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.753381642, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.794001544, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.540051639, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 34327, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 12.894796116, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000375645 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 36661, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.005668159, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000154 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-31T23:28:30.140 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 311728 2024-03-31T23:28:30.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.141 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:30.141 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 24593, 2024-03-31T23:28:30.141 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 27907, 2024-03-31T23:28:30.141 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 8405208, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 43618754, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 27, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 2.227552233, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.842723090, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.676350790, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.682485130, 2024-03-31T23:28:30.142 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 27907, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 24.877001697, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000891425 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 19048, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.004218131, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000221 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 342656, 2024-03-31T23:28:30.143 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 230336 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 50693, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 89066, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 18332718, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 66638076, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 66, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 3.426886568, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 1.593888803, 2024-03-31T23:28:30.144 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 1.927794212, 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.409974937, 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 89066, 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 15.443377311, 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000173392 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.145 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:30.146 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 76678, 2024-03-31T23:28:30.146 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.017345729, 2024-03-31T23:28:30.146 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000226 2024-03-31T23:28:30.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.146 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 1798000, 2024-03-31T23:28:30.146 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 180272 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 1, 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-MDSRank": { 2024-03-31T23:28:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 4934, 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 33.254759774, 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.006739918 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.148 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:30.149 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:30.149 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:30.149 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 11340, 2024-03-31T23:28:30.149 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 3.113722700, 2024-03-31T23:28:30.149 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000274578 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": { 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "request": 17935, 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "reply": 17831, 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "reply_latency": { 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 17831, 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 54.807830143, 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003073738 2024-03-31T23:28:30.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_reply": 0, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "forward": 104, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_complete": 4, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_keys": 1, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_commit": 1444, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_split": 15, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_merge": 5, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes": 6251, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_top": 3647, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_bottom": 2474, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pin_tail": 130, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pinned": 983, 2024-03-31T23:28:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_expired": 4634, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_with_caps": 2, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": 2, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "subtrees": 6, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse": 19398, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_hit": 18645, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_forward": 0, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_discover": 250, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_lock": 0, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "load_cent": 0, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "q": 0, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "exported": 65, 2024-03-31T23:28:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: "exported_inodes": 3927, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "imported": 65, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "imported_inodes": 3105, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_backtrace_fetch": 4799, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rfiles": 4, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rbytes": 234, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rsnaps": 6, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_fetch": 4799, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_inodes": 452, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_base_inodes": 5, 2024-03-31T23:28:30.153 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dirfrag_rstats": 447, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_file_inodes": 4347, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_inode_file_caps": 94, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_revoke": 1470, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_grant": 17036, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps": 13124, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps_dirty": 9984, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_cap_release": 66, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "process_request_cap_release": 8017 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_cache": { 2024-03-31T23:28:30.154 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update": 2801, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update_receipt": 626, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_try_discover": 410, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_send_discover": 396, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_handle_discover": 5402, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays": 167, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_created": 6489, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_enqueued": 6322, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_migrated": 0, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:30.155 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_started": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_completed": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_enqueue_scrub": 5, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_exportdir": 72, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_flush": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragmentdir": 20, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_inodestats": 0 2024-03-31T23:28:30.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_log": { 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "evlrg": 0, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "evadd": 35386, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "evex": 34605, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "evtrm": 34605, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "ev": 781, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "evexg": 0, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "evexd": 5659, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "segadd": 54, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "segex": 52, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "segtrm": 52, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "seg": 2, 2024-03-31T23:28:30.157 INFO:teuthology.orchestra.run.smithi094.stdout: "segmjr": 1, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "segexg": 0, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "segexd": 8, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "expos": 82729609, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "wrpos": 84034211, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "rdpos": 0, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "jlat": { 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1543, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 110.996648730, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.071935611 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "replayed": 0 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_mem": { 2024-03-31T23:28:30.158 INFO:teuthology.orchestra.run.smithi094.stdout: "ino": 2582, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "ino+": 12951, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "ino-": 10369, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "dir": 232, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "dir+": 1003, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "dir-": 771, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "dn": 6251, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "dn+": 19502, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "dn-": 13251, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "cap": 2, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "cap+": 10215, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "cap-": 10213, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "rss": 112292, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "heap": 231804 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.159 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_server": { 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_client_request": 21379, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_server_request": 1645, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_request": 17935, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_session": 92, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_peer_request": 3703, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "req_create_latency": { 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 9320, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 24.533500163, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002632349 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getattr_latency": { 2024-03-31T23:28:30.160 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 156, 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.095854144, 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000614449 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "req_link_latency": { 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookup_latency": { 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 403, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.394725180, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000979466 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.162 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupino_latency": { 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupname_latency": { 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.163 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.164 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.164 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:30.164 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.164 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lssnap_latency": { 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 10, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.001602990, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000160299 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mkdir_latency": { 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 623, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.648912792, 2024-03-31T23:28:30.165 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001041593 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mknod_latency": { 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mksnap_latency": { 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 10, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.407762837, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.040776283 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "req_open_latency": { 2024-03-31T23:28:30.166 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000161710, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000161710 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "req_readdir_latency": { 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 802, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 2.220613534, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002768844 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rename_latency": { 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.003844550, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001922275 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:30.167 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmdir_latency": { 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 421, 2024-03-31T23:28:30.168 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 12.503384708, 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.029699251 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 4, 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.015992227, 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003998056 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.169 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:30.170 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.170 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.170 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.170 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setattr_latency": { 2024-03-31T23:28:30.170 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 3, 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.086165863, 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.028721954 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.171 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.172 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:30.172 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.172 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.172 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setlayout_latency": { 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setxattr_latency": { 2024-03-31T23:28:30.173 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 8, 2024-03-31T23:28:30.174 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.021105608, 2024-03-31T23:28:30.174 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002638201 2024-03-31T23:28:30.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.174 INFO:teuthology.orchestra.run.smithi094.stdout: "req_symlink_latency": { 2024-03-31T23:28:30.174 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.174 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.175 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.177 INFO:teuthology.orchestra.run.smithi094.stdout: "req_unlink_latency": { 2024-03-31T23:28:30.177 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 6068, 2024-03-31T23:28:30.177 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 13.874203837, 2024-03-31T23:28:30.177 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002286454 2024-03-31T23:28:30.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.178 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:30.178 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:30.178 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:30.178 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.178 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_sessions": { 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "session_count": 2, 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "session_add": 6, 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "session_remove": 4, 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_open": 2, 2024-03-31T23:28:30.179 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_stale": 0, 2024-03-31T23:28:30.180 INFO:teuthology.orchestra.run.smithi094.stdout: "total_load": 112, 2024-03-31T23:28:30.180 INFO:teuthology.orchestra.run.smithi094.stdout: "average_load": 56, 2024-03-31T23:28:30.180 INFO:teuthology.orchestra.run.smithi094.stdout: "avg_session_uptime": 601, 2024-03-31T23:28:30.180 INFO:teuthology.orchestra.run.smithi094.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:30.180 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 120, 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 120, 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:30.181 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:30.182 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:30.182 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:30.182 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:30.182 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:30.182 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:30.182 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:30.183 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:30.183 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:30.183 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:30.183 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:30.184 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:30.185 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:30.185 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:30.185 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:30.185 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:30.185 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:30.185 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:30.186 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:30.186 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:30.186 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-03-31T23:28:30.186 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:30.186 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:30.186 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:30.187 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:30.187 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 1707444, 2024-03-31T23:28:30.187 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 3007, 2024-03-31T23:28:30.187 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 1232, 2024-03-31T23:28:30.187 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 14, 2024-03-31T23:28:30.187 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-03-31T23:28:30.188 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-03-31T23:28:30.188 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:30.188 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:30.188 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:30.188 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:30.188 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:30.189 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 182, 2024-03-31T23:28:30.189 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:30.189 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:30.189 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:30.189 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-03-31T23:28:30.189 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 11096148, 2024-03-31T23:28:30.190 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 178390, 2024-03-31T23:28:30.190 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:30.190 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-03-31T23:28:30.190 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:30.190 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-03-31T23:28:30.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.191 INFO:teuthology.orchestra.run.smithi094.stdout: "objecter": { 2024-03-31T23:28:30.191 INFO:teuthology.orchestra.run.smithi094.stdout: "op_active": 0, 2024-03-31T23:28:30.191 INFO:teuthology.orchestra.run.smithi094.stdout: "op_laggy": 0, 2024-03-31T23:28:30.191 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send": 40533, 2024-03-31T23:28:30.191 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send_bytes": 102644911, 2024-03-31T23:28:30.192 INFO:teuthology.orchestra.run.smithi094.stdout: "op_resend": 32, 2024-03-31T23:28:30.192 INFO:teuthology.orchestra.run.smithi094.stdout: "op_reply": 40533, 2024-03-31T23:28:30.192 INFO:teuthology.orchestra.run.smithi094.stdout: "op_latency": { 2024-03-31T23:28:30.192 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 40533, 2024-03-31T23:28:30.192 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 9200.984331997, 2024-03-31T23:28:30.192 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.226999835 2024-03-31T23:28:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: "op_inflight": 0, 2024-03-31T23:28:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: "oplen_avg": { 2024-03-31T23:28:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 40533, 2024-03-31T23:28:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 72679 2024-03-31T23:28:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.194 INFO:teuthology.orchestra.run.smithi094.stdout: "op": 40533, 2024-03-31T23:28:30.194 INFO:teuthology.orchestra.run.smithi094.stdout: "op_r": 4973, 2024-03-31T23:28:30.194 INFO:teuthology.orchestra.run.smithi094.stdout: "op_w": 35560, 2024-03-31T23:28:30.194 INFO:teuthology.orchestra.run.smithi094.stdout: "op_rmw": 0, 2024-03-31T23:28:30.194 INFO:teuthology.orchestra.run.smithi094.stdout: "op_pg": 0, 2024-03-31T23:28:30.194 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_stat": 684, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_create": 19111, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_read": 164, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_write": 1702, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writefull": 140, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writesame": 0, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_append": 0, 2024-03-31T23:28:30.195 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_zero": 0, 2024-03-31T23:28:30.196 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_truncate": 15, 2024-03-31T23:28:30.196 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_delete": 13035, 2024-03-31T23:28:30.196 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_mapext": 0, 2024-03-31T23:28:30.196 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:30.196 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:30.196 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_getxattr": 4809, 2024-03-31T23:28:30.197 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_setxattr": 29727, 2024-03-31T23:28:30.197 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:30.197 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:30.197 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:30.197 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_call": 0, 2024-03-31T23:28:30.197 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_watch": 0, 2024-03-31T23:28:30.198 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_notify": 0, 2024-03-31T23:28:30.198 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:30.198 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls": 0, 2024-03-31T23:28:30.198 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:30.198 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_other": 0, 2024-03-31T23:28:30.198 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_active": 0, 2024-03-31T23:28:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_send": 0, 2024-03-31T23:28:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_resend": 0, 2024-03-31T23:28:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_ping": 0, 2024-03-31T23:28:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_active": 0, 2024-03-31T23:28:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_send": 0, 2024-03-31T23:28:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_resend": 0, 2024-03-31T23:28:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_active": 0, 2024-03-31T23:28:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_send": 0, 2024-03-31T23:28:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_resend": 0, 2024-03-31T23:28:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_active": 0, 2024-03-31T23:28:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_send": 0, 2024-03-31T23:28:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_resend": 0, 2024-03-31T23:28:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: "command_active": 0, 2024-03-31T23:28:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: "command_send": 0, 2024-03-31T23:28:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: "command_resend": 0, 2024-03-31T23:28:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: "map_epoch": 102, 2024-03-31T23:28:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: "map_full": 0, 2024-03-31T23:28:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: "map_inc": 18, 2024-03-31T23:28:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_sessions": 12, 2024-03-31T23:28:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_open": 12, 2024-03-31T23:28:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_close": 0, 2024-03-31T23:28:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_laggy": 0, 2024-03-31T23:28:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_wr": 2996, 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_rd": 10, 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_del": 286 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: "oft": { 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_objs": 1, 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_updates": 0, 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_removes": 0 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: "osd-slow-ops": { 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_ops_count": 0 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: "purge_queue": { 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops_high_water": 41, 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing": 0, 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_high_water": 9, 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed_ops": 12456, 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed": 6322, 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 103504, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 26957902, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 103504, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 103504, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 26957902, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 40533, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 103341789, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 40533, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 103341789, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 1024, 2024-03-31T23:28:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 40533, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 40533, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 40533, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 40533, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 6322, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 696946, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 6322, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 159, 2024-03-31T23:28:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 696946, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle-0x5633304de500": { 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 35386, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 79839907, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 35386, 2024-03-31T23:28:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 1543, 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 79839907, 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:30.212 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds.exported=65 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds.imported=65 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2801 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=626 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-03-31T23:28:30.906 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-03-31T23:28:30.906 DEBUG:tasks.check_counter:Getting stats from e 2024-03-31T23:28:30.906 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.e perf dump 2024-03-31T23:28:31.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:31 smithi094 ceph-mon[36167]: pgmap v321: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:31.173 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:28:31.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:31 smithi188 ceph-mon[36068]: pgmap v321: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:31.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:31 smithi042 ceph-mon[32380]: pgmap v321: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:32.945 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-31T23:28:32.945 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:32.945 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 1361, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 1322, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 27167888, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 481816, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 6, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 2, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.118747703, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.034768119, 2024-03-31T23:28:32.946 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.061938519, 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.026619819, 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1321, 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.036343619, 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000027512 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:32.948 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.948 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.948 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.948 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 1662352, 2024-03-31T23:28:32.948 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 136464 2024-03-31T23:28:32.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.949 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:32.949 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 996, 2024-03-31T23:28:32.949 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 1157, 2024-03-31T23:28:32.949 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 21379003, 2024-03-31T23:28:32.949 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 759158, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 8, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.064800317, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.016351101, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.025488705, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.018778412, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1155, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.034524377, 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000029891 2024-03-31T23:28:32.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 444272 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 360, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 362, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 33649343, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 114487, 2024-03-31T23:28:32.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 6, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.045680930, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.006397986, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.028534107, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.008545194, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 360, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.011299491, 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000031387 2024-03-31T23:28:32.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-03-31T23:28:32.953 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 1, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-MDSRank": { 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 4020, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.228848406, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000056927 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:32.954 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": { 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "request": 0, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "reply": 0, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "reply_latency": { 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_reply": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "forward": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_commit": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_split": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_merge": 0, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes": 12410, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_top": 7902, 2024-03-31T23:28:32.956 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_bottom": 4508, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pin_tail": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pinned": 1122, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_expired": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_with_caps": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "subtrees": 2, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_hit": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_forward": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_discover": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_lock": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "load_cent": 0, 2024-03-31T23:28:32.957 INFO:teuthology.orchestra.run.smithi094.stdout: "q": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "exported": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "exported_inodes": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "imported": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "imported_inodes": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_backtrace_fetch": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rfiles": 4, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rbytes": 234, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rsnaps": 6, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_fetch": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:32.958 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_inodes": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dirfrag_rstats": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_file_inodes": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_revoke": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_grant": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:32.959 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps_dirty": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_cap_release": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "process_request_cap_release": 0 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_cache": { 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update_receipt": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_try_discover": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_send_discover": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_handle_discover": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_created": 0, 2024-03-31T23:28:32.960 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_enqueued": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_migrated": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_started": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_completed": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:32.961 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:32.962 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_exportdir": 0, 2024-03-31T23:28:32.962 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_flush": 0, 2024-03-31T23:28:32.962 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:32.962 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:32.962 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_inodestats": 0 2024-03-31T23:28:32.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.963 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_log": { 2024-03-31T23:28:32.963 INFO:teuthology.orchestra.run.smithi094.stdout: "evlrg": 0, 2024-03-31T23:28:32.963 INFO:teuthology.orchestra.run.smithi094.stdout: "evadd": 0, 2024-03-31T23:28:32.963 INFO:teuthology.orchestra.run.smithi094.stdout: "evex": 0, 2024-03-31T23:28:32.963 INFO:teuthology.orchestra.run.smithi094.stdout: "evtrm": 0, 2024-03-31T23:28:32.964 INFO:teuthology.orchestra.run.smithi094.stdout: "ev": 35386, 2024-03-31T23:28:32.964 INFO:teuthology.orchestra.run.smithi094.stdout: "evexg": 0, 2024-03-31T23:28:32.964 INFO:teuthology.orchestra.run.smithi094.stdout: "evexd": 0, 2024-03-31T23:28:32.964 INFO:teuthology.orchestra.run.smithi094.stdout: "segadd": 0, 2024-03-31T23:28:32.964 INFO:teuthology.orchestra.run.smithi094.stdout: "segex": 0, 2024-03-31T23:28:32.964 INFO:teuthology.orchestra.run.smithi094.stdout: "segtrm": 0, 2024-03-31T23:28:32.965 INFO:teuthology.orchestra.run.smithi094.stdout: "seg": 2, 2024-03-31T23:28:32.965 INFO:teuthology.orchestra.run.smithi094.stdout: "segmjr": 14, 2024-03-31T23:28:32.965 INFO:teuthology.orchestra.run.smithi094.stdout: "segexg": 0, 2024-03-31T23:28:32.965 INFO:teuthology.orchestra.run.smithi094.stdout: "segexd": 0, 2024-03-31T23:28:32.965 INFO:teuthology.orchestra.run.smithi094.stdout: "expos": 82729609, 2024-03-31T23:28:32.965 INFO:teuthology.orchestra.run.smithi094.stdout: "wrpos": 84034211, 2024-03-31T23:28:32.966 INFO:teuthology.orchestra.run.smithi094.stdout: "rdpos": 84034075, 2024-03-31T23:28:32.966 INFO:teuthology.orchestra.run.smithi094.stdout: "jlat": { 2024-03-31T23:28:32.966 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.966 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.966 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.967 INFO:teuthology.orchestra.run.smithi094.stdout: "replayed": 35386 2024-03-31T23:28:32.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.967 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_mem": { 2024-03-31T23:28:32.968 INFO:teuthology.orchestra.run.smithi094.stdout: "ino": 2697, 2024-03-31T23:28:32.968 INFO:teuthology.orchestra.run.smithi094.stdout: "ino+": 12725, 2024-03-31T23:28:32.968 INFO:teuthology.orchestra.run.smithi094.stdout: "ino-": 10028, 2024-03-31T23:28:32.968 INFO:teuthology.orchestra.run.smithi094.stdout: "dir": 223, 2024-03-31T23:28:32.968 INFO:teuthology.orchestra.run.smithi094.stdout: "dir+": 774, 2024-03-31T23:28:32.968 INFO:teuthology.orchestra.run.smithi094.stdout: "dir-": 551, 2024-03-31T23:28:32.969 INFO:teuthology.orchestra.run.smithi094.stdout: "dn": 12410, 2024-03-31T23:28:32.969 INFO:teuthology.orchestra.run.smithi094.stdout: "dn+": 19064, 2024-03-31T23:28:32.969 INFO:teuthology.orchestra.run.smithi094.stdout: "dn-": 6654, 2024-03-31T23:28:32.969 INFO:teuthology.orchestra.run.smithi094.stdout: "cap": 0, 2024-03-31T23:28:32.969 INFO:teuthology.orchestra.run.smithi094.stdout: "cap+": 0, 2024-03-31T23:28:32.970 INFO:teuthology.orchestra.run.smithi094.stdout: "cap-": 0, 2024-03-31T23:28:32.970 INFO:teuthology.orchestra.run.smithi094.stdout: "rss": 75816, 2024-03-31T23:28:32.970 INFO:teuthology.orchestra.run.smithi094.stdout: "heap": 215420 2024-03-31T23:28:32.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.970 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_server": { 2024-03-31T23:28:32.970 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_client_request": 0, 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_server_request": 0, 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_request": 0, 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_session": 0, 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_peer_request": 0, 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "req_create_latency": { 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.971 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getattr_latency": { 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: "req_link_latency": { 2024-03-31T23:28:32.973 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookup_latency": { 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.974 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupino_latency": { 2024-03-31T23:28:32.975 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupname_latency": { 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.977 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:32.977 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.977 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.977 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.977 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lssnap_latency": { 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.978 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.979 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.980 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mkdir_latency": { 2024-03-31T23:28:32.980 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.980 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mknod_latency": { 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.981 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mksnap_latency": { 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "req_open_latency": { 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "req_readdir_latency": { 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rename_latency": { 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.984 INFO:teuthology.orchestra.run.smithi094.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmdir_latency": { 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.985 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.987 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setattr_latency": { 2024-03-31T23:28:32.987 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.987 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.987 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.987 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.988 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setlayout_latency": { 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setxattr_latency": { 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "req_symlink_latency": { 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.989 INFO:teuthology.orchestra.run.smithi094.stdout: "req_unlink_latency": { 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.990 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_sessions": { 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "session_count": 2, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "session_add": 6, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "session_remove": 4, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_open": 4, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_stale": 0, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "total_load": 0, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "average_load": 0, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "avg_session_uptime": 3323, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:32.991 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:32.992 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 327742, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 2914, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:32.994 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 182, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 15523980, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 189064, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:32.995 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "objecter": { 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_active": 0, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_laggy": 0, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send": 2436, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send_bytes": 26, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_resend": 4, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_reply": 2436, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "op_latency": { 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2436, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 2.848952327, 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001169520 2024-03-31T23:28:32.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "op_inflight": 0, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "oplen_avg": { 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2436, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 2437 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "op": 2436, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "op_r": 2436, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "op_w": 0, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "op_rmw": 0, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "op_pg": 0, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_stat": 1527, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_create": 0, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_read": 906, 2024-03-31T23:28:32.997 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_write": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writefull": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writesame": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_append": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_zero": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_truncate": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_delete": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_mapext": 0, 2024-03-31T23:28:32.998 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:32.999 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:32.999 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_getxattr": 2, 2024-03-31T23:28:32.999 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_setxattr": 0, 2024-03-31T23:28:32.999 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:32.999 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:32.999 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_call": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_watch": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_notify": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:33.000 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_other": 0, 2024-03-31T23:28:33.001 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_active": 0, 2024-03-31T23:28:33.001 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_send": 0, 2024-03-31T23:28:33.001 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_resend": 0, 2024-03-31T23:28:33.001 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_ping": 0, 2024-03-31T23:28:33.001 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_active": 0, 2024-03-31T23:28:33.001 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_send": 0, 2024-03-31T23:28:33.002 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_resend": 0, 2024-03-31T23:28:33.002 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_active": 0, 2024-03-31T23:28:33.002 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_send": 0, 2024-03-31T23:28:33.002 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_resend": 0, 2024-03-31T23:28:33.002 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_active": 0, 2024-03-31T23:28:33.002 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_send": 0, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_resend": 0, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "command_active": 0, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "command_send": 0, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "command_resend": 0, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "map_epoch": 102, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "map_full": 0, 2024-03-31T23:28:33.003 INFO:teuthology.orchestra.run.smithi094.stdout: "map_inc": 13, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_sessions": 9, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_open": 9, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_close": 0, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_laggy": 0, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_wr": 0, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_rd": 2, 2024-03-31T23:28:33.004 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_del": 0 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: "oft": { 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_objs": 0, 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_updates": 0, 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_removes": 0 2024-03-31T23:28:33.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.006 INFO:teuthology.orchestra.run.smithi094.stdout: "osd-slow-ops": { 2024-03-31T23:28:33.006 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_ops_count": 0 2024-03-31T23:28:33.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.006 INFO:teuthology.orchestra.run.smithi094.stdout: "purge_queue": { 2024-03-31T23:28:33.006 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:33.006 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops_high_water": 0, 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing": 0, 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_high_water": 0, 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed_ops": 0, 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed": 0, 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.007 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:33.008 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:33.008 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:33.008 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:33.008 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 2713, 2024-03-31T23:28:33.008 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 81935095, 2024-03-31T23:28:33.008 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 2713, 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2713, 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 81935095, 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:33.009 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:33.010 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:33.010 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:33.010 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:33.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.010 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:33.010 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:33.011 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 2436, 2024-03-31T23:28:33.012 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 79849410, 2024-03-31T23:28:33.012 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2436, 2024-03-31T23:28:33.012 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 79849410, 2024-03-31T23:28:33.012 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:33.012 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:33.012 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:33.013 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:33.013 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:33.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.013 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:33.013 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:33.013 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 1024, 2024-03-31T23:28:33.014 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:33.014 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:33.014 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:33.014 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:33.014 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:33.014 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 2436, 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 2436, 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2436, 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 2436, 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:33.015 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:33.016 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:33.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.016 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:33.017 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 0, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 0, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle-0x557662fcc6e0": { 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:33.018 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:33.019 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-31T23:28:33.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:33 smithi094 ceph-mon[36167]: pgmap v322: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:33.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:33 smithi188 ceph-mon[36068]: pgmap v322: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:33.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:33 smithi042 ceph-mon[32380]: pgmap v322: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:33.904 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-03-31T23:28:33.904 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-03-31T23:28:33.904 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-03-31T23:28:33.904 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-03-31T23:28:33.904 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-03-31T23:28:33.905 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:33.905 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:33.905 DEBUG:tasks.check_counter:Getting stats from h 2024-03-31T23:28:33.905 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.h perf dump 2024-03-31T23:28:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:28:35.377 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:35 smithi042 ceph-mon[32380]: pgmap v323: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:35.387 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:35 smithi094 ceph-mon[36167]: pgmap v323: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:35.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:35 smithi188 ceph-mon[36068]: pgmap v323: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:35.980 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-31T23:28:35.980 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:35.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 2576, 2024-03-31T23:28:35.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 2177, 2024-03-31T23:28:35.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 985808, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 5332690, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 21, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.183454743, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.070142584, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.071016220, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.038489253, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2175, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.173565833, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000079800 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1994, 2024-03-31T23:28:35.981 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000265761, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000133 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 314000 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 2557, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 2084, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 2575537, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 5723011, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 11, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.179210581, 2024-03-31T23:28:35.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.058220527, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.096106462, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.035864873, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2084, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.162440160, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000077946 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1817, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000259527, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000142 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 1690944, 2024-03-31T23:28:35.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 169888 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 17325, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 17615, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 7512579, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 11147497, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 17, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 1.018871613, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.468628262, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.708182297, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.037115875, 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:35.984 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 17612, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.880402425, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000049988 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 26711, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.004606292, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000172 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 928, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 134640 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 1, 2024-03-31T23:28:35.985 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-MDSRank": { 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 713, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 3.507620534, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.004919523 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2177, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.445573907, 2024-03-31T23:28:35.986 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000204673 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": { 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "request": 1976, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "reply": 1974, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "reply_latency": { 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1974, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 6.362734966, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003223269 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_reply": 0, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "forward": 1, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:35.987 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_commit": 19, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_split": 1, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_merge": 0, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes": 1205, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_top": 1, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_bottom": 6, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pin_tail": 1198, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pinned": 1201, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_expired": 1476, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_with_caps": 0, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": 0, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "subtrees": 3, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse": 4095, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_hit": 2848, 2024-03-31T23:28:35.988 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_forward": 1, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_discover": 952, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_lock": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "load_cent": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "q": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "exported": 5, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "exported_inodes": 266, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "imported": 5, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "imported_inodes": 774, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_backtrace_fetch": 708, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:35.989 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rfiles": 4, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rbytes": 234, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rsnaps": 3, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_fetch": 708, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_inodes": 49, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dirfrag_rstats": 49, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_file_inodes": 659, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_revoke": 442, 2024-03-31T23:28:35.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_grant": 1933, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps": 2100, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps_dirty": 1660, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_cap_release": 10, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "process_request_cap_release": 1466 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_cache": { 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update": 50, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update_receipt": 2439, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_try_discover": 1687, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_send_discover": 1415, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_handle_discover": 93, 2024-03-31T23:28:35.991 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays": 49, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_created": 1269, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_enqueued": 1220, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_migrated": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_started": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_completed": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:35.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_exportdir": 8, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_flush": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragmentdir": 1, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_inodestats": 0 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_log": { 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "evlrg": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "evadd": 6346, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "evex": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "evtrm": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "ev": 6346, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "evexg": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "evexd": 0, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "segadd": 9, 2024-03-31T23:28:35.993 INFO:teuthology.orchestra.run.smithi094.stdout: "segex": 0, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "segtrm": 0, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "seg": 9, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "segmjr": 2, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "segexg": 0, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "segexd": 0, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "expos": 4194304, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "wrpos": 18118172, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "rdpos": 0, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "jlat": { 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 101, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.698699686, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.016818808 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.994 INFO:teuthology.orchestra.run.smithi094.stdout: "replayed": 0 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_mem": { 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "ino": 593, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "ino+": 2562, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "ino-": 1969, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "dir": 83, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "dir+": 811, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "dir-": 728, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "dn": 1205, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "dn+": 3901, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "dn-": 2696, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "cap": 0, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "cap+": 1270, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "cap-": 1270, 2024-03-31T23:28:35.995 INFO:teuthology.orchestra.run.smithi094.stdout: "rss": 72068, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "heap": 223612 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_server": { 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_client_request": 2612, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_server_request": 57, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_request": 1976, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_session": 23, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_peer_request": 328, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "req_create_latency": { 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 561, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.106310260, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001972032 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getattr_latency": { 2024-03-31T23:28:35.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "req_link_latency": { 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookup_latency": { 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 86, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.055312730, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000643171 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.998 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupino_latency": { 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupname_latency": { 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:35.999 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:36.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.000 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.000 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lssnap_latency": { 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mkdir_latency": { 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mknod_latency": { 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mksnap_latency": { 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "req_open_latency": { 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "req_readdir_latency": { 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 58, 2024-03-31T23:28:36.002 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.061347082, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001057708 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rename_latency": { 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.003 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmdir_latency": { 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 49, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.261465804, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.025744200 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:36.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setattr_latency": { 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:36.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setlayout_latency": { 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setxattr_latency": { 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.006 INFO:teuthology.orchestra.run.smithi094.stdout: "req_symlink_latency": { 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "req_unlink_latency": { 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1220, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 3.878299090, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003178933 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.007 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_sessions": { 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "session_count": 2, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "session_add": 4, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "session_remove": 2, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_open": 2, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_stale": 0, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "total_load": 1642, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "average_load": 821, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "avg_session_uptime": 571, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-03-31T23:28:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:36.009 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:36.010 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 721938, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 804, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 616, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 7, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:36.011 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 182, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 2437448, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 34984, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "objecter": { 2024-03-31T23:28:36.012 INFO:teuthology.orchestra.run.smithi094.stdout: "op_active": 0, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_laggy": 0, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send": 3379, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send_bytes": 14283953, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_resend": 33, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_reply": 3379, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_latency": { 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 3379, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 14.181762113, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.004197029 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_inflight": 0, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "oplen_avg": { 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 3379, 2024-03-31T23:28:36.013 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 3435 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "op": 3379, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "op_r": 730, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "op_w": 2649, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "op_rmw": 0, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "op_pg": 0, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_stat": 0, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_create": 10, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_read": 22, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_write": 123, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writefull": 22, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writesame": 0, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_append": 0, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_zero": 0, 2024-03-31T23:28:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_truncate": 1, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_delete": 2455, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_mapext": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_getxattr": 708, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_setxattr": 20, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_call": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_watch": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_notify": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls": 0, 2024-03-31T23:28:36.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_other": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_active": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_send": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_resend": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_ping": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_active": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_send": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_resend": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_active": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_send": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_resend": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_active": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_send": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_resend": 0, 2024-03-31T23:28:36.016 INFO:teuthology.orchestra.run.smithi094.stdout: "command_active": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "command_send": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "command_resend": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "map_epoch": 102, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "map_full": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "map_inc": 13, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_sessions": 12, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_open": 12, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_close": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_laggy": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_wr": 59, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_rd": 0, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_del": 15 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "oft": { 2024-03-31T23:28:36.017 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_objs": 1, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_updates": 0, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_removes": 0 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "osd-slow-ops": { 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_ops_count": 0 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "purge_queue": { 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops_high_water": 10, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing": 0, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_high_water": 5, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed_ops": 2440, 2024-03-31T23:28:36.018 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed": 1220, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 22454, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 9100677, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 22454, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 22454, 2024-03-31T23:28:36.019 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 9100677, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:36.020 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 3379, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 14422205, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 3379, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 14422205, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 1024, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:36.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 3379, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 3379, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 3379, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 3379, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:36.022 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 1220, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 138252, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 1220, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 22, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 138252, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle-0x55bf300b2500": { 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 6346, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 13923868, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 6346, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 101, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 13923868, 2024-03-31T23:28:36.024 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:36.025 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:36.025 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:36.025 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:36.025 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.025 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:36.025 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-31T23:28:36.813 INFO:tasks.check_counter:Daemon mds.h mds.exported=5 2024-03-31T23:28:36.813 INFO:tasks.check_counter:Daemon mds.h mds.imported=5 2024-03-31T23:28:36.813 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=50 2024-03-31T23:28:36.813 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2439 2024-03-31T23:28:36.814 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=3 2024-03-31T23:28:36.814 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:36.814 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:36.814 DEBUG:tasks.check_counter:Getting stats from k 2024-03-31T23:28:36.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.k perf dump 2024-03-31T23:28:37.070 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-31T23:28:37.346 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:37 smithi094 ceph-mon[36167]: pgmap v324: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:28:37.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:37 smithi188 ceph-mon[36068]: pgmap v324: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:28:37.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:37 smithi042 ceph-mon[32380]: pgmap v324: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 1725, 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 1727, 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 16815535, 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 548557, 2024-03-31T23:28:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 6, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 2, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.112714691, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.033018347, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.035509658, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.035367801, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1725, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.035851958, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000020783 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.978 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 39, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 203, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 4206198, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 456972, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 7, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.013410135, 2024-03-31T23:28:38.979 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.005460074, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.005596868, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000696907, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 201, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.017424135, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000086687 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-03-31T23:28:38.980 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 446416 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 765, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 726, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 1783078, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 293408, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 4, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.069022371, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.019255844, 2024-03-31T23:28:38.981 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.041394239, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.016651299, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 725, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.017499757, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000024137 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.982 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 1663008, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 138224 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 1, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-MDSRank": { 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 3767, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.073294858, 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000019457 2024-03-31T23:28:38.983 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": { 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "request": 0, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "reply": 0, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "reply_latency": { 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.984 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_reply": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "forward": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_commit": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_split": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_merge": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes": 3364, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_top": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_bottom": 3364, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pin_tail": 0, 2024-03-31T23:28:38.985 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pinned": 3364, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_expired": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_with_caps": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "subtrees": 1, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_hit": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_forward": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_discover": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_lock": 0, 2024-03-31T23:28:38.986 INFO:teuthology.orchestra.run.smithi094.stdout: "load_cent": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "q": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "exported": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "exported_inodes": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "imported": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "imported_inodes": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_backtrace_fetch": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rfiles": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rbytes": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rsnaps": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_fetch": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:38.987 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_inodes": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dirfrag_rstats": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_file_inodes": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_revoke": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_grant": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps_dirty": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_cap_release": 0, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "process_request_cap_release": 0 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.988 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_cache": { 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update_receipt": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_try_discover": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_send_discover": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_handle_discover": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_created": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_enqueued": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_migrated": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:38.989 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_started": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_completed": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_exportdir": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_flush": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_inodestats": 0 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_log": { 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "evlrg": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "evadd": 0, 2024-03-31T23:28:38.990 INFO:teuthology.orchestra.run.smithi094.stdout: "evex": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "evtrm": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "ev": 8399, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "evexg": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "evexd": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "segadd": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "segex": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "segtrm": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "seg": 11, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "segmjr": 2, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "segexg": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "segexd": 0, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "expos": 4194304, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "wrpos": 24696991, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "rdpos": 24682452, 2024-03-31T23:28:38.991 INFO:teuthology.orchestra.run.smithi094.stdout: "jlat": { 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "replayed": 8399 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_mem": { 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ino": 797, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ino+": 3637, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "ino-": 2840, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "dir": 79, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "dir+": 128, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "dir-": 49, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "dn": 3364, 2024-03-31T23:28:38.992 INFO:teuthology.orchestra.run.smithi094.stdout: "dn+": 4666, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "dn-": 1302, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "cap": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "cap+": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "cap-": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "rss": 58404, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "heap": 215420 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_server": { 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_client_request": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_server_request": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_request": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_session": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_peer_request": 0, 2024-03-31T23:28:38.993 INFO:teuthology.orchestra.run.smithi094.stdout: "req_create_latency": { 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getattr_latency": { 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.994 INFO:teuthology.orchestra.run.smithi094.stdout: "req_link_latency": { 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookup_latency": { 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupino_latency": { 2024-03-31T23:28:38.995 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupname_latency": { 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:38.996 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lssnap_latency": { 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.997 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mkdir_latency": { 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mknod_latency": { 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mksnap_latency": { 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "req_open_latency": { 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "req_readdir_latency": { 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:38.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rename_latency": { 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmdir_latency": { 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.001 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setattr_latency": { 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:39.002 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setlayout_latency": { 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setxattr_latency": { 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.003 INFO:teuthology.orchestra.run.smithi094.stdout: "req_symlink_latency": { 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "req_unlink_latency": { 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.004 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_sessions": { 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "session_count": 2, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "session_add": 4, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "session_remove": 2, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_open": 2, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_stale": 0, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "total_load": 0, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "average_load": 0, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "avg_session_uptime": 3330, 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:39.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:39.006 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:39.007 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:39.008 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 229078, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 890, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:39.009 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 182, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 4375258, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 47512, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "objecter": { 2024-03-31T23:28:39.010 INFO:teuthology.orchestra.run.smithi094.stdout: "op_active": 0, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_laggy": 0, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send": 2246, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send_bytes": 21, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_resend": 3, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_reply": 2246, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_latency": { 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2246, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 7.599872318, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003383736 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "op_inflight": 0, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "oplen_avg": { 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2246, 2024-03-31T23:28:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 2247 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "op": 2246, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "op_r": 2246, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "op_w": 0, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "op_rmw": 0, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "op_pg": 0, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_stat": 1454, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_create": 0, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_read": 790, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_write": 0, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writefull": 0, 2024-03-31T23:28:39.012 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writesame": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_append": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_zero": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_truncate": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_delete": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_mapext": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_getxattr": 1, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_setxattr": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_call": 0, 2024-03-31T23:28:39.013 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_watch": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_notify": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_other": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_active": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_send": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_resend": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_ping": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_active": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_send": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_resend": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_active": 0, 2024-03-31T23:28:39.014 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_send": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_resend": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_active": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_send": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_resend": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "command_active": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "command_send": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "command_resend": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "map_epoch": 102, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "map_full": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "map_inc": 13, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_sessions": 6, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_open": 6, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_close": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_laggy": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_wr": 0, 2024-03-31T23:28:39.015 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_rd": 2, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_del": 0 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "oft": { 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_objs": 0, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_updates": 0, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_removes": 0 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "osd-slow-ops": { 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_ops_count": 0 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "purge_queue": { 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops_high_water": 0, 2024-03-31T23:28:39.016 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_high_water": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed_ops": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 2525, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 22560482, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 2525, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:39.017 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2525, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 22560482, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:39.018 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 2246, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 20504967, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2246, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 20504967, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 1024, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:39.019 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 2246, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 2246, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2246, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 2246, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle-0x5596c1e5e6e0": { 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-31T23:28:39.022 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-31T23:28:39.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-31T23:28:39.023 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-31T23:28:39.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:39 smithi094 ceph-mon[36167]: pgmap v325: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:39.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:39 smithi188 ceph-mon[36068]: pgmap v325: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:39.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:39 smithi042 ceph-mon[32380]: pgmap v325: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:39.675 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-03-31T23:28:39.675 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-03-31T23:28:39.675 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-03-31T23:28:39.675 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-03-31T23:28:39.675 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-03-31T23:28:39.676 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:39.676 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:39.676 DEBUG:tasks.check_counter:Getting stats from c 2024-03-31T23:28:39.676 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.c perf dump 2024-03-31T23:28:39.925 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:28:41.383 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:41 smithi188 ceph-mon[36068]: pgmap v326: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:41.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:41 smithi094 ceph-mon[36167]: pgmap v326: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:41.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:41 smithi042 ceph-mon[32380]: pgmap v326: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:41.914 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-03-31T23:28:41.914 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:41.914 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 14202, 2024-03-31T23:28:41.915 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 14549, 2024-03-31T23:28:41.915 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 6341915, 2024-03-31T23:28:41.915 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 10022665, 2024-03-31T23:28:41.915 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 19, 2024-03-31T23:28:41.915 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:41.916 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.772546088, 2024-03-31T23:28:41.916 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.321169078, 2024-03-31T23:28:41.916 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.520886158, 2024-03-31T23:28:41.916 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.033811439, 2024-03-31T23:28:41.916 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 14551, 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.486098606, 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000033406 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 23187, 2024-03-31T23:28:41.917 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.003648284, 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000157 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 2023, 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 2632, 2024-03-31T23:28:41.918 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 639688, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 5736219, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 12, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 7, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.195648554, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.082361455, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.065285445, 2024-03-31T23:28:41.919 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.041243007, 2024-03-31T23:28:41.920 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:41.920 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2629, 2024-03-31T23:28:41.920 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.237607457, 2024-03-31T23:28:41.920 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000090379 2024-03-31T23:28:41.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.920 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1792, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000313686, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000175 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 447264 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 2525, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 2302, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 2629576, 2024-03-31T23:28:41.921 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 1076947, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 17, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 7, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.209599817, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.086347236, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.123665232, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.022469663, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2298, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.134998293, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000058745 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2959, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000752309, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000254 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 1687200, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 172928 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 1, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-MDSRank": { 2024-03-31T23:28:41.923 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 592, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2.030668042, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.003430182 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1828, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.274396747, 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000150107 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "mds": { 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "request": 1667, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "reply": 1665, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "reply_latency": { 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1665, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 4.543436987, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002728790 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_reply": 0, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "forward": 0, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_commit": 11, 2024-03-31T23:28:41.925 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_split": 0, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_merge": 0, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes": 710, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_top": 1, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_bottom": 6, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pin_tail": 703, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pinned": 706, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_expired": 1648, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_with_caps": 1, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "caps": 1, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "subtrees": 3, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse": 4227, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_hit": 2787, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_forward": 0, 2024-03-31T23:28:41.926 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_discover": 966, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_lock": 0, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "load_cent": 0, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "q": 0, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "exported": 11, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "exported_inodes": 668, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "imported": 11, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "imported_inodes": 918, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_backtrace_fetch": 534, 2024-03-31T23:28:41.927 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rfiles": 4, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rbytes": 234, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rsnaps": 3, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_fetch": 534, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_inodes": 50, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dirfrag_rstats": 50, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_file_inodes": 484, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_revoke": 154, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_grant": 1390, 2024-03-31T23:28:41.928 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps": 623, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps_dirty": 474, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_cap_release": 12, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "process_request_cap_release": 1487 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_cache": { 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update": 68, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update_receipt": 2461, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_try_discover": 1705, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_send_discover": 1437, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_handle_discover": 120, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays": 52, 2024-03-31T23:28:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_created": 1063, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_enqueued": 1011, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_migrated": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_started": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_completed": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:41.930 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_exportdir": 11, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_flush": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_inodestats": 0 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_log": { 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "evlrg": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "evadd": 3827, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "evex": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "evtrm": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "ev": 3827, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "evexg": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "evexd": 0, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "segadd": 6, 2024-03-31T23:28:41.931 INFO:teuthology.orchestra.run.smithi188.stdout: "segex": 0, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "segtrm": 0, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "seg": 6, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "segmjr": 2, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "segexg": 0, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "segexd": 0, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "expos": 4194304, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "wrpos": 12672241, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "rdpos": 0, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "jlat": { 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 136, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.882894198, 2024-03-31T23:28:41.932 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.006491869 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "replayed": 0 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_mem": { 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "ino": 387, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "ino+": 2260, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "ino-": 1873, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "dir": 72, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "dir+": 808, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "dir-": 736, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "dn": 710, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "dn+": 3601, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "dn-": 2891, 2024-03-31T23:28:41.933 INFO:teuthology.orchestra.run.smithi188.stdout: "cap": 1, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "cap+": 1072, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "cap-": 1071, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "rss": 68912, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "heap": 223612 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_server": { 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_client_request": 2449, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_server_request": 77, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_request": 1667, 2024-03-31T23:28:41.934 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_session": 21, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_peer_request": 565, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "req_create_latency": { 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 207, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.609101020, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002942517 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getattr_latency": { 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "req_link_latency": { 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.936 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookup_latency": { 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 333, 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.179882074, 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000540186 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupino_latency": { 2024-03-31T23:28:41.937 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000131674, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000131674 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupname_latency": { 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.938 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lssnap_latency": { 2024-03-31T23:28:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.940 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mkdir_latency": { 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.941 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mknod_latency": { 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mksnap_latency": { 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "req_open_latency": { 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.942 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "req_readdir_latency": { 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 61, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.066354038, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001087771 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rename_latency": { 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:41.943 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmdir_latency": { 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 55, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.479335266, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.026897004 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.944 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:41.945 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setattr_latency": { 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.946 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setlayout_latency": { 2024-03-31T23:28:41.947 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setxattr_latency": { 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "req_symlink_latency": { 2024-03-31T23:28:41.948 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "req_unlink_latency": { 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1008, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2.208632915, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002191104 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.949 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_sessions": { 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "session_count": 2, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "session_add": 3, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "session_remove": 1, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_open": 2, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_stale": 0, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "total_load": 1073, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "average_load": 536, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "avg_session_uptime": 603, 2024-03-31T23:28:41.950 INFO:teuthology.orchestra.run.smithi188.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:41.951 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:41.952 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:41.953 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 738578, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 604, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 704, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 8, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 182, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 1580390, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 25347, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "objecter": { 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_active": 0, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_laggy": 0, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send": 2852, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send_bytes": 8658634, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_resend": 33, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_reply": 2852, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_latency": { 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2852, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 12.071776550, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.004232740 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "op_inflight": 0, 2024-03-31T23:28:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "oplen_avg": { 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2852, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2911 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "op": 2852, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "op_r": 565, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "op_w": 2287, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "op_rmw": 0, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "op_pg": 0, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_stat": 0, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_create": 10, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_read": 31, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_write": 167, 2024-03-31T23:28:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writefull": 25, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writesame": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_append": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_zero": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_truncate": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_delete": 2041, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_mapext": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_getxattr": 534, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_setxattr": 20, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_call": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_watch": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_notify": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_other": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_active": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_send": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_resend": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_ping": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_active": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_send": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_resend": 0, 2024-03-31T23:28:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_active": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_send": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_resend": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_active": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_send": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_resend": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "command_active": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "command_send": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "command_resend": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "map_epoch": 102, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "map_full": 0, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "map_inc": 13, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_sessions": 12, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_open": 12, 2024-03-31T23:28:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_close": 0, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_laggy": 0, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_wr": 65, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_rd": 0, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_del": 18 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "oft": { 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_objs": 1, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_updates": 0, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_removes": 0 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "osd-slow-ops": { 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_ops_count": 0 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "purge_queue": { 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops_high_water": 17, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing": 0, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_high_water": 5, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed_ops": 2027, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed": 1011, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 18746, 2024-03-31T23:28:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 7942654, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 18746, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 18746, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 7942654, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 2852, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 8773385, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 2852, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 8773385, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 1024, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 2852, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 2852, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 2852, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 2852, 2024-03-31T23:28:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 1011, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 114751, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 1011, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 31, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 114751, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle-0x55c7feb1c500": { 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 3827, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 8477937, 2024-03-31T23:28:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 3827, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 136, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 8477937, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:41.968 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-03-31T23:28:42.766 INFO:tasks.check_counter:Daemon mds.c mds.exported=11 2024-03-31T23:28:42.766 INFO:tasks.check_counter:Daemon mds.c mds.imported=11 2024-03-31T23:28:42.766 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=68 2024-03-31T23:28:42.766 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2461 2024-03-31T23:28:42.767 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=3 2024-03-31T23:28:42.767 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:42.767 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:42.767 DEBUG:tasks.check_counter:Getting stats from f 2024-03-31T23:28:42.767 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.f perf dump 2024-03-31T23:28:43.038 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:28:43.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:43 smithi188 ceph-mon[36068]: pgmap v327: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:43.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:43 smithi094 ceph-mon[36167]: pgmap v327: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:43.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:43 smithi042 ceph-mon[32380]: pgmap v327: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:44.983 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 12188, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 9710, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 5751059, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 7781209, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 11, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 4, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.679472900, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.262128020, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.473784608, 2024-03-31T23:28:44.984 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.025218685, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 9710, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.445801555, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000045911 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 19781, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.003371065, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000170 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 315056 2024-03-31T23:28:44.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 3907, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 7399, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 1183108, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 3904004, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 28, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 9, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.346447866, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.155392143, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.131150646, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.043854973, 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:44.986 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 7393, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.473377432, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000064030 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 4532, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.001373686, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000303 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 4880, 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 136240 2024-03-31T23:28:44.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 3099, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 3725, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 3054472, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 5653678, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 9, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 7, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.351807676, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.184780147, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.149802710, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.035593647, 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:44.988 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3726, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.299172204, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000080293 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 4272, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000832232, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000194 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 1675520, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 220256 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 1, 2024-03-31T23:28:44.989 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-MDSRank": { 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 870, 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.896545456, 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002179937 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:44.990 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1929, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.402243310, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000208524 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "mds": { 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "request": 1998, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "reply": 1997, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "reply_latency": { 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1997, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 4.205028287, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002105672 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_reply": 0, 2024-03-31T23:28:44.991 INFO:teuthology.orchestra.run.smithi188.stdout: "forward": 1, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_commit": 11, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_split": 0, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_merge": 0, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes": 455, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_top": 1, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_bottom": 1, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pin_tail": 453, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pinned": 453, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_expired": 2511, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_with_caps": 1, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "caps": 1, 2024-03-31T23:28:44.992 INFO:teuthology.orchestra.run.smithi188.stdout: "subtrees": 3, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse": 5512, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_hit": 3565, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_forward": 1, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_discover": 955, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_lock": 0, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "load_cent": 0, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "q": 0, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "exported": 49, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "exported_inodes": 1563, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "imported": 49, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "imported_inodes": 1329, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:44.993 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_backtrace_fetch": 423, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rfiles": 4, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rbytes": 234, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rsnaps": 3, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_fetch": 423, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_inodes": 5, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dirfrag_rstats": 5, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_file_inodes": 418, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:44.994 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_revoke": 179, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_grant": 1218, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps": 416, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps_dirty": 260, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_cap_release": 26, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "process_request_cap_release": 1996 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_cache": { 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update": 170, 2024-03-31T23:28:44.995 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update_receipt": 2346, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_try_discover": 1638, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_send_discover": 1333, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_handle_discover": 210, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays": 39, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:44.996 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_created": 1103, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_enqueued": 1064, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_migrated": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_started": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_completed": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_exportdir": 49, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_flush": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:44.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:44.998 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_inodestats": 0 2024-03-31T23:28:44.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:44.998 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_log": { 2024-03-31T23:28:44.998 INFO:teuthology.orchestra.run.smithi188.stdout: "evlrg": 0, 2024-03-31T23:28:44.998 INFO:teuthology.orchestra.run.smithi188.stdout: "evadd": 3452, 2024-03-31T23:28:44.999 INFO:teuthology.orchestra.run.smithi188.stdout: "evex": 0, 2024-03-31T23:28:44.999 INFO:teuthology.orchestra.run.smithi188.stdout: "evtrm": 0, 2024-03-31T23:28:44.999 INFO:teuthology.orchestra.run.smithi188.stdout: "ev": 3452, 2024-03-31T23:28:44.999 INFO:teuthology.orchestra.run.smithi188.stdout: "evexg": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "evexd": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "segadd": 5, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "segex": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "segtrm": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "seg": 5, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "segmjr": 2, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "segexg": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "segexd": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "expos": 4194304, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "wrpos": 12068311, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "rdpos": 0, 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "jlat": { 2024-03-31T23:28:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 301, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.078498379, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.003583051 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "replayed": 0 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_mem": { 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "ino": 258, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "ino+": 2656, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "ino-": 2398, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "dir": 54, 2024-03-31T23:28:45.001 INFO:teuthology.orchestra.run.smithi188.stdout: "dir+": 779, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "dir-": 725, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "dn": 455, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "dn+": 4150, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "dn-": 3695, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "cap": 1, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "cap+": 1146, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "cap-": 1145, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "rss": 62808, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "heap": 223612 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_server": { 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_client_request": 3255, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_server_request": 77, 2024-03-31T23:28:45.002 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_request": 1998, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_session": 16, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_peer_request": 1071, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "req_create_latency": { 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getattr_latency": { 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:45.003 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "req_link_latency": { 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookup_latency": { 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 826, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.425886117, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000515600 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.004 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupino_latency": { 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000112082, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000112082 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupname_latency": { 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:45.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lssnap_latency": { 2024-03-31T23:28:45.006 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mkdir_latency": { 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.007 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mknod_latency": { 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mksnap_latency": { 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "req_open_latency": { 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.008 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "req_readdir_latency": { 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 67, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.066558167, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000993405 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rename_latency": { 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.009 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmdir_latency": { 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 44, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.130511248, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.025693437 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:45.010 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setattr_latency": { 2024-03-31T23:28:45.011 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.012 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setlayout_latency": { 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setxattr_latency": { 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "req_symlink_latency": { 2024-03-31T23:28:45.013 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "req_unlink_latency": { 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1059, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2.581960673, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002438112 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_sessions": { 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "session_count": 1, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "session_add": 3, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "session_remove": 2, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_open": 1, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_stale": 0, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "total_load": 1366, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "average_load": 1366, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "avg_session_uptime": 648, 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:45.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:45.016 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:45.017 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 605379, 2024-03-31T23:28:45.018 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 442, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 182, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:45.019 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 1057634, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 17457, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "objecter": { 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_active": 0, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_laggy": 0, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send": 3052, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send_bytes": 8095035, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_resend": 33, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_reply": 3052, 2024-03-31T23:28:45.020 INFO:teuthology.orchestra.run.smithi188.stdout: "op_latency": { 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3052, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 13.375752446, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.004382618 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "op_inflight": 0, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "oplen_avg": { 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3052, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 3119 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "op": 3052, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "op_r": 475, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "op_w": 2577, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "op_rmw": 0, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "op_pg": 0, 2024-03-31T23:28:45.021 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_stat": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_create": 10, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_read": 52, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_write": 353, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writefull": 34, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writesame": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_append": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_zero": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_truncate": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_delete": 2136, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_mapext": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_getxattr": 423, 2024-03-31T23:28:45.022 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_setxattr": 20, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_call": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_watch": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_notify": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_other": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_active": 0, 2024-03-31T23:28:45.023 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_send": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_resend": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_ping": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_active": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_send": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_resend": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_active": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_send": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_resend": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_active": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_send": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_resend": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "command_active": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "command_send": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "command_resend": 0, 2024-03-31T23:28:45.024 INFO:teuthology.orchestra.run.smithi188.stdout: "map_epoch": 102, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "map_full": 0, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "map_inc": 13, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_sessions": 12, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_open": 12, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_close": 0, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_laggy": 0, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_wr": 68, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_rd": 0, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_del": 23 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "oft": { 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_objs": 1, 2024-03-31T23:28:45.025 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_updates": 0, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_removes": 0 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "osd-slow-ops": { 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_ops_count": 0 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "purge_queue": { 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops_high_water": 10, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing": 0, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_high_water": 5, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed_ops": 2123, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed": 1064, 2024-03-31T23:28:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 19190, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 8281838, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 19190, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 19190, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 8281838, 2024-03-31T23:28:45.027 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 3052, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 8216723, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 3052, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 8216723, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 1024, 2024-03-31T23:28:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 3052, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 3052, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 3052, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 3052, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 1064, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 121688, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 1064, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 52, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 121688, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.031 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle-0x5609be652500": { 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 3452, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 7874007, 2024-03-31T23:28:45.032 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 3452, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 301, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 7874007, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:45.033 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-03-31T23:28:45.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:45 smithi094 ceph-mon[36167]: pgmap v328: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:45.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:45 smithi188 ceph-mon[36068]: pgmap v328: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:45.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:45 smithi042 ceph-mon[32380]: pgmap v328: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds.exported=49 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds.imported=49 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=170 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=2346 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=3 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:45.905 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:45.906 DEBUG:tasks.check_counter:Getting stats from i 2024-03-31T23:28:45.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.i perf dump 2024-03-31T23:28:46.181 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:28:47.383 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:47 smithi188 ceph-mon[36068]: pgmap v329: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:28:47.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:47 smithi094 ceph-mon[36167]: pgmap v329: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:28:47.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:47 smithi042 ceph-mon[32380]: pgmap v329: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-31T23:28:48.018 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-03-31T23:28:48.018 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:48.018 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 20492, 2024-03-31T23:28:48.018 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 23729, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 10658358, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 26556591, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 18, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 7, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 1.224356356, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.530968760, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 1.025947769, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.048677228, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 23728, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2.347233429, 2024-03-31T23:28:48.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000098922 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 32989, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.007162863, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000217 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 1690880, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 169296 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 2600, 2024-03-31T23:28:48.020 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 3291, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 761359, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 2077714, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 18, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 7, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.289691725, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.127796152, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.091290193, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.060759836, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3288, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.296015713, 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000090029 2024-03-31T23:28:48.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2005, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000411007, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000204 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 2176, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 452048 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 3142, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 3191, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 1173201, 2024-03-31T23:28:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 2764356, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 12, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 7, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.333614437, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.138164828, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.100194935, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.080329928, 2024-03-31T23:28:48.023 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3190, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.417211252, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000130787 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1583, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000374834, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000236 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 6512, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 11504 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.024 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 1, 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-MDSRank": { 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1047, 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 6.945182857, 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.006633412 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:48.025 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3060, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.232437939, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000402757 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "mds": { 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "request": 3314, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "reply": 3285, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "reply_latency": { 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3285, 2024-03-31T23:28:48.026 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 8.775221134, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002671300 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_reply": 0, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "forward": 29, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_commit": 19, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_split": 1, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_merge": 0, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes": 1528, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_top": 2, 2024-03-31T23:28:48.027 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_bottom": 6, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pin_tail": 1520, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pinned": 1523, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_expired": 2393, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_with_caps": 1, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "caps": 1, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "subtrees": 3, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse": 5739, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_hit": 4362, 2024-03-31T23:28:48.028 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_forward": 1, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_discover": 979, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_lock": 0, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "load_cent": 0, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "q": 0, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "exported": 12, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "exported_inodes": 1277, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "imported": 12, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "imported_inodes": 1575, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:48.029 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_backtrace_fetch": 1231, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rfiles": 4, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rbytes": 234, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rsnaps": 3, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_fetch": 1231, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_inodes": 59, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dirfrag_rstats": 59, 2024-03-31T23:28:48.030 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_file_inodes": 1172, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_inode_file_caps": 14, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_revoke": 454, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_grant": 3020, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps": 2442, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps_dirty": 1993, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_cap_release": 18, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "process_request_cap_release": 2135 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_cache": { 2024-03-31T23:28:48.031 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update": 86, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update_receipt": 2419, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_try_discover": 1676, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_send_discover": 1416, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_handle_discover": 172, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays": 48, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_created": 1837, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_enqueued": 1789, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_migrated": 0, 2024-03-31T23:28:48.032 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_started": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_completed": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_exportdir": 12, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_flush": 0, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragmentdir": 1, 2024-03-31T23:28:48.033 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_inodestats": 0 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_log": { 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "evlrg": 0, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "evadd": 8399, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "evex": 0, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "evtrm": 0, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "ev": 8399, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "evexg": 0, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "evexd": 0, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "segadd": 11, 2024-03-31T23:28:48.034 INFO:teuthology.orchestra.run.smithi188.stdout: "segex": 0, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "segtrm": 0, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "seg": 11, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "segmjr": 2, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "segexg": 0, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "segexd": 0, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "expos": 4194304, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "wrpos": 24696991, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "rdpos": 0, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "jlat": { 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 158, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 13.107552558, 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.082959193 2024-03-31T23:28:48.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "replayed": 0 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_mem": { 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "ino": 753, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "ino+": 4238, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "ino-": 3485, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "dir": 90, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "dir+": 813, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "dir-": 723, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "dn": 1528, 2024-03-31T23:28:48.036 INFO:teuthology.orchestra.run.smithi188.stdout: "dn+": 5710, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "dn-": 4182, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "cap": 1, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "cap+": 2294, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "cap-": 2293, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "rss": 80636, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "heap": 223612 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_server": { 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_client_request": 4163, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_server_request": 201, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_request": 3314, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_session": 31, 2024-03-31T23:28:48.037 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_peer_request": 702, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "req_create_latency": { 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1060, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.618646689, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001527025 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getattr_latency": { 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 10, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.017752298, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001775229 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.038 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "req_link_latency": { 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookup_latency": { 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 288, 2024-03-31T23:28:48.039 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.154845163, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000537656 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupino_latency": { 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.040 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupname_latency": { 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.042 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lssnap_latency": { 2024-03-31T23:28:48.042 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mkdir_latency": { 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mknod_latency": { 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.043 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mksnap_latency": { 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "req_open_latency": { 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "req_readdir_latency": { 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 90, 2024-03-31T23:28:48.044 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.124577180, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001384190 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rename_latency": { 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmdir_latency": { 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 48, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 1.623717286, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.033827443 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.046 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setattr_latency": { 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.047 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setlayout_latency": { 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setxattr_latency": { 2024-03-31T23:28:48.048 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "req_symlink_latency": { 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "req_unlink_latency": { 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1789, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 5.235682518, 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002926597 2024-03-31T23:28:48.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_sessions": { 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "session_count": 2, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "session_add": 4, 2024-03-31T23:28:48.050 INFO:teuthology.orchestra.run.smithi188.stdout: "session_remove": 2, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_open": 2, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_stale": 0, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "total_load": 2607, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "average_load": 1303, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "avg_session_uptime": 584, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:48.052 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:48.053 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 687800, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 954, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 704, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 8, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:48.054 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 182, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 3049508, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 44245, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "objecter": { 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "op_active": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "op_laggy": 0, 2024-03-31T23:28:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send": 5129, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send_bytes": 21061599, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op_resend": 32, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op_reply": 5129, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op_latency": { 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 5129, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 34.855353719, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.006795740 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op_inflight": 0, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "oplen_avg": { 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 5129, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 5194 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op": 5129, 2024-03-31T23:28:48.056 INFO:teuthology.orchestra.run.smithi188.stdout: "op_r": 1264, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "op_w": 3865, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "op_rmw": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "op_pg": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_stat": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_create": 10, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_read": 33, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_write": 191, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writefull": 24, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writesame": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_append": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_zero": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_truncate": 1, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_delete": 3594, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_mapext": 0, 2024-03-31T23:28:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_getxattr": 1231, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_setxattr": 20, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_call": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_watch": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_notify": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:48.058 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_other": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_active": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_send": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_resend": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_ping": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_active": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_send": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_resend": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_active": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_send": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_resend": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_active": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_send": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_resend": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "command_active": 0, 2024-03-31T23:28:48.059 INFO:teuthology.orchestra.run.smithi188.stdout: "command_send": 0, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "command_resend": 0, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "map_epoch": 102, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "map_full": 0, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "map_inc": 13, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_sessions": 12, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_open": 12, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_close": 0, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_laggy": 0, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_wr": 72, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_rd": 0, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_del": 18 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "oft": { 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_objs": 1, 2024-03-31T23:28:48.060 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_updates": 0, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_removes": 0 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "osd-slow-ops": { 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_ops_count": 0 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "purge_queue": { 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops_high_water": 10, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing": 0, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_high_water": 5, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed_ops": 3578, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed": 1789, 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 26230, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 10306099, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 26230, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 26230, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 10306099, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.062 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 5129, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 21265976, 2024-03-31T23:28:48.063 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 5129, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 21265976, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 1024, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:48.064 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 5129, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 5129, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 5129, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 5129, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:48.065 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 1789, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 204377, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 1789, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 33, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 204377, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle-0x55bb5339c500": { 2024-03-31T23:28:48.066 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 8399, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 20502687, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 8399, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 158, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 20502687, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:48.067 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.068 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:48.068 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-03-31T23:28:48.779 INFO:tasks.check_counter:Daemon mds.i mds.exported=12 2024-03-31T23:28:48.779 INFO:tasks.check_counter:Daemon mds.i mds.imported=12 2024-03-31T23:28:48.779 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=86 2024-03-31T23:28:48.780 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=2419 2024-03-31T23:28:48.780 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=3 2024-03-31T23:28:48.780 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:48.780 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:48.780 DEBUG:tasks.check_counter:Getting stats from l 2024-03-31T23:28:48.780 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583 shell --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.l perf dump 2024-03-31T23:28:49.099 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/mon.c/config 2024-03-31T23:28:49.381 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:49 smithi188 ceph-mon[36068]: pgmap v330: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:49.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:49 smithi094 ceph-mon[36167]: pgmap v330: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:49.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:49 smithi042 ceph-mon[32380]: pgmap v330: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 761, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 763, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 4386181, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 242062, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 7, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.053899329, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.014260348, 2024-03-31T23:28:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.015222684, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.019203679, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 761, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.018755669, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000024646 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-31T23:28:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 0 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 715, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 885, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 5721945, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 679875, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 7, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 5, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.058438330, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.021453747, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.016037669, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.015354943, 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 882, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.024287095, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000027536 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 453136 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 1079, 2024-03-31T23:28:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 1038, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 6126008, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 393724, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 4, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 3, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.098733264, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.027139239, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.053064618, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.024481930, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1038, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.028641335, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000027592 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-03-31T23:28:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 1667120, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 141232 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 1, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-MDSRank": { 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3783, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.086328031, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000022819 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-PurgeQueue": { 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "mds": { 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "request": 0, 2024-03-31T23:28:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "reply": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "reply_latency": { 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_reply": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "forward": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_complete": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_keys": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_commit": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_split": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_merge": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes": 2492, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_top": 0, 2024-03-31T23:28:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_bottom": 2492, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pin_tail": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pinned": 2492, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_expired": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_with_caps": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "caps": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "subtrees": 1, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_hit": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_forward": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_discover": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_dir_fetch": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_remote_ino": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_lock": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "load_cent": 0, 2024-03-31T23:28:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "q": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "exported": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "exported_inodes": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "imported": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "imported_inodes": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_dir_fetch": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_backtrace_fetch": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_peer_discover": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rfiles": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rbytes": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rsnaps": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_fetch": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_set_tag": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_repaired": 0, 2024-03-31T23:28:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_inotable_repaired": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_inodes": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_base_inodes": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dirfrag_rstats": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_file_inodes": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_inode_file_caps": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_revoke": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_grant": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_trunc": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps_dirty": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_cap_release": 0, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "process_request_cap_release": 0 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_cache": { 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update_receipt": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_try_discover": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_send_discover": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_handle_discover": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_delayed": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_enqueuing": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_created": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_enqueued": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_reintegrated": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_migrated": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_processing": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_enqueued": 0, 2024-03-31T23:28:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_prioritized": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_started": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_completed": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_path": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_inode": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_enqueue_scrub": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_exportdir": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_flush": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragmentdir": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragstats": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_inodestats": 0 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_log": { 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "evlrg": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "evadd": 0, 2024-03-31T23:28:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "evex": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "evtrm": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "ev": 6346, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "evexg": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "evexd": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "segadd": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "segex": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "segtrm": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "seg": 9, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "segmjr": 2, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "segexg": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "segexd": 0, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "expos": 4194304, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "wrpos": 18118172, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "rdpos": 18103633, 2024-03-31T23:28:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "jlat": { 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "replayed": 6346 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_mem": { 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "ino": 656, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "ino+": 1958, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "ino-": 1302, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "dir": 71, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "dir+": 97, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "dir-": 26, 2024-03-31T23:28:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "dn": 2492, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "dn+": 2778, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "dn-": 286, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "cap": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "cap+": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "cap-": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "rss": 57820, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "heap": 215420 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_server": { 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_client_request": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_server_request": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_request": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_session": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_peer_request": 0, 2024-03-31T23:28:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "req_create_latency": { 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getattr_latency": { 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getfilelock_latency": { 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "req_link_latency": { 2024-03-31T23:28:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookup_latency": { 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookuphash_latency": { 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupino_latency": { 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupname_latency": { 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupparent_latency": { 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupsnap_latency": { 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lssnap_latency": { 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mkdir_latency": { 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mknod_latency": { 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mksnap_latency": { 2024-03-31T23:28:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "req_open_latency": { 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "req_readdir_latency": { 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rename_latency": { 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "req_renamesnap_latency": { 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "req_snapdiff_latency": { 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmdir_latency": { 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmsnap_latency": { 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmxattr_latency": { 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setattr_latency": { 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setdirlayout_latency": { 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setfilelock_latency": { 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setlayout_latency": { 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setxattr_latency": { 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "req_symlink_latency": { 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "req_unlink_latency": { 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_revoke_eviction": 0, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_acquisition_throttle": 0, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getvxattr_latency": { 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.027 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_sessions": { 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "session_count": 2, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "session_add": 4, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "session_remove": 2, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_open": 2, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_stale": 0, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "total_load": 0, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "average_load": 0, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "avg_session_uptime": 3366, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "mdthresh_evicted": 0 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-03-31T23:28:51.028 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-03-31T23:28:51.029 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-03-31T23:28:51.030 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 232132, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 758, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-03-31T23:28:51.031 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 9512, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 182, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 3423120, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 36970, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "objecter": { 2024-03-31T23:28:51.032 INFO:teuthology.orchestra.run.smithi188.stdout: "op_active": 0, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_laggy": 0, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send": 2268, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send_bytes": 21, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_resend": 3, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_reply": 2268, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_latency": { 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2268, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2.496953994, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001100949 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "op_inflight": 0, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "oplen_avg": { 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2268, 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2269 2024-03-31T23:28:51.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "op": 2268, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "op_r": 2268, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "op_w": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "op_rmw": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "op_pg": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_stat": 1467, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_create": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_read": 799, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_write": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writefull": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writesame": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_append": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_zero": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_truncate": 0, 2024-03-31T23:28:51.034 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_delete": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_mapext": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_sparse_read": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_clonerange": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_getxattr": 1, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_setxattr": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_cmpxattr": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_rmxattr": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_resetxattrs": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_call": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_watch": 0, 2024-03-31T23:28:51.035 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_notify": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_src_cmpxattr": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls_filter": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_other": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_active": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_send": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_resend": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_ping": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_active": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_send": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_resend": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_active": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_send": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_resend": 0, 2024-03-31T23:28:51.036 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_active": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_send": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_resend": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "command_active": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "command_send": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "command_resend": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "map_epoch": 102, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "map_full": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "map_inc": 13, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_sessions": 7, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_open": 7, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_close": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_laggy": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_wr": 0, 2024-03-31T23:28:51.037 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_rd": 2, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_del": 0 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "oft": { 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_objs": 0, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_kv_pairs": 0, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_updates": 0, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_removes": 0 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "osd-slow-ops": { 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_ops_count": 0 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "purge_queue": { 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops": 0, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops_high_water": 0, 2024-03-31T23:28:51.038 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing": 0, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_high_water": 0, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed_ops": 0, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed": 0, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_item_in_journal": 0 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 2551, 2024-03-31T23:28:51.039 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 15987257, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 2551, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 2551, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 15987257, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_bytes": { 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:51.040 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 2268, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 13926514, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 2268, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 13926514, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_ops": { 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 1024, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 2268, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 2268, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 2268, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 2268, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.042 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle": { 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 0, 2024-03-31T23:28:51.043 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle-0x557747f266e0": { 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-03-31T23:28:51.044 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 0, 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 0, 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-03-31T23:28:51.045 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-03-31T23:28:51.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:51 smithi094 ceph-mon[36167]: pgmap v331: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:51.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:51 smithi188 ceph-mon[36068]: pgmap v331: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:51.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:51 smithi042 ceph-mon[32380]: pgmap v331: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:51.772 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-03-31T23:28:51.772 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-03-31T23:28:51.773 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-03-31T23:28:51.773 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-03-31T23:28:51.773 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-03-31T23:28:51.773 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-03-31T23:28:51.773 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-03-31T23:28:51.773 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-31T23:28:51.787 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-31T23:28:51.787 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:28:51.787 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T23:28:51.809 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:28:51.809 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T23:28:51.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 -- 172.21.15.42:0/1016438469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82781032e0 msgr2=0x7f827810b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 --2- 172.21.15.42:0/1016438469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82781032e0 0x7f827810b7c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f826002bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 -- 172.21.15.42:0/1016438469 shutdown_connections 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 --2- 172.21.15.42:0/1016438469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827810bd90 0x7f827810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 --2- 172.21.15.42:0/1016438469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82781032e0 0x7f827810b7c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 --2- 172.21.15.42:0/1016438469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82781029c0 0x7f8278102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 -- 172.21.15.42:0/1016438469 >> 172.21.15.42:0/1016438469 conn(0x7f8278077750 msgr2=0x7f8278077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 -- 172.21.15.42:0/1016438469 shutdown_connections 2024-03-31T23:28:52.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.024+0000 7f827cd02640 1 -- 172.21.15.42:0/1016438469 wait complete. 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 Processor -- start 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 -- start start 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82781029c0 0x7f8278198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82781032e0 0x7f82781986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 0x7f827819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8278111c60 con 0x7f827810bd90 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8278111ae0 con 0x7f82781032e0 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827cd02640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8278111de0 con 0x7f82781029c0 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f8276d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 0x7f827819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f827659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82781029c0 0x7f8278198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f8276d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 0x7f827819c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46432/0 (socket says 172.21.15.42:46432) 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f8276d9d640 1 -- 172.21.15.42:0/1719946361 learned_addr learned my addr 172.21.15.42:0/1719946361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.025+0000 7f8275d9b640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82781032e0 0x7f82781986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f8276d9d640 1 -- 172.21.15.42:0/1719946361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82781029c0 msgr2=0x7f8278198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f8276d9d640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82781029c0 0x7f8278198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f8276d9d640 1 -- 172.21.15.42:0/1719946361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82781032e0 msgr2=0x7f82781986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f8276d9d640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82781032e0 0x7f82781986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f8276d9d640 1 -- 172.21.15.42:0/1719946361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827819d120 con 0x7f827810bd90 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f8276d9d640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 0x7f827819c9f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f826800eb10 tx=0x7f826800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268004b20 con 0x7f827810bd90 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827819d410 con 0x7f827810bd90 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8268004cc0 con 0x7f827810bd90 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680107f0 con 0x7f827810bd90 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.026+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781a4ca0 con 0x7f827810bd90 2024-03-31T23:28:52.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.027+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8278068540 con 0x7f827810bd90 2024-03-31T23:28:52.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.028+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f8268005020 con 0x7f827810bd90 2024-03-31T23:28:52.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.029+0000 7f826f7fe640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f82640a2610 0x7f82640a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.029+0000 7f827659c640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f82640a2610 0x7f82640a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.029+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f82680cf490 con 0x7f827810bd90 2024-03-31T23:28:52.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.029+0000 7f827659c640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f82640a2610 0x7f82640a4ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8270009bd0 tx=0x7f8270005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.033+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f826809bf40 con 0x7f827810bd90 2024-03-31T23:28:52.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.219+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8278106e80 con 0x7f827810bd90 2024-03-31T23:28:52.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.221+0000 7f826f7fe640 1 -- 172.21.15.42:0/1719946361 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+25247 (secure 0 0 0) 0x7f826809b840 con 0x7f827810bd90 2024-03-31T23:28:52.222 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:28:52.222 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":102,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:28:13.611742+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1986563449":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/1673984370":"2024-04-01T23:18:09.837578+0000","172.21.15.42:6800/2637331812":"2024-04-01T23:18:09.837578+0000","172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6801/2637331812":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3564928943":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/2338905125":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:28:52.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f82640a2610 msgr2=0x7f82640a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f82640a2610 0x7f82640a4ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8270009bd0 tx=0x7f8270005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 msgr2=0x7f827819c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 0x7f827819c9f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f826800eb10 tx=0x7f826800c2d0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 shutdown_connections 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f82640a2610 0x7f82640a4ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827810bd90 0x7f827819c9f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82781032e0 0x7f82781986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 --2- 172.21.15.42:0/1719946361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82781029c0 0x7f8278198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 >> 172.21.15.42:0/1719946361 conn(0x7f8278077750 msgr2=0x7f82780fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 shutdown_connections 2024-03-31T23:28:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.223+0000 7f827cd02640 1 -- 172.21.15.42:0/1719946361 wait complete. 2024-03-31T23:28:52.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T23:10:59.033651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T23:15:31.173466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T23:15:32.407121+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-31T23:15:36.393994+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-31T23:28:52.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 -- 172.21.15.42:0/3574573474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc1077c0 msgr2=0x7f4abc107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 --2- 172.21.15.42:0/3574573474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc1077c0 0x7f4abc107ba0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009900 tx=0x7f4ab802bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 -- 172.21.15.42:0/3574573474 shutdown_connections 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 --2- 172.21.15.42:0/3574573474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc06a720 0x7f4abc10e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 --2- 172.21.15.42:0/3574573474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4abc069d80 0x7f4abc06a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 --2- 172.21.15.42:0/3574573474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc1077c0 0x7f4abc107ba0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 -- 172.21.15.42:0/3574573474 >> 172.21.15.42:0/3574573474 conn(0x7f4abc0773f0 msgr2=0x7f4abc077800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 -- 172.21.15.42:0/3574573474 shutdown_connections 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.340+0000 7f4ac431e640 1 -- 172.21.15.42:0/3574573474 wait complete. 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 Processor -- start 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 -- start start 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 0x7f4abc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc06a720 0x7f4abc1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4abc1077c0 0x7f4abc19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc111bb0 con 0x7f4abc069d80 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc111a30 con 0x7f4abc1077c0 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac431e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc111d30 con 0x7f4abc06a720 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 0x7f4abc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 0x7f4abc197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46448/0 (socket says 172.21.15.42:46448) 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 -- 172.21.15.42:0/2600729788 learned_addr learned my addr 172.21.15.42:0/2600729788 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:52.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac28bb640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4abc1077c0 0x7f4abc19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac18b9640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc06a720 0x7f4abc1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 -- 172.21.15.42:0/2600729788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc06a720 msgr2=0x7f4abc1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc06a720 0x7f4abc1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 -- 172.21.15.42:0/2600729788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4abc1077c0 msgr2=0x7f4abc19c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4abc1077c0 0x7f4abc19c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.341+0000 7f4ac20ba640 1 -- 172.21.15.42:0/2600729788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc19cfa0 con 0x7f4abc069d80 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.342+0000 7f4ac20ba640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 0x7f4abc197fb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8005940 tx=0x7f4ab802dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.342+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8043020 con 0x7f4abc069d80 2024-03-31T23:28:52.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.342+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ab8004250 con 0x7f4abc069d80 2024-03-31T23:28:52.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.342+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc19d230 con 0x7f4abc069d80 2024-03-31T23:28:52.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.342+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8003a10 con 0x7f4abc069d80 2024-03-31T23:28:52.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.342+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc1a4b20 con 0x7f4abc069d80 2024-03-31T23:28:52.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.343+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc102e50 con 0x7f4abc069d80 2024-03-31T23:28:52.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.344+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f4ab8046020 con 0x7f4abc069d80 2024-03-31T23:28:52.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.344+0000 7f4ab37fe640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4aa80a2690 0x7f4aa80a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.345+0000 7f4ac18b9640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4aa80a2690 0x7f4aa80a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.345+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f4ab80f0da0 con 0x7f4abc069d80 2024-03-31T23:28:52.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.345+0000 7f4ac18b9640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4aa80a2690 0x7f4aa80a4b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0095f0 tx=0x7f4aac005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.349+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4ab804d020 con 0x7f4abc069d80 2024-03-31T23:28:52.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.531+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4abc1a4cf0 con 0x7f4abc069d80 2024-03-31T23:28:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.531+0000 7f4ab37fe640 1 -- 172.21.15.42:0/2600729788 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) ==== 93+0+10 (secure 0 0 0) 0x7f4ab80bd900 con 0x7f4abc069d80 2024-03-31T23:28:52.532 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4aa80a2690 msgr2=0x7f4aa80a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4aa80a2690 0x7f4aa80a4b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0095f0 tx=0x7f4aac005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 msgr2=0x7f4abc197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 0x7f4abc197fb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8005940 tx=0x7f4ab802dc90 comp rx=0 tx=0).stop 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 shutdown_connections 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4abc1077c0 0x7f4abc19c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc06a720 0x7f4abc1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4aa80a2690 0x7f4aa80a4b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 --2- 172.21.15.42:0/2600729788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4abc069d80 0x7f4abc197fb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 >> 172.21.15.42:0/2600729788 conn(0x7f4abc0773f0 msgr2=0x7f4abc0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 shutdown_connections 2024-03-31T23:28:52.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.533+0000 7f4ac431e640 1 -- 172.21.15.42:0/2600729788 wait complete. 2024-03-31T23:28:52.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T23:28:52.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 -- 172.21.15.42:0/2407641148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e000ffc50 msgr2=0x7f4e001000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2407641148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e000ffc50 0x7f4e001000b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009930 tx=0x7f4df402bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 -- 172.21.15.42:0/2407641148 shutdown_connections 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2407641148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e001005f0 0x7f4e0010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2407641148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e000ffc50 0x7f4e001000b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2407641148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e00107710 0x7f4e00107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 -- 172.21.15.42:0/2407641148 >> 172.21.15.42:0/2407641148 conn(0x7f4e00076c10 msgr2=0x7f4e000fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 -- 172.21.15.42:0/2407641148 shutdown_connections 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.650+0000 7f4e077a1640 1 -- 172.21.15.42:0/2407641148 wait complete. 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 Processor -- start 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 -- start start 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 0x7f4e00198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e001005f0 0x7f4e00198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e00107710 0x7f4e0019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00111c20 con 0x7f4e000ffc50 2024-03-31T23:28:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00111aa0 con 0x7f4e00107710 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e077a1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00111da0 con 0x7f4e001005f0 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 0x7f4e00198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e05d3e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e00107710 0x7f4e0019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e04d3c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e001005f0 0x7f4e00198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 0x7f4e00198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46456/0 (socket says 172.21.15.42:46456) 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 -- 172.21.15.42:0/2380088542 learned_addr learned my addr 172.21.15.42:0/2380088542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 -- 172.21.15.42:0/2380088542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e001005f0 msgr2=0x7f4e00198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e001005f0 0x7f4e00198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 -- 172.21.15.42:0/2380088542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e00107710 msgr2=0x7f4e0019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e00107710 0x7f4e0019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 -- 172.21.15.42:0/2380088542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0019d0c0 con 0x7f4e000ffc50 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e05d3e640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e00107710 0x7f4e0019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.651+0000 7f4e0553d640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 0x7f4e00198120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4df800ea60 tx=0x7f4df800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.652+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df800cde0 con 0x7f4e000ffc50 2024-03-31T23:28:52.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.652+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0019d3b0 con 0x7f4e000ffc50 2024-03-31T23:28:52.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.652+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4df80035f0 con 0x7f4e000ffc50 2024-03-31T23:28:52.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.652+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8010720 con 0x7f4e000ffc50 2024-03-31T23:28:52.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.652+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e001a4c40 con 0x7f4e000ffc50 2024-03-31T23:28:52.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.653+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e00068990 con 0x7f4e000ffc50 2024-03-31T23:28:52.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.654+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f4df80037a0 con 0x7f4e000ffc50 2024-03-31T23:28:52.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.654+0000 7f4dfe7fc640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4de80a2610 0x7f4de80a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.655+0000 7f4e04d3c640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4de80a2610 0x7f4de80a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.655+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f4df80cf370 con 0x7f4e000ffc50 2024-03-31T23:28:52.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.655+0000 7f4e04d3c640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4de80a2610 0x7f4de80a4ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4df4005ab0 tx=0x7f4df4005fd0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.658+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4df809be50 con 0x7f4e000ffc50 2024-03-31T23:28:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.841+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4e00109cc0 con 0x7f4e000ffc50 2024-03-31T23:28:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.841+0000 7f4dfe7fc640 1 -- 172.21.15.42:0/2380088542 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) ==== 104+0+11 (secure 0 0 0) 0x7f4df809b750 con 0x7f4e000ffc50 2024-03-31T23:28:52.842 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:28:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4de80a2610 msgr2=0x7f4de80a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4de80a2610 0x7f4de80a4ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4df4005ab0 tx=0x7f4df4005fd0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 msgr2=0x7f4e00198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 0x7f4e00198120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4df800ea60 tx=0x7f4df800ef20 comp rx=0 tx=0).stop 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 shutdown_connections 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e00107710 0x7f4e0019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e001005f0 0x7f4e00198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4de80a2610 0x7f4de80a4ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 --2- 172.21.15.42:0/2380088542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e000ffc50 0x7f4e00198120 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 >> 172.21.15.42:0/2380088542 conn(0x7f4e00076c10 msgr2=0x7f4e000fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 shutdown_connections 2024-03-31T23:28:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.844+0000 7f4e077a1640 1 -- 172.21.15.42:0/2380088542 wait complete. 2024-03-31T23:28:52.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 -- 172.21.15.42:0/3457746194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a50106680 msgr2=0x7f4a50106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 --2- 172.21.15.42:0/3457746194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a50106680 0x7f4a50106a60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009900 tx=0x7f4a4c02bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 -- 172.21.15.42:0/3457746194 shutdown_connections 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 --2- 172.21.15.42:0/3457746194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 0x7f4a5010d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 --2- 172.21.15.42:0/3457746194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a501008a0 0x7f4a50100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 --2- 172.21.15.42:0/3457746194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a50106680 0x7f4a50106a60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 -- 172.21.15.42:0/3457746194 >> 172.21.15.42:0/3457746194 conn(0x7f4a500773f0 msgr2=0x7f4a50077800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 -- 172.21.15.42:0/3457746194 shutdown_connections 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.961+0000 7f4a57e98640 1 -- 172.21.15.42:0/3457746194 wait complete. 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 Processor -- start 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 -- start start 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 0x7f4a50196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 0x7f4a50197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a50106680 0x7f4a5019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50110ad0 con 0x7f4a501008a0 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50110950 con 0x7f4a50106680 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a57e98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50110c50 con 0x7f4a50101240 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 0x7f4a50196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 0x7f4a50196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46480/0 (socket says 172.21.15.42:46480) 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 -- 172.21.15.42:0/4072347791 learned_addr learned my addr 172.21.15.42:0/4072347791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a56435640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a50106680 0x7f4a5019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55433640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 0x7f4a50197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 -- 172.21.15.42:0/4072347791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 msgr2=0x7f4a50197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 0x7f4a50197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 -- 172.21.15.42:0/4072347791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a50106680 msgr2=0x7f4a5019b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a50106680 0x7f4a5019b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 -- 172.21.15.42:0/4072347791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5019bf20 con 0x7f4a501008a0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55433640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 0x7f4a50197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.962+0000 7f4a55c34640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 0x7f4a50196f30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005940 tx=0x7f4a4c004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.963+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c043070 con 0x7f4a501008a0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.963+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4a4c004250 con 0x7f4a501008a0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.963+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5019c1b0 con 0x7f4a501008a0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.963+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c003a80 con 0x7f4a501008a0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.963+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a50069d80 con 0x7f4a501008a0 2024-03-31T23:28:52.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.964+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a50101d60 con 0x7f4a501008a0 2024-03-31T23:28:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.965+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f4a4c046070 con 0x7f4a501008a0 2024-03-31T23:28:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.966+0000 7f4a46ffd640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4a3c0a2610 0x7f4a3c0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.966+0000 7f4a55433640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4a3c0a2610 0x7f4a3c0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.966+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f4a4c0f3380 con 0x7f4a501008a0 2024-03-31T23:28:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.966+0000 7f4a55433640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4a3c0a2610 0x7f4a3c0a4ad0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4a50105d70 tx=0x7f4a40005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:52.970+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4a4c0bff40 con 0x7f4a501008a0 2024-03-31T23:28:53.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.152+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4a5006a7a0 con 0x7f4a501008a0 2024-03-31T23:28:53.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.153+0000 7f4a46ffd640 1 -- 172.21.15.42:0/4072347791 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) ==== 100+0+11 (secure 0 0 0) 0x7f4a4c0bf840 con 0x7f4a501008a0 2024-03-31T23:28:53.154 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-03-31T23:28:53.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4a3c0a2610 msgr2=0x7f4a3c0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4a3c0a2610 0x7f4a3c0a4ad0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4a50105d70 tx=0x7f4a40005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 msgr2=0x7f4a50196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 0x7f4a50196f30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005940 tx=0x7f4a4c004a90 comp rx=0 tx=0).stop 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 shutdown_connections 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a50106680 0x7f4a5019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a50101240 0x7f4a50197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f4a3c0a2610 0x7f4a3c0a4ad0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 --2- 172.21.15.42:0/4072347791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a501008a0 0x7f4a50196f30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 >> 172.21.15.42:0/4072347791 conn(0x7f4a500773f0 msgr2=0x7f4a500ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 shutdown_connections 2024-03-31T23:28:53.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.155+0000 7f4a57e98640 1 -- 172.21.15.42:0/4072347791 wait complete. 2024-03-31T23:28:53.166 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-31T23:28:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 -- 172.21.15.42:0/2517094489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 msgr2=0x7f1da010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2517094489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da010d490 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009cd0 tx=0x7f1d9802c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 -- 172.21.15.42:0/2517094489 shutdown_connections 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2517094489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da010d490 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2517094489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 0x7f1da0100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2517094489 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1da0106660 0x7f1da0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 -- 172.21.15.42:0/2517094489 >> 172.21.15.42:0/2517094489 conn(0x7f1da0077750 msgr2=0x7f1da0077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 -- 172.21.15.42:0/2517094489 shutdown_connections 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 -- 172.21.15.42:0/2517094489 wait complete. 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 Processor -- start 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.271+0000 7f1da6da1640 1 -- start start 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 0x7f1da0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1da0106660 0x7f1da01a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1da0110b00 con 0x7f1da0100f80 2024-03-31T23:28:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1da0110980 con 0x7f1da0106660 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1da0110c80 con 0x7f1da01005c0 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da0199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46512/0 (socket says 172.21.15.42:46512) 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da4b3d640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 0x7f1da0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2243108895 learned_addr learned my addr 172.21.15.42:0/2243108895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da533e640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1da0106660 0x7f1da01a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2243108895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 msgr2=0x7f1da0198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 0x7f1da0198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2243108895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1da0106660 msgr2=0x7f1da01a3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1da0106660 0x7f1da01a3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 -- 172.21.15.42:0/2243108895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da01a4400 con 0x7f1da0100f80 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da4b3d640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 0x7f1da0198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9ffff640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da0199380 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00e9f0 tx=0x7f1d8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00cd80 con 0x7f1da0100f80 2024-03-31T23:28:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da01a45d0 con 0x7f1da0100f80 2024-03-31T23:28:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d8c005520 con 0x7f1da0100f80 2024-03-31T23:28:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.272+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c010690 con 0x7f1da0100f80 2024-03-31T23:28:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.273+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da01a4aa0 con 0x7f1da0100f80 2024-03-31T23:28:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.274+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da0068540 con 0x7f1da0100f80 2024-03-31T23:28:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.275+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f1d8c0046c0 con 0x7f1da0100f80 2024-03-31T23:28:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.275+0000 7f1d9dffb640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1d900a2610 0x7f1d900a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.275+0000 7f1da4b3d640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1d900a2610 0x7f1d900a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.275+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f1d8c0cf310 con 0x7f1da0100f80 2024-03-31T23:28:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.276+0000 7f1da4b3d640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1d900a2610 0x7f1d900a4ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da0101700 tx=0x7f1d94005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:53.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.280+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1d8c09bdc0 con 0x7f1da0100f80 2024-03-31T23:28:53.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:53 smithi094 ceph-mon[36167]: pgmap v332: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:53.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1719946361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:53.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2600729788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:28:53.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:53 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2380088542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:28:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.465+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1da01a4d60 con 0x7f1da0100f80 2024-03-31T23:28:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.465+0000 7f1d9dffb640 1 -- 172.21.15.42:0/2243108895 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v102) ==== 103+0+11 (secure 0 0 0) 0x7f1d8c09b6c0 con 0x7f1da0100f80 2024-03-31T23:28:53.466 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1d900a2610 msgr2=0x7f1d900a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1d900a2610 0x7f1d900a4ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da0101700 tx=0x7f1d94005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 msgr2=0x7f1da0199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da0199380 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00e9f0 tx=0x7f1d8c00edf0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 shutdown_connections 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1da0106660 0x7f1da01a3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f1d900a2610 0x7f1d900a4ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da0100f80 0x7f1da0199380 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 --2- 172.21.15.42:0/2243108895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1da01005c0 0x7f1da0198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 >> 172.21.15.42:0/2243108895 conn(0x7f1da0077750 msgr2=0x7f1da00feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:53.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 shutdown_connections 2024-03-31T23:28:53.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.467+0000 7f1da6da1640 1 -- 172.21.15.42:0/2243108895 wait complete. 2024-03-31T23:28:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:53 smithi188 ceph-mon[36068]: pgmap v332: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1719946361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2600729788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:28:53.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:53 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2380088542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:28:53.478 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:53 smithi042 ceph-mon[32380]: pgmap v332: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-03-31T23:28:53.478 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1719946361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:53.478 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2600729788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-31T23:28:53.478 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:53 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2380088542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-31T23:28:53.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T23:28:53.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.582+0000 7f980b807640 1 -- 172.21.15.42:0/18671669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804100f80 msgr2=0x7f980410d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.582+0000 7f980b807640 1 --2- 172.21.15.42:0/18671669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804100f80 0x7f980410d490 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009cd0 tx=0x7f97f402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- 172.21.15.42:0/18671669 shutdown_connections 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 --2- 172.21.15.42:0/18671669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804100f80 0x7f980410d490 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 --2- 172.21.15.42:0/18671669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98041005c0 0x7f9804100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 --2- 172.21.15.42:0/18671669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9804106660 0x7f9804106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- 172.21.15.42:0/18671669 >> 172.21.15.42:0/18671669 conn(0x7f9804077750 msgr2=0x7f9804077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- 172.21.15.42:0/18671669 shutdown_connections 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- 172.21.15.42:0/18671669 wait complete. 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 Processor -- start 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- start start 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98041005c0 0x7f9804198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9804100f80 0x7f9804199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 0x7f98041a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9804110ac0 con 0x7f9804106660 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9804110940 con 0x7f9804100f80 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.583+0000 7f980b807640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9804110c40 con 0x7f98041005c0 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 0x7f98041a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f98095a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98041005c0 0x7f9804198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9808da2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9804100f80 0x7f9804199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 0x7f98041a3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50818/0 (socket says 172.21.15.42:50818) 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f98095a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98041005c0 0x7f9804198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.42:56504/0 (socket says 172.21.15.42:56504) 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 -- 172.21.15.42:0/3634911149 learned_addr learned my addr 172.21.15.42:0/3634911149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 -- 172.21.15.42:0/3634911149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98041005c0 msgr2=0x7f9804198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98041005c0 0x7f9804198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 -- 172.21.15.42:0/3634911149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9804100f80 msgr2=0x7f9804199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9804100f80 0x7f9804199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 -- 172.21.15.42:0/3634911149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98041a43c0 con 0x7f9804106660 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9808da2640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9804100f80 0x7f9804199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f9809da4640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 0x7f98041a3e80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f97f4004af0 tx=0x7f97f4032550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4039040 con 0x7f9804106660 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97f4044070 con 0x7f9804106660 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98041a4590 con 0x7f9804106660 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f40042a0 con 0x7f9804106660 2024-03-31T23:28:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.584+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98041a4a50 con 0x7f9804106660 2024-03-31T23:28:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.585+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9804068540 con 0x7f9804106660 2024-03-31T23:28:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.586+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f97f4003970 con 0x7f9804106660 2024-03-31T23:28:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.587+0000 7f98027fc640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f97ec0a2610 0x7f97ec0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.587+0000 7f98095a3640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f97ec0a2610 0x7f97ec0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.587+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f97f40f12e0 con 0x7f9804106660 2024-03-31T23:28:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.587+0000 7f98095a3640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f97ec0a2610 0x7f97ec0a4ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9804101700 tx=0x7f97fc005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:53.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.591+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f97f40bded0 con 0x7f9804106660 2024-03-31T23:28:53.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.788+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f98041a4d80 con 0x7f9804106660 2024-03-31T23:28:53.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.788+0000 7f98027fc640 1 -- 172.21.15.42:0/3634911149 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v102) ==== 81+0+942 (secure 0 0 0) 0x7f97f40bd7d0 con 0x7f9804106660 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1986563449 2024-04-01T23:18:09.837578+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1673984370 2024-04-01T23:18:09.837578+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/2637331812 2024-04-01T23:18:09.837578+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/1517474041 2024-04-01T23:08:40.680947+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/1517474041 2024-04-01T23:08:40.680947+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1353829037 2024-04-01T23:08:40.680947+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/2637331812 2024-04-01T23:18:09.837578+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3347343211 2024-04-01T23:08:14.773907+0000 2024-03-31T23:28:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/99599854 2024-04-01T23:08:40.680947+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/510916434 2024-04-01T23:08:14.773907+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/355558561 2024-04-01T23:08:14.773907+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/3342764964 2024-04-01T23:08:14.773907+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/3342764964 2024-04-01T23:08:14.773907+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3564928943 2024-04-01T23:18:09.837578+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/2338905125 2024-04-01T23:18:09.837578+0000 2024-03-31T23:28:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3890423578 2024-04-01T23:08:40.680947+0000 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:listed 16 entries 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f97ec0a2610 msgr2=0x7f97ec0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f97ec0a2610 0x7f97ec0a4ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9804101700 tx=0x7f97fc005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 msgr2=0x7f98041a3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 0x7f98041a3e80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f97f4004af0 tx=0x7f97f4032550 comp rx=0 tx=0).stop 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 shutdown_connections 2024-03-31T23:28:53.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f97ec0a2610 0x7f97ec0a4ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9804106660 0x7f98041a3e80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9804100f80 0x7f9804199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 --2- 172.21.15.42:0/3634911149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98041005c0 0x7f9804198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:53.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 >> 172.21.15.42:0/3634911149 conn(0x7f9804077750 msgr2=0x7f98040fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:53.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 shutdown_connections 2024-03-31T23:28:53.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:53.790+0000 7f980b807640 1 -- 172.21.15.42:0/3634911149 wait complete. 2024-03-31T23:28:53.801 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-31T23:28:53.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:53.802 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-31T23:28:53.940 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:28:53.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:53.940 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-31T23:28:53.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:53.966 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-31T23:28:54.025 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-31T23:28:54.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:54.026 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-31T23:28:54.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:54.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-31T23:28:54.187 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-31T23:28:54.188 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-31T23:28:54.188 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T23:28:54.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057145,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2906 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/df0871ad1bb83a2a27a170da4833e954884ada3a810e18e5cca3e22b21d0114e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/df0871ad1bb83a2a27a170da4833e954884ada3a810e18e5cca3e22b21d0114e/diff,workdir=/var/lib/containers/storage/overlay/df0871ad1bb83a2a27a170da4833e954884ada3a810e18e5cca3e22b21d0114e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5368958398b09168aa1871b6d898a56592a5ba1cd8ccb38feec761fa2687d513/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/5368958398b09168aa1871b6d898a56592a5ba1cd8ccb38feec761fa2687d513/diff,workdir=/var/lib/containers/storage/overlay/5368958398b09168aa1871b6d898a56592a5ba1cd8ccb38feec761fa2687d513/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/47d01eed4921adccc0d8e726c5d3b3356d71debc943d1196e811b405f7f697ef/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/47d01eed4921adccc0d8e726c5d3b3356d71debc943d1196e811b405f7f697ef/diff,workdir=/var/lib/containers/storage/overlay/47d01eed4921adccc0d8e726c5d3b3356d71debc943d1196e811b405f7f697ef/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ae77e32afd739e40b015a6bc660f6aac87987d28cd583246a4012d5ec01749f9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/ae77e32afd739e40b015a6bc660f6aac87987d28cd583246a4012d5ec01749f9/diff,workdir=/var/lib/containers/storage/overlay/ae77e32afd739e40b015a6bc660f6aac87987d28cd583246a4012d5ec01749f9/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f24ad25f709983b674a6d3979a6a368202559b556a4b23607c93ba2da8ee8634/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/f24ad25f709983b674a6d3979a6a368202559b556a4b23607c93ba2da8ee8634/diff,workdir=/var/lib/containers/storage/overlay/f24ad25f709983b674a6d3979a6a368202559b556a4b23607c93ba2da8ee8634/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/48d4ed6e537866fe2ffaed4172b035cdb461f8505bdc2fd3f26945ddf1635bf6/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/48d4ed6e537866fe2ffaed4172b035cdb461f8505bdc2fd3f26945ddf1635bf6/diff,workdir=/var/lib/containers/storage/overlay/48d4ed6e537866fe2ffaed4172b035cdb461f8505bdc2fd3f26945ddf1635bf6/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/86ce7c84dd0c69533686252a55b5fa26529f58c1665184ccd9c9631e7969936e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/86ce7c84dd0c69533686252a55b5fa26529f58c1665184ccd9c9631e7969936e/diff,workdir=/var/lib/containers/storage/overlay/86ce7c84dd0c69533686252a55b5fa26529f58c1665184ccd9c9631e7969936e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fce62a0b07c52697f24946140aa0eaefdd67057854962990f828d93bb0685269/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/fce62a0b07c52697f24946140aa0eaefdd67057854962990f828d93bb0685269/diff,workdir=/var/lib/containers/storage/overlay/fce62a0b07c52697f24946140aa0eaefdd67057854962990f828d93bb0685269/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5c04a89ecefb2f9e73b7ea44497da963b96c20ac95af8ea55b40fc7e2036593b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/5c04a89ecefb2f9e73b7ea44497da963b96c20ac95af8ea55b40fc7e2036593b/diff,workdir=/var/lib/containers/storage/overlay/5c04a89ecefb2f9e73b7ea44497da963b96c20ac95af8ea55b40fc7e2036593b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ce0c86840739509c881f3f3e14de6ed38b642634cacdab76ff17d1f31f8e5bc9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4G6NLNNIQY63X6YTYHS2PYBQ7E:/var/lib/containers/storage/overlay/l/5HDYSPI7MTSZZONSRX45R3FSYK,upperdir=/var/lib/containers/storage/overlay/ce0c86840739509c881f3f3e14de6ed38b642634cacdab76ff17d1f31f8e5bc9/diff,workdir=/var/lib/containers/storage/overlay/ce0c86840739509c881f3f3e14de6ed38b642634cacdab76ff17d1f31f8e5bc9/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 2024-03-31T23:28:54.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:54.204 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-31T23:28:54.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T23:28:54.261 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-31T23:28:54.330 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-03-31T23:28:54.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:28:54.332 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-31T23:28:54.344 INFO:tasks.cephadm:Teardown begin 2024-03-31T23:28:54.344 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-31T23:28:54.344 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:28:54.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:54 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/4072347791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:28:54.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:54 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2243108895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:28:54.395 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:54 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3634911149' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:28:54.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:54 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/4072347791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:28:54.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:54 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2243108895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:28:54.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:54 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3634911149' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:28:54.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:54 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/4072347791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-31T23:28:54.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:54 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2243108895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-31T23:28:54.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:54 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3634911149' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 -- 172.21.15.42:0/2099257946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 msgr2=0x7f524810d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 --2- 172.21.15.42:0/2099257946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f524810d550 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5240009cd0 tx=0x7f524002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 -- 172.21.15.42:0/2099257946 shutdown_connections 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 --2- 172.21.15.42:0/2099257946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f524810d550 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 --2- 172.21.15.42:0/2099257946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52481006d0 0x7f5248100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 --2- 172.21.15.42:0/2099257946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5248106690 0x7f5248106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 -- 172.21.15.42:0/2099257946 >> 172.21.15.42:0/2099257946 conn(0x7f52480777b0 msgr2=0x7f5248077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 -- 172.21.15.42:0/2099257946 shutdown_connections 2024-03-31T23:28:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.475+0000 7f524e81c640 1 -- 172.21.15.42:0/2099257946 wait complete. 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 Processor -- start 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 -- start start 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52481006d0 0x7f5248198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f5248198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5248106690 0x7f524819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5248111cc0 con 0x7f5248101090 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5248111b40 con 0x7f52481006d0 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524e81c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5248111e40 con 0x7f5248106690 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f5248198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f5248198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50846/0 (socket says 172.21.15.42:50846) 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 -- 172.21.15.42:0/2890846117 learned_addr learned my addr 172.21.15.42:0/2890846117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f5247fff640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52481006d0 0x7f5248198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f524cdb9640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5248106690 0x7f524819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 -- 172.21.15.42:0/2890846117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5248106690 msgr2=0x7f524819c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5248106690 0x7f524819c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 -- 172.21.15.42:0/2890846117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52481006d0 msgr2=0x7f5248198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52481006d0 0x7f5248198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.476+0000 7f52477fe640 1 -- 172.21.15.42:0/2890846117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524819d0f0 con 0x7f5248101090 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.477+0000 7f52477fe640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f5248198640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f523c00ea60 tx=0x7f523c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.477+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c00cde0 con 0x7f5248101090 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.477+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524819d3e0 con 0x7f5248101090 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.477+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f523c0035f0 con 0x7f5248101090 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.477+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c010720 con 0x7f5248101090 2024-03-31T23:28:54.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.477+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52481a4c70 con 0x7f5248101090 2024-03-31T23:28:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.478+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248068990 con 0x7f5248101090 2024-03-31T23:28:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.479+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f523c0037a0 con 0x7f5248101090 2024-03-31T23:28:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.479+0000 7f52457fa640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52300a2610 0x7f52300a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.479+0000 7f5247fff640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52300a2610 0x7f52300a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.480+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f523c0cf250 con 0x7f5248101090 2024-03-31T23:28:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.480+0000 7f5247fff640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52300a2610 0x7f52300a4ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5238009b50 tx=0x7f5238005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:54.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.484+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f523c09bca0 con 0x7f5248101090 2024-03-31T23:28:54.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.707+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52481a4f00 con 0x7f5248101090 2024-03-31T23:28:54.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.707+0000 7f52457fa640 1 -- 172.21.15.42:0/2890846117 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+11923 (secure 0 0 0) 0x7f523c09b5a0 con 0x7f5248101090 2024-03-31T23:28:54.708 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:28:54.708 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:23:53.725307+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":78,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":77,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":77,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":76,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:28:54.709 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 57 2024-03-31T23:28:54.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.709+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52300a2610 msgr2=0x7f52300a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.709+0000 7f524e81c640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52300a2610 0x7f52300a4ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5238009b50 tx=0x7f5238005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:54.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.709+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 msgr2=0x7f5248198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.709+0000 7f524e81c640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f5248198640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f523c00ea60 tx=0x7f523c00ef20 comp rx=0 tx=0).stop 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 shutdown_connections 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5248106690 0x7f524819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f52300a2610 0x7f52300a4ad0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5248101090 0x7f5248198640 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 --2- 172.21.15.42:0/2890846117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52481006d0 0x7f5248198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 >> 172.21.15.42:0/2890846117 conn(0x7f52480777b0 msgr2=0x7f5248102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 shutdown_connections 2024-03-31T23:28:54.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.710+0000 7f524e81c640 1 -- 172.21.15.42:0/2890846117 wait complete. 2024-03-31T23:28:54.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T23:28:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 -- 172.21.15.42:0/3018140553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414100da0 msgr2=0x7f3414101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3018140553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414100da0 0x7f3414101220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3408009900 tx=0x7f340802bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 -- 172.21.15.42:0/3018140553 shutdown_connections 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3018140553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3414101760 0x7f341410d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3018140553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414100da0 0x7f3414101220 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3018140553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34141055e0 0x7f34141059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 -- 172.21.15.42:0/3018140553 >> 172.21.15.42:0/3018140553 conn(0x7f3414076be0 msgr2=0x7f34140fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 -- 172.21.15.42:0/3018140553 shutdown_connections 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 -- 172.21.15.42:0/3018140553 wait complete. 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.864+0000 7f3418bfd640 1 Processor -- start 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 -- start start 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3414100da0 0x7f34141980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 0x7f3414198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34141055e0 0x7f341419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3414111c40 con 0x7f3414101760 2024-03-31T23:28:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3414111ac0 con 0x7f34141055e0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3418bfd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3414111dc0 con 0x7f3414100da0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3411d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 0x7f3414198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3411d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 0x7f3414198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50862/0 (socket says 172.21.15.42:50862) 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3411d9b640 1 -- 172.21.15.42:0/3629727344 learned_addr learned my addr 172.21.15.42:0/3629727344 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34141055e0 0x7f341419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f341259c640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3414100da0 0x7f34141980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 -- 172.21.15.42:0/3629727344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3414100da0 msgr2=0x7f34141980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3414100da0 0x7f34141980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 -- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 msgr2=0x7f3414198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 0x7f3414198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 -- 172.21.15.42:0/3629727344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341419d0d0 con 0x7f34141055e0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3411d9b640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 0x7f3414198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f3412d9d640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34141055e0 0x7f341419c9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f340c009fd0 tx=0x7f340c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.865+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c00ce20 con 0x7f34141055e0 2024-03-31T23:28:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.866+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341419d3c0 con 0x7f34141055e0 2024-03-31T23:28:54.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.866+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f340c004b20 con 0x7f34141055e0 2024-03-31T23:28:54.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.866+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c010790 con 0x7f34141055e0 2024-03-31T23:28:54.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.866+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34141a4c50 con 0x7f34141055e0 2024-03-31T23:28:54.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.866+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3414068990 con 0x7f34141055e0 2024-03-31T23:28:54.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.868+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f340c005020 con 0x7f34141055e0 2024-03-31T23:28:54.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.868+0000 7f34037fe640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f33fc0a2610 0x7f33fc0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:54.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.868+0000 7f341259c640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f33fc0a2610 0x7f33fc0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:54.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.869+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f340c0cf950 con 0x7f34141055e0 2024-03-31T23:28:54.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.869+0000 7f341259c640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f33fc0a2610 0x7f33fc0a4ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3404009b50 tx=0x7f3404005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:54.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:54.872+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f340c09c3a0 con 0x7f34141055e0 2024-03-31T23:28:55.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.093+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f341402d170 con 0x7f34141055e0 2024-03-31T23:28:55.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.094+0000 7f34037fe640 1 -- 172.21.15.42:0/3629727344 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+11923 (secure 0 0 0) 0x7f340c09bca0 con 0x7f34141055e0 2024-03-31T23:28:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:28:55.095 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/957043264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":957043264},{"type":"v1","addr":"172.21.15.42:6835","nonce":957043264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/795209517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":795209517},{"type":"v1","addr":"172.21.15.42:6837","nonce":795209517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-31T23:15:33.212486+0000","modified":"2024-03-31T23:23:53.725307+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24464,"mds_3":24454,"mds_4":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/2174921226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2174921226},{"type":"v1","addr":"172.21.15.42:6839","nonce":2174921226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/1878678856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":1878678856},{"type":"v1","addr":"172.21.15.42:6841","nonce":1878678856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6833/524584837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":524584837},{"type":"v1","addr":"172.21.15.188:6833","nonce":524584837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6833/2977205291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2977205291},{"type":"v1","addr":"172.21.15.94:6833","nonce":2977205291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.94:6835/1301341988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1301341988},{"type":"v1","addr":"172.21.15.94:6835","nonce":1301341988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":78,"addr":"172.21.15.188:6835/2839339934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2839339934},{"type":"v1","addr":"172.21.15.188:6835","nonce":2839339934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":77,"addr":"172.21.15.188:6837/67113861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":67113861},{"type":"v1","addr":"172.21.15.188:6837","nonce":67113861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":77,"addr":"172.21.15.94:6837/2576498268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2576498268},{"type":"v1","addr":"172.21.15.94:6837","nonce":2576498268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":76,"addr":"172.21.15.188:6839/2041061045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":2041061045},{"type":"v1","addr":"172.21.15.188:6839","nonce":2041061045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1375958649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1375958649},{"type":"v1","addr":"172.21.15.94:6839","nonce":1375958649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24442,24454,24464,24472,24497]},"id":1}]} 2024-03-31T23:28:55.095 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 57 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f33fc0a2610 msgr2=0x7f33fc0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f33fc0a2610 0x7f33fc0a4ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3404009b50 tx=0x7f3404005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34141055e0 msgr2=0x7f341419c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34141055e0 0x7f341419c9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f340c009fd0 tx=0x7f340c00ef10 comp rx=0 tx=0).stop 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 shutdown_connections 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34141055e0 0x7f341419c9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f33fc0a2610 0x7f33fc0a4ad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3414101760 0x7f3414198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 --2- 172.21.15.42:0/3629727344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3414100da0 0x7f34141980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 >> 172.21.15.42:0/3629727344 conn(0x7f3414076be0 msgr2=0x7f34141032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:55.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 shutdown_connections 2024-03-31T23:28:55.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.096+0000 7f3418bfd640 1 -- 172.21.15.42:0/3629727344 wait complete. 2024-03-31T23:28:55.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T23:28:55.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 -- 172.21.15.42:0/746369641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 msgr2=0x7f44c8100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 --2- 172.21.15.42:0/746369641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8100a80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009930 tx=0x7f44b802bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 -- 172.21.15.42:0/746369641 shutdown_connections 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 --2- 172.21.15.42:0/746369641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44c8100fc0 0x7f44c810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 --2- 172.21.15.42:0/746369641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8100a80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 --2- 172.21.15.42:0/746369641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c81066a0 0x7f44c8106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 -- 172.21.15.42:0/746369641 >> 172.21.15.42:0/746369641 conn(0x7f44c80769d0 msgr2=0x7f44c8076de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 -- 172.21.15.42:0/746369641 shutdown_connections 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.210+0000 7f44d03f2640 1 -- 172.21.15.42:0/746369641 wait complete. 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 Processor -- start 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 -- start start 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c8100fc0 0x7f44c8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44c81066a0 0x7f44c819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8110ab0 con 0x7f44c8100600 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8110930 con 0x7f44c81066a0 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44d03f2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8110c30 con 0x7f44c8100fc0 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50866/0 (socket says 172.21.15.42:50866) 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 -- 172.21.15.42:0/518675492 learned_addr learned my addr 172.21.15.42:0/518675492 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44cd98d640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c8100fc0 0x7f44c8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce98f640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44c81066a0 0x7f44c819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 -- 172.21.15.42:0/518675492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c8100fc0 msgr2=0x7f44c8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c8100fc0 0x7f44c8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 -- 172.21.15.42:0/518675492 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44c81066a0 msgr2=0x7f44c819c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44c81066a0 0x7f44c819c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44ce18e640 1 -- 172.21.15.42:0/518675492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c819d020 con 0x7f44c8100600 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.211+0000 7f44cd98d640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c8100fc0 0x7f44c8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T23:28:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.212+0000 7f44ce18e640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8198030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f44c400e9c0 tx=0x7f44c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.212+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c400cd80 con 0x7f44c8100600 2024-03-31T23:28:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.212+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44c40035f0 con 0x7f44c8100600 2024-03-31T23:28:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.212+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c819d310 con 0x7f44c8100600 2024-03-31T23:28:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.212+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4010670 con 0x7f44c8100600 2024-03-31T23:28:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.212+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81a4ba0 con 0x7f44c8100600 2024-03-31T23:28:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.213+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c8101d40 con 0x7f44c8100600 2024-03-31T23:28:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.214+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f44c40037a0 con 0x7f44c8100600 2024-03-31T23:28:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.214+0000 7f44bf7fe640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f44b40a2690 0x7f44b40a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.215+0000 7f44cd98d640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f44b40a2690 0x7f44b40a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.215+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7f44c40cf210 con 0x7f44c8100600 2024-03-31T23:28:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.215+0000 7f44cd98d640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f44b40a2690 0x7f44b40a4b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44b8005ab0 tx=0x7f44b8005fd0 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:55.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.219+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f44c409bc60 con 0x7f44c8100600 2024-03-31T23:28:55.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.404+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44c8068990 con 0x7f44c8100600 2024-03-31T23:28:55.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.405+0000 7f44bf7fe640 1 -- 172.21.15.42:0/518675492 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+25247 (secure 0 0 0) 0x7f44c409b560 con 0x7f44c8100600 2024-03-31T23:28:55.406 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-31T23:28:55.407 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":102,"fsid":"5a449cfe-efb3-11ee-b647-cb9ed24678a4","created":"2024-03-31T23:07:44.954200+0000","modified":"2024-03-31T23:28:13.611742+0000","last_up_change":"2024-03-31T23:14:44.846903+0000","last_in_change":"2024-03-31T23:14:24.864430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T23:10:59.033651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T23:15:31.173466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T23:15:32.407121+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-31T23:15:36.393994+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd9af9df-4f3c-49af-aeb6-7e69ae19fe1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6803","nonce":2561562305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6805","nonce":2561562305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6809","nonce":2561562305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2561562305},{"type":"v1","addr":"172.21.15.42:6807","nonce":2561562305}]},"public_addr":"172.21.15.42:6803/2561562305","cluster_addr":"172.21.15.42:6805/2561562305","heartbeat_back_addr":"172.21.15.42:6809/2561562305","heartbeat_front_addr":"172.21.15.42:6807/2561562305","state":["exists","up"]},{"osd":1,"uuid":"7c72d11f-d1e4-429e-b066-1fc0cc75bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6801","nonce":3613405638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6803","nonce":3613405638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6807","nonce":3613405638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3613405638},{"type":"v1","addr":"172.21.15.94:6805","nonce":3613405638}]},"public_addr":"172.21.15.94:6801/3613405638","cluster_addr":"172.21.15.94:6803/3613405638","heartbeat_back_addr":"172.21.15.94:6807/3613405638","heartbeat_front_addr":"172.21.15.94:6805/3613405638","state":["exists","up"]},{"osd":2,"uuid":"35000c1d-43e1-4918-aa28-dac85f3b7802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6801","nonce":3086405523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6803","nonce":3086405523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6807","nonce":3086405523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3086405523},{"type":"v1","addr":"172.21.15.188:6805","nonce":3086405523}]},"public_addr":"172.21.15.188:6801/3086405523","cluster_addr":"172.21.15.188:6803/3086405523","heartbeat_back_addr":"172.21.15.188:6807/3086405523","heartbeat_front_addr":"172.21.15.188:6805/3086405523","state":["exists","up"]},{"osd":3,"uuid":"f930edaa-f275-44f4-ae10-1699013ce78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6811","nonce":3411304012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6813","nonce":3411304012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6817","nonce":3411304012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3411304012},{"type":"v1","addr":"172.21.15.42:6815","nonce":3411304012}]},"public_addr":"172.21.15.42:6811/3411304012","cluster_addr":"172.21.15.42:6813/3411304012","heartbeat_back_addr":"172.21.15.42:6817/3411304012","heartbeat_front_addr":"172.21.15.42:6815/3411304012","state":["exists","up"]},{"osd":4,"uuid":"cf0bfa0c-ff89-4cfa-ae26-a97164273ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6809","nonce":3966467075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6811","nonce":3966467075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6815","nonce":3966467075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3966467075},{"type":"v1","addr":"172.21.15.94:6813","nonce":3966467075}]},"public_addr":"172.21.15.94:6809/3966467075","cluster_addr":"172.21.15.94:6811/3966467075","heartbeat_back_addr":"172.21.15.94:6815/3966467075","heartbeat_front_addr":"172.21.15.94:6813/3966467075","state":["exists","up"]},{"osd":5,"uuid":"0176a668-abe0-43f2-98de-235389566eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6809","nonce":432169288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6811","nonce":432169288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6815","nonce":432169288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":432169288},{"type":"v1","addr":"172.21.15.188:6813","nonce":432169288}]},"public_addr":"172.21.15.188:6809/432169288","cluster_addr":"172.21.15.188:6811/432169288","heartbeat_back_addr":"172.21.15.188:6815/432169288","heartbeat_front_addr":"172.21.15.188:6813/432169288","state":["exists","up"]},{"osd":6,"uuid":"7878060c-9e7e-4383-98be-826d47820b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6819","nonce":2819581932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6821","nonce":2819581932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6825","nonce":2819581932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2819581932},{"type":"v1","addr":"172.21.15.42:6823","nonce":2819581932}]},"public_addr":"172.21.15.42:6819/2819581932","cluster_addr":"172.21.15.42:6821/2819581932","heartbeat_back_addr":"172.21.15.42:6825/2819581932","heartbeat_front_addr":"172.21.15.42:6823/2819581932","state":["exists","up"]},{"osd":7,"uuid":"864a3347-34e1-4a21-96be-9c620c631fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6817","nonce":2551405001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6819","nonce":2551405001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6823","nonce":2551405001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2551405001},{"type":"v1","addr":"172.21.15.94:6821","nonce":2551405001}]},"public_addr":"172.21.15.94:6817/2551405001","cluster_addr":"172.21.15.94:6819/2551405001","heartbeat_back_addr":"172.21.15.94:6823/2551405001","heartbeat_front_addr":"172.21.15.94:6821/2551405001","state":["exists","up"]},{"osd":8,"uuid":"290efe08-cf7f-4cfb-8dcf-c346705f3b7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6817","nonce":1325771974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6819","nonce":1325771974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6823","nonce":1325771974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1325771974},{"type":"v1","addr":"172.21.15.188:6821","nonce":1325771974}]},"public_addr":"172.21.15.188:6817/1325771974","cluster_addr":"172.21.15.188:6819/1325771974","heartbeat_back_addr":"172.21.15.188:6823/1325771974","heartbeat_front_addr":"172.21.15.188:6821/1325771974","state":["exists","up"]},{"osd":9,"uuid":"2b15764c-d0d6-4f5b-89e1-4f1c3b673599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6827","nonce":892645704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6829","nonce":892645704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6833","nonce":892645704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":892645704},{"type":"v1","addr":"172.21.15.42:6831","nonce":892645704}]},"public_addr":"172.21.15.42:6827/892645704","cluster_addr":"172.21.15.42:6829/892645704","heartbeat_back_addr":"172.21.15.42:6833/892645704","heartbeat_front_addr":"172.21.15.42:6831/892645704","state":["exists","up"]},{"osd":10,"uuid":"b06f08e0-c853-4d15-8a08-c35257d23814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6825","nonce":12358886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6827","nonce":12358886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6831","nonce":12358886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":12358886},{"type":"v1","addr":"172.21.15.94:6829","nonce":12358886}]},"public_addr":"172.21.15.94:6825/12358886","cluster_addr":"172.21.15.94:6827/12358886","heartbeat_back_addr":"172.21.15.94:6831/12358886","heartbeat_front_addr":"172.21.15.94:6829/12358886","state":["exists","up"]},{"osd":11,"uuid":"047cc9e9-aff1-433b-b4df-145e31c678c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6825","nonce":3794628957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6827","nonce":3794628957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6831","nonce":3794628957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3794628957},{"type":"v1","addr":"172.21.15.188:6829","nonce":3794628957}]},"public_addr":"172.21.15.188:6825/3794628957","cluster_addr":"172.21.15.188:6827/3794628957","heartbeat_back_addr":"172.21.15.188:6831/3794628957","heartbeat_front_addr":"172.21.15.188:6829/3794628957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:10.650132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:33.877352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:10:57.118338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:21.122270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:11:45.473106+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:10.220877+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:12:35.252325+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:00.146154+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:25.320053+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:13:51.361883+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:17.364620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T23:14:43.453654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1986563449":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/1673984370":"2024-04-01T23:18:09.837578+0000","172.21.15.42:6800/2637331812":"2024-04-01T23:18:09.837578+0000","172.21.15.42:6801/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6800/1517474041":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/1353829037":"2024-04-01T23:08:40.680947+0000","172.21.15.42:6801/2637331812":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/3347343211":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/99599854":"2024-04-01T23:08:40.680947+0000","172.21.15.42:0/510916434":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/355558561":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6800/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:6801/3342764964":"2024-04-01T23:08:14.773907+0000","172.21.15.42:0/3564928943":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/2338905125":"2024-04-01T23:18:09.837578+0000","172.21.15.42:0/3890423578":"2024-04-01T23:08:40.680947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T23:28:55.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.407+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f44b40a2690 msgr2=0x7f44b40a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.407+0000 7f44d03f2640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f44b40a2690 0x7f44b40a4b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44b8005ab0 tx=0x7f44b8005fd0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.407+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 msgr2=0x7f44c8198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.407+0000 7f44d03f2640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8198030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f44c400e9c0 tx=0x7f44c400ee80 comp rx=0 tx=0).stop 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.407+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 shutdown_connections 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44c81066a0 0x7f44c819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c8100fc0 0x7f44c8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f44b40a2690 0x7f44b40a4b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 --2- 172.21.15.42:0/518675492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44c8100600 0x7f44c8198030 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 >> 172.21.15.42:0/518675492 conn(0x7f44c80769d0 msgr2=0x7f44c80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 shutdown_connections 2024-03-31T23:28:55.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.408+0000 7f44d03f2640 1 -- 172.21.15.42:0/518675492 wait complete. 2024-03-31T23:28:55.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-mon[32380]: pgmap v333: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:55.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2890846117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:28:55.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3629727344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:28:55.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-31T23:28:55.421 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mon[36167]: pgmap v333: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:55.421 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2890846117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:28:55.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3629727344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:28:55.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mon[36068]: pgmap v333: 129 pgs: 129 active+clean; 55 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-31T23:28:55.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2890846117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:28:55.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3629727344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-31T23:28:55.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 -- 172.21.15.42:0/598062176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01020a0 msgr2=0x7efcd010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 --2- 172.21.15.42:0/598062176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01020a0 0x7efcd010e5b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009cd0 tx=0x7efcc002c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 -- 172.21.15.42:0/598062176 shutdown_connections 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 --2- 172.21.15.42:0/598062176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01020a0 0x7efcd010e5b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 --2- 172.21.15.42:0/598062176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcd01016e0 0x7efcd0101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 --2- 172.21.15.42:0/598062176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcd01076f0 0x7efcd0107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 -- 172.21.15.42:0/598062176 >> 172.21.15.42:0/598062176 conn(0x7efcd0078b50 msgr2=0x7efcd0078f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 -- 172.21.15.42:0/598062176 shutdown_connections 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 -- 172.21.15.42:0/598062176 wait complete. 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 Processor -- start 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.523+0000 7efcd74f4640 1 -- start start 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 0x7efcd0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcd01020a0 0x7efcd0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcd01076f0 0x7efcd019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0111c20 con 0x7efcd01016e0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0111aa0 con 0x7efcd01076f0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0111da0 con 0x7efcd01020a0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 0x7efcd0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 0x7efcd0198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50880/0 (socket says 172.21.15.42:50880) 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 -- 172.21.15.42:0/3078498012 learned_addr learned my addr 172.21.15.42:0/3078498012 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd4a8f640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcd01020a0 0x7efcd0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5a91640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcd01076f0 0x7efcd019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 -- 172.21.15.42:0/3078498012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcd01020a0 msgr2=0x7efcd0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcd01020a0 0x7efcd0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 -- 172.21.15.42:0/3078498012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcd01076f0 msgr2=0x7efcd019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcd01076f0 0x7efcd019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 -- 172.21.15.42:0/3078498012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd019d010 con 0x7efcd01016e0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd5290640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 0x7efcd0198020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e9f0 tx=0x7efcc800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:55.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc800cd80 con 0x7efcd01016e0 2024-03-31T23:28:55.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd019d300 con 0x7efcd01016e0 2024-03-31T23:28:55.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efcc8005520 con 0x7efcd01016e0 2024-03-31T23:28:55.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.524+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8010690 con 0x7efcd01016e0 2024-03-31T23:28:55.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.525+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd01a4b90 con 0x7efcd01016e0 2024-03-31T23:28:55.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.525+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd0068990 con 0x7efcd01016e0 2024-03-31T23:28:55.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.527+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7efcc80046c0 con 0x7efcd01016e0 2024-03-31T23:28:55.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.528+0000 7efcce7fc640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efcb80a2610 0x7efcb80a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.528+0000 7efcd4a8f640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efcb80a2610 0x7efcb80a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.528+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9496+0+0 (secure 0 0 0) 0x7efcc80cf480 con 0x7efcd01016e0 2024-03-31T23:28:55.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.528+0000 7efcd4a8f640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efcb80a2610 0x7efcb80a4ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcd0105ce0 tx=0x7efcc4005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:55.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.531+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efcc8053280 con 0x7efcd01016e0 2024-03-31T23:28:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.750+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efcd0109c80 con 0x7efcd01016e0 2024-03-31T23:28:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.753+0000 7efcce7fc640 1 -- 172.21.15.42:0/3078498012 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) ==== 161+0+0 (secure 0 0 0) 0x7efcc809bf30 con 0x7efcd01016e0 2024-03-31T23:28:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-31T23:28:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.756+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efcb80a2610 msgr2=0x7efcb80a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.756+0000 7efcd74f4640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efcb80a2610 0x7efcb80a4ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcd0105ce0 tx=0x7efcc4005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.756+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 msgr2=0x7efcd0198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.756+0000 7efcd74f4640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 0x7efcd0198020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e9f0 tx=0x7efcc800edf0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 shutdown_connections 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcd01076f0 0x7efcd019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcd01020a0 0x7efcd0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7efcb80a2610 0x7efcb80a4ad0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 --2- 172.21.15.42:0/3078498012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd01016e0 0x7efcd0198020 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 >> 172.21.15.42:0/3078498012 conn(0x7efcd0078b50 msgr2=0x7efcd0103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 shutdown_connections 2024-03-31T23:28:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.757+0000 7efcd74f4640 1 -- 172.21.15.42:0/3078498012 wait complete. 2024-03-31T23:28:55.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-31T23:28:55.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 -- 172.21.15.42:0/4001664417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c1077a0 msgr2=0x7fad5c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 --2- 172.21.15.42:0/4001664417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c1077a0 0x7fad5c107b80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fad54009930 tx=0x7fad5402bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:55.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 -- 172.21.15.42:0/4001664417 shutdown_connections 2024-03-31T23:28:55.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 --2- 172.21.15.42:0/4001664417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad5c069310 0x7fad5c10e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 --2- 172.21.15.42:0/4001664417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad5c068950 0x7fad5c068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 --2- 172.21.15.42:0/4001664417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c1077a0 0x7fad5c107b80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.878+0000 7fad60bd0640 1 -- 172.21.15.42:0/4001664417 >> 172.21.15.42:0/4001664417 conn(0x7fad5c077750 msgr2=0x7fad5c077b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:55.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 -- 172.21.15.42:0/4001664417 shutdown_connections 2024-03-31T23:28:55.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 -- 172.21.15.42:0/4001664417 wait complete. 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 Processor -- start 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 -- start start 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 0x7fad5c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad5c069310 0x7fad5c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad5c1077a0 0x7fad5c19c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c111c10 con 0x7fad5c068950 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c111a90 con 0x7fad5c1077a0 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.879+0000 7fad60bd0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c111d90 con 0x7fad5c069310 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 0x7fad5c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 0x7fad5c1980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50958/0 (socket says 172.21.15.42:50958) 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 -- 172.21.15.42:0/1743813115 learned_addr learned my addr 172.21.15.42:0/1743813115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 -- 172.21.15.42:0/1743813115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad5c069310 msgr2=0x7fad5c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad5c069310 0x7fad5c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5ad9d640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad5c1077a0 0x7fad5c19c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 -- 172.21.15.42:0/1743813115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad5c1077a0 msgr2=0x7fad5c19c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad5c1077a0 0x7fad5c19c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 -- 172.21.15.42:0/1743813115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5c19d0c0 con 0x7fad5c068950 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad5a59c640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 0x7fad5c1980d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fad54009900 tx=0x7fad5402dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54043020 con 0x7fad5c068950 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5c19d350 con 0x7fad5c068950 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad54004250 con 0x7fad5c068950 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54003b50 con 0x7fad5c068950 2024-03-31T23:28:55.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.880+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5c1a4c40 con 0x7fad5c068950 2024-03-31T23:28:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.881+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5c068540 con 0x7fad5c068950 2024-03-31T23:28:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.882+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fad54046020 con 0x7fad5c068950 2024-03-31T23:28:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.883+0000 7fad4b7fe640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fad440a2610 0x7fad440a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.883+0000 7fad59d9b640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fad440a2610 0x7fad440a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.883+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9838+0+0 (secure 0 0 0) 0x7fad540f1100 con 0x7fad5c068950 2024-03-31T23:28:55.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.883+0000 7fad59d9b640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fad440a2610 0x7fad440a4ad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad50005fd0 tx=0x7fad50005850 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:55.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:55.887+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fad5404d020 con 0x7fad5c068950 2024-03-31T23:28:56.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32376]: 2024-03-31T23:28:55.751+0000 7f0104161700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-31T23:28:56.075 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g[71344]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g[71344]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-mds[71348]: -- 172.21.15.42:0/2969741372 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ffbbfdfa40 con 0x55ffbbfb2c00 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g[71344]: starting mds.g at 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a[71706]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a[71706]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-mds[71710]: -- 172.21.15.42:0/2568897873 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7df409a40 con 0x55f7df3dcc00 2024-03-31T23:28:56.076 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:28:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a[71706]: starting mds.a at 2024-03-31T23:28:56.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.111+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fad5c109c50 con 0x7fad5c068950 2024-03-31T23:28:56.122 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.122 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.122 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mds[66672]: -- 172.21.15.188:0/1609081185 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561393407a40 con 0x5613933da800 2024-03-31T23:28:56.122 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: starting mds.c at 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mds[66979]: -- 172.21.15.188:0/3194199655 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b04b737a40 con 0x55b04b70ac00 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: starting mds.i at 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mds[66358]: -- 172.21.15.188:0/1972974904 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560de6a6e4e0 con 0x560de6a44800 2024-03-31T23:28:56.123 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mds[66358]: -- 172.21.15.188:0/1972974904 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560de6a71a40 con 0x560de6a44800 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: starting mds.f at 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l[66047]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l[66047]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mds[66051]: -- 172.21.15.188:0/1864256241 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562aa3024e0 con 0x5562aa2d9000 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-mds[66051]: -- 172.21.15.188:0/1864256241 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562aa305a40 con 0x5562aa2d9000 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:28:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l[66047]: starting mds.l at 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e[66011]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.124 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e[66011]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.125 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mds[66015]: -- 172.21.15.94:0/1548730289 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5a8a35a40 con 0x55e5a8a09000 2024-03-31T23:28:56.125 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e[66011]: starting mds.e at 2024-03-31T23:28:56.125 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.125 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.125 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mds[66647]: -- 172.21.15.94:0/2633176052 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d15169da40 con 0x55d151671000 2024-03-31T23:28:56.125 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: starting mds.b at 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mds[66325]: -- 172.21.15.94:0/1408537260 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b266dba40 con 0x557b266aec00 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: starting mds.h at 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k[65692]: ignoring --setuser ceph since I am not root 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k[65692]: ignoring --setgroup ceph since I am not root 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-mds[65696]: -- 172.21.15.94:0/871265556 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb30905a40 con 0x55fb308d8c00 2024-03-31T23:28:56.126 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:28:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k[65692]: starting mds.k at 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/518675492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3078498012' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/3078498012' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: osdmap e103: 12 total, 12 up, 12 in 2024-03-31T23:28:56.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-31T23:28:56.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:56 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1743813115' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:28:56.468 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/518675492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3078498012' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/3078498012' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: osdmap e103: 12 total, 12 up, 12 in 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-31T23:28:56.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:56 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1743813115' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:28:56.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/518675492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-31T23:28:56.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3078498012' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-31T23:28:56.575 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-31T23:28:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-31T23:28:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-03-31T23:28:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/3078498012' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-31T23:28:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: osdmap e103: 12 total, 12 up, 12 in 2024-03-31T23:28:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-31T23:28:56.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:56 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1743813115' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-31T23:28:56.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.758+0000 7fad4b7fe640 1 -- 172.21.15.42:0/1743813115 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7fad5403c350 con 0x7fad5c068950 2024-03-31T23:28:56.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.761+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fad440a2610 msgr2=0x7fad440a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fad440a2610 0x7fad440a4ad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad50005fd0 tx=0x7fad50005850 comp rx=0 tx=0).stop 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 msgr2=0x7fad5c1980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 0x7fad5c1980d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fad54009900 tx=0x7fad5402dd40 comp rx=0 tx=0).stop 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 shutdown_connections 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad5c1077a0 0x7fad5c19c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad5c069310 0x7fad5c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fad440a2610 0x7fad440a4ad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 --2- 172.21.15.42:0/1743813115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad5c068950 0x7fad5c1980d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 >> 172.21.15.42:0/1743813115 conn(0x7fad5c077750 msgr2=0x7fad5c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 shutdown_connections 2024-03-31T23:28:56.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.762+0000 7fad60bd0640 1 -- 172.21.15.42:0/1743813115 wait complete. 2024-03-31T23:28:56.779 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/1179910015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 msgr2=0x7fc6b410d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/1179910015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b410d4a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009cd0 tx=0x7fc6ac02c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/1179910015 shutdown_connections 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/1179910015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b410d4a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/1179910015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6b41005d0 0x7fc6b4100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/1179910015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b4106670 0x7fc6b4106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/1179910015 >> 172.21.15.42:0/1179910015 conn(0x7fc6b4077800 msgr2=0x7fc6b4077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/1179910015 shutdown_connections 2024-03-31T23:28:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.891+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/1179910015 wait complete. 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 Processor -- start 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 -- start start 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6b41005d0 0x7fc6b419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b4106670 0x7fc6b419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4110b10 con 0x7fc6b4100f90 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4110990 con 0x7fc6b41005d0 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b8d3e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4110c90 con 0x7fc6b4106670 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50968/0 (socket says 172.21.15.42:50968) 2024-03-31T23:28:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 -- 172.21.15.42:0/2351478677 learned_addr learned my addr 172.21.15.42:0/2351478677 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b259c640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6b41005d0 0x7fc6b419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b2d9d640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b4106670 0x7fc6b419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 -- 172.21.15.42:0/2351478677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b4106670 msgr2=0x7fc6b419ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b4106670 0x7fc6b419ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 -- 172.21.15.42:0/2351478677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6b41005d0 msgr2=0x7fc6b419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6b41005d0 0x7fc6b419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.892+0000 7fc6b1d9b640 1 -- 172.21.15.42:0/2351478677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b419f1a0 con 0x7fc6b4100f90 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.893+0000 7fc6b1d9b640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b419a6f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800d950 tx=0x7fc6a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.893+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8017070 con 0x7fc6b4100f90 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.893+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc6a8009c30 con 0x7fc6b4100f90 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.893+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800f740 con 0x7fc6b4100f90 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.893+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b419f490 con 0x7fc6b4100f90 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.893+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b41a6d20 con 0x7fc6b4100f90 2024-03-31T23:28:56.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.894+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b4068540 con 0x7fc6b4100f90 2024-03-31T23:28:56.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.895+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fc6a8010a80 con 0x7fc6b4100f90 2024-03-31T23:28:56.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.895+0000 7fc6a37fe640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc69c0a2690 0x7fc69c0a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:56.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.895+0000 7fc6b259c640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc69c0a2690 0x7fc69c0a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:56.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.895+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9838+0+0 (secure 0 0 0) 0x7fc6a80ced00 con 0x7fc6b4100f90 2024-03-31T23:28:56.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.896+0000 7fc6b259c640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc69c0a2690 0x7fc69c0a4b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4005fd0 tx=0x7fc6a4005850 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:56.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:56.900+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc6a8009de0 con 0x7fc6b4100f90 2024-03-31T23:28:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.081+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc6b41a7020 con 0x7fc6b4100f90 2024-03-31T23:28:57.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: pgmap v335: 129 pgs: 129 active+clean; 55 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-31T23:28:57.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: Cluster is now healthy 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/1743813115' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.42:6838/1605210922,v1:172.21.15.42:6840/1605210922] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.42:6839/2059789142,v1:172.21.15.42:6841/2059789142] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6833/1300737080,v1:172.21.15.94:6835/1300737080] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6832/995533762,v1:172.21.15.188:6836/995533762] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6838/1571260862,v1:172.21.15.188:6839/1571260862] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6838/3537590665,v1:172.21.15.94:6839/3537590665] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6832/1506230828,v1:172.21.15.94:6834/1506230828] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6834/2316819815,v1:172.21.15.188:6837/2316819815] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.188:6833/1495204675,v1:172.21.15.188:6835/1495204675] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: mds.? [v2:172.21.15.94:6836/1294420568,v1:172.21.15.94:6837/1294420568] up:boot 2024-03-31T23:28:57.423 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: fsmap 12 up:standby 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:28:57.424 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:57 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2351478677' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: pgmap v335: 129 pgs: 129 active+clean; 55 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: Cluster is now healthy 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/1743813115' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.42:6838/1605210922,v1:172.21.15.42:6840/1605210922] up:boot 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.42:6839/2059789142,v1:172.21.15.42:6841/2059789142] up:boot 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6833/1300737080,v1:172.21.15.94:6835/1300737080] up:boot 2024-03-31T23:28:57.469 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6832/995533762,v1:172.21.15.188:6836/995533762] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6838/1571260862,v1:172.21.15.188:6839/1571260862] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6838/3537590665,v1:172.21.15.94:6839/3537590665] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6832/1506230828,v1:172.21.15.94:6834/1506230828] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6834/2316819815,v1:172.21.15.188:6837/2316819815] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.188:6833/1495204675,v1:172.21.15.188:6835/1495204675] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: mds.? [v2:172.21.15.94:6836/1294420568,v1:172.21.15.94:6837/1294420568] up:boot 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: fsmap 12 up:standby 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:28:57.470 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:28:57.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:28:57.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:28:57.471 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:57 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2351478677' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: pgmap v335: 129 pgs: 129 active+clean; 55 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: Cluster is now healthy 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/1743813115' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.42:6838/1605210922,v1:172.21.15.42:6840/1605210922] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.42:6839/2059789142,v1:172.21.15.42:6841/2059789142] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6833/1300737080,v1:172.21.15.94:6835/1300737080] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6832/995533762,v1:172.21.15.188:6836/995533762] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6838/1571260862,v1:172.21.15.188:6839/1571260862] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6838/3537590665,v1:172.21.15.94:6839/3537590665] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6832/1506230828,v1:172.21.15.94:6834/1506230828] up:boot 2024-03-31T23:28:57.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6834/2316819815,v1:172.21.15.188:6837/2316819815] up:boot 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.188:6833/1495204675,v1:172.21.15.188:6835/1495204675] up:boot 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: mds.? [v2:172.21.15.94:6836/1294420568,v1:172.21.15.94:6837/1294420568] up:boot 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: fsmap 12 up:standby 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='mgr.15714 172.21.15.42:0/2092627780' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-31T23:28:57.577 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:57 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2351478677' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:28:57.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.760+0000 7fc6a37fe640 1 -- 172.21.15.42:0/2351478677 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) ==== 181+0+0 (secure 0 0 0) 0x7fc6a809b660 con 0x7fc6b4100f90 2024-03-31T23:28:57.761 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-03-31T23:28:57.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc69c0a2690 msgr2=0x7fc69c0a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc69c0a2690 0x7fc69c0a4b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4005fd0 tx=0x7fc6a4005850 comp rx=0 tx=0).stop 2024-03-31T23:28:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 msgr2=0x7fc6b419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b419a6f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800d950 tx=0x7fc6a800de10 comp rx=0 tx=0).stop 2024-03-31T23:28:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 shutdown_connections 2024-03-31T23:28:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6b4106670 0x7fc6b419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc69c0a2690 0x7fc69c0a4b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b4100f90 0x7fc6b419a6f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 --2- 172.21.15.42:0/2351478677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6b41005d0 0x7fc6b419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 >> 172.21.15.42:0/2351478677 conn(0x7fc6b4077800 msgr2=0x7fc6b40688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 shutdown_connections 2024-03-31T23:28:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.764+0000 7fc6b8d3e640 1 -- 172.21.15.42:0/2351478677 wait complete. 2024-03-31T23:28:57.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-31T23:28:57.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 -- 172.21.15.42:0/1552156216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414101000 msgr2=0x7fc41410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:57.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 --2- 172.21.15.42:0/1552156216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414101000 0x7fc41410d4c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc404009cd0 tx=0x7fc40402c0f0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 -- 172.21.15.42:0/1552156216 shutdown_connections 2024-03-31T23:28:57.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 --2- 172.21.15.42:0/1552156216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414101000 0x7fc41410d4c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 --2- 172.21.15.42:0/1552156216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc414100640 0x7fc414100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 --2- 172.21.15.42:0/1552156216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414106690 0x7fc414106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 -- 172.21.15.42:0/1552156216 >> 172.21.15.42:0/1552156216 conn(0x7fc4140777b0 msgr2=0x7fc414077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 -- 172.21.15.42:0/1552156216 shutdown_connections 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.894+0000 7fc418e9d640 1 -- 172.21.15.42:0/1552156216 wait complete. 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 Processor -- start 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 -- start start 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc414100640 0x7fc41419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414101000 0x7fc41419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 0x7fc41419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc414110b30 con 0x7fc414106690 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141109b0 con 0x7fc414101000 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc418e9d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc414110cb0 con 0x7fc414100640 2024-03-31T23:28:57.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc412d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 0x7fc41419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc412d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 0x7fc41419ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50990/0 (socket says 172.21.15.42:50990) 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc412d9d640 1 -- 172.21.15.42:0/2478350017 learned_addr learned my addr 172.21.15.42:0/2478350017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.895+0000 7fc411d9b640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414101000 0x7fc41419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc41259c640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc414100640 0x7fc41419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc412d9d640 1 -- 172.21.15.42:0/2478350017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc414100640 msgr2=0x7fc41419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc412d9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc414100640 0x7fc41419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc412d9d640 1 -- 172.21.15.42:0/2478350017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414101000 msgr2=0x7fc41419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc412d9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414101000 0x7fc41419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc412d9d640 1 -- 172.21.15.42:0/2478350017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41419f180 con 0x7fc414106690 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc411d9b640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414101000 0x7fc41419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc412d9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 0x7fc41419ea50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc404037040 tx=0x7fc404034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:57.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404039040 con 0x7fc414106690 2024-03-31T23:28:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41419f410 con 0x7fc414106690 2024-03-31T23:28:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc404044070 con 0x7fc414106690 2024-03-31T23:28:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404004710 con 0x7fc414106690 2024-03-31T23:28:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.896+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141a6d00 con 0x7fc414106690 2024-03-31T23:28:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.897+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc414068990 con 0x7fc414106690 2024-03-31T23:28:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.898+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7fc404003970 con 0x7fc414106690 2024-03-31T23:28:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.899+0000 7fc40b7fe640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4000a2610 0x7fc4000a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.899+0000 7fc41259c640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4000a2610 0x7fc4000a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.899+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9342+0+0 (secure 0 0 0) 0x7fc4040f1c70 con 0x7fc414106690 2024-03-31T23:28:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.899+0000 7fc41259c640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4000a2610 0x7fc4000a4ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0058c0 tx=0x7fc40c005850 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:57.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:57.903+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc40403e3a0 con 0x7fc414106690 2024-03-31T23:28:58.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.098+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc4141a6f30 con 0x7fc414106690 2024-03-31T23:28:58.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.765+0000 7fc40b7fe640 1 -- 172.21.15.42:0/2478350017 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7fc4040be8d0 con 0x7fc414106690 2024-03-31T23:28:58.766 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-03-31T23:28:58.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.769+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4000a2610 msgr2=0x7fc4000a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.769+0000 7fc418e9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4000a2610 0x7fc4000a4ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0058c0 tx=0x7fc40c005850 comp rx=0 tx=0).stop 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.769+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 msgr2=0x7fc41419ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.769+0000 7fc418e9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 0x7fc41419ea50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc404037040 tx=0x7fc404034670 comp rx=0 tx=0).stop 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.769+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 shutdown_connections 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7fc4000a2610 0x7fc4000a4ad0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0058c0 tx=0x7fc40c005850 comp rx=0 tx=0).stop 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc414106690 0x7fc41419ea50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc414101000 0x7fc41419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 --2- 172.21.15.42:0/2478350017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc414100640 0x7fc41419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 >> 172.21.15.42:0/2478350017 conn(0x7fc4140777b0 msgr2=0x7fc4140fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 shutdown_connections 2024-03-31T23:28:58.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.770+0000 7fc418e9d640 1 -- 172.21.15.42:0/2478350017 wait complete. 2024-03-31T23:28:58.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-31T23:28:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 -- 172.21.15.42:0/2656836116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b50069dc0 msgr2=0x7f6b5006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 --2- 172.21.15.42:0/2656836116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b50069dc0 0x7f6b5006a220 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009930 tx=0x7f6b4002bc30 comp rx=0 tx=0).stop 2024-03-31T23:28:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 -- 172.21.15.42:0/2656836116 shutdown_connections 2024-03-31T23:28:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 --2- 172.21.15.42:0/2656836116 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b5006a760 0x7f6b5010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 --2- 172.21.15.42:0/2656836116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b50069dc0 0x7f6b5006a220 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 --2- 172.21.15.42:0/2656836116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b501078a0 0x7f6b50107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 -- 172.21.15.42:0/2656836116 >> 172.21.15.42:0/2656836116 conn(0x7f6b500773f0 msgr2=0x7f6b50077800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 -- 172.21.15.42:0/2656836116 shutdown_connections 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.908+0000 7f6b56119640 1 -- 172.21.15.42:0/2656836116 wait complete. 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 Processor -- start 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 -- start start 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b50069dc0 0x7f6b5019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 0x7f6b5019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b501078a0 0x7f6b5019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111ba0 con 0x7f6b5006a760 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111a20 con 0x7f6b501078a0 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b56119640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111d20 con 0x7f6b50069dc0 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b4effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 0x7f6b5019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b4effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 0x7f6b5019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51010/0 (socket says 172.21.15.42:51010) 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b4effd640 1 -- 172.21.15.42:0/296185528 learned_addr learned my addr 172.21.15.42:0/296185528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-31T23:28:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.909+0000 7f6b4ffff640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b501078a0 0x7f6b5019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4f7fe640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b50069dc0 0x7f6b5019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4effd640 1 -- 172.21.15.42:0/296185528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b50069dc0 msgr2=0x7f6b5019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4effd640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b50069dc0 0x7f6b5019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4effd640 1 -- 172.21.15.42:0/296185528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b501078a0 msgr2=0x7f6b5019eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4effd640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b501078a0 0x7f6b5019eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4effd640 1 -- 172.21.15.42:0/296185528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5019f1e0 con 0x7f6b5006a760 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4effd640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 0x7f6b5019a730 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009230 tx=0x7f6b4002dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40043020 con 0x7f6b5006a760 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5019f470 con 0x7f6b5006a760 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b40004250 con 0x7f6b5006a760 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40003ab0 con 0x7f6b5006a760 2024-03-31T23:28:58.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.910+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a6d60 con 0x7f6b5006a760 2024-03-31T23:28:58.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.911+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b50102e00 con 0x7f6b5006a760 2024-03-31T23:28:58.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.912+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 25) ==== 137451+0+0 (secure 0 0 0) 0x7f6b40046020 con 0x7f6b5006a760 2024-03-31T23:28:58.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.913+0000 7f6b4cff9640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6b380a2610 0x7f6b380a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T23:28:58.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.913+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8754+0+0 (secure 0 0 0) 0x7f6b400f0c60 con 0x7f6b5006a760 2024-03-31T23:28:58.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.913+0000 7f6b4f7fe640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6b380a2610 0x7f6b380a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T23:28:58.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.914+0000 7f6b4f7fe640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6b380a2610 0x7f6b380a4ad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009aa0 tx=0x7f6b44005f90 comp rx=0 tx=0).ready entity=mgr.15714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T23:28:58.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:58.919+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6b4004d020 con 0x7f6b5006a760 2024-03-31T23:28:59.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:58 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2351478677' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-31T23:28:59.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:58 smithi042 ceph-mon[32380]: osdmap e104: 12 total, 12 up, 12 in 2024-03-31T23:28:59.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:58 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2478350017' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:28:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.110+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b501a6f90 con 0x7f6b5006a760 2024-03-31T23:28:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:58 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2351478677' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-31T23:28:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:58 smithi094 ceph-mon[36167]: osdmap e104: 12 total, 12 up, 12 in 2024-03-31T23:28:59.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:58 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2478350017' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:28:59.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:58 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2351478677' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-31T23:28:59.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:58 smithi188 ceph-mon[36068]: osdmap e104: 12 total, 12 up, 12 in 2024-03-31T23:28:59.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:58 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2478350017' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:28:59.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.767+0000 7f6b4cff9640 1 -- 172.21.15.42:0/296185528 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v106) ==== 178+0+0 (secure 0 0 0) 0x7f6b4003c350 con 0x7f6b5006a760 2024-03-31T23:28:59.768 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data_ec' removed 2024-03-31T23:28:59.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6b380a2610 msgr2=0x7f6b380a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:59.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6b380a2610 0x7f6b380a4ad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009aa0 tx=0x7f6b44005f90 comp rx=0 tx=0).stop 2024-03-31T23:28:59.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 msgr2=0x7f6b5019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 0x7f6b5019a730 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009230 tx=0x7f6b4002dc90 comp rx=0 tx=0).stop 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 shutdown_connections 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b501078a0 0x7f6b5019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:6800/4058163900,v1:172.21.15.42:6801/4058163900] conn(0x7f6b380a2610 0x7f6b380a4ad0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.770+0000 7f6b56119640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b5006a760 0x7f6b5019a730 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.771+0000 7f6b56119640 1 --2- 172.21.15.42:0/296185528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b50069dc0 0x7f6b5019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.771+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 >> 172.21.15.42:0/296185528 conn(0x7f6b500773f0 msgr2=0x7f6b5010c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.771+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 shutdown_connections 2024-03-31T23:28:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-31T23:28:59.771+0000 7f6b56119640 1 -- 172.21.15.42:0/296185528 wait complete. 2024-03-31T23:28:59.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:28:59.822 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:28:59.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:28:59.888 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-31T23:28:59.888 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-31T23:28:59.904 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-31T23:28:59.920 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-31T23:28:59.944 INFO:tasks.cephadm:Stopping all daemons... 2024-03-31T23:28:59.944 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-31T23:28:59.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a 2024-03-31T23:29:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:59 smithi042 ceph-mon[32380]: pgmap v337: 97 pgs: 97 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:29:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/2478350017' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-03-31T23:29:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:59 smithi042 ceph-mon[32380]: osdmap e105: 12 total, 12 up, 12 in 2024-03-31T23:29:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:59 smithi042 ceph-mon[32380]: from='client.? 172.21.15.42:0/296185528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:29:00.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:28:59 smithi042 systemd[1]: Stopping Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:59 smithi094 ceph-mon[36167]: pgmap v337: 97 pgs: 97 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:29:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/2478350017' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-03-31T23:29:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:59 smithi094 ceph-mon[36167]: osdmap e105: 12 total, 12 up, 12 in 2024-03-31T23:29:00.172 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:28:59 smithi094 ceph-mon[36167]: from='client.? 172.21.15.42:0/296185528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:29:00.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:59 smithi188 ceph-mon[36068]: pgmap v337: 97 pgs: 97 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-03-31T23:29:00.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/2478350017' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-03-31T23:29:00.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:59 smithi188 ceph-mon[36068]: osdmap e105: 12 total, 12 up, 12 in 2024-03-31T23:29:00.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:28:59 smithi188 ceph-mon[36068]: from='client.? 172.21.15.42:0/296185528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-31T23:29:00.507 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:29:00.416+0000 7f1e675fc700 -1 client.15738: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-03-31T23:29:00.507 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:29:00.418+0000 7f1e675fc700 -1 client.15738: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-03-31T23:29:00.508 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32376]: 2024-03-31T23:29:00.251+0000 7f010996c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:00.508 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a[32376]: 2024-03-31T23:29:00.251+0000 7f010996c700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-31T23:29:00.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:00 smithi042 podman[94275]: 2024-03-31 23:29:00.507391256 +0000 UTC m=+0.370646908 container died 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-31T23:29:01.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:00 smithi042 podman[94275]: 2024-03-31 23:29:00.903118902 +0000 UTC m=+0.766374546 container cleanup 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:01.075 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:00 smithi042 bash[94275]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a 2024-03-31T23:29:01.346 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service' 2024-03-31T23:29:01.372 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:01 smithi042 podman[94287]: 2024-03-31 23:29:01.09730675 +0000 UTC m=+0.588091081 container remove 5e468e8e05c627ed1e3ff0e462622b796f164bbc6b42380dc861884347cf38e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-31T23:29:01.372 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:01 smithi042 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-31T23:29:01.372 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:01 smithi042 systemd[1]: Stopped Ceph mon.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:29:01.372 INFO:journalctl@ceph.mon.a.smithi042.stdout:Mar 31 23:29:01 smithi042 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.a.service: Consumed 20.298s CPU time. 2024-03-31T23:29:01.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:01.404 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-31T23:29:01.404 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-31T23:29:01.404 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.b 2024-03-31T23:29:01.714 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:29:01 smithi094 systemd[1]: Stopping Ceph mon.b for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:02.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:29:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-b[36163]: 2024-03-31T23:29:01.710+0000 7f2fa85f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:02.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:29:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-b[36163]: 2024-03-31T23:29:01.710+0000 7f2fa85f3700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-31T23:29:02.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:29:01 smithi094 podman[72140]: 2024-03-31 23:29:01.833423292 +0000 UTC m=+0.238593922 container died 41f61d177940fd171d3f9aed035b745e49aeddb5a763dc7432ec993c685cc85c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-31T23:29:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:29:02 smithi094 podman[72140]: 2024-03-31 23:29:02.211302218 +0000 UTC m=+0.616472873 container cleanup 41f61d177940fd171d3f9aed035b745e49aeddb5a763dc7432ec993c685cc85c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-b, GIT_CLEAN=True, RELEASE=squid-384f31f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:29:02.422 INFO:journalctl@ceph.mon.b.smithi094.stdout:Mar 31 23:29:02 smithi094 bash[72140]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-b 2024-03-31T23:29:02.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.b.service' 2024-03-31T23:29:02.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:02.702 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-31T23:29:02.702 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-31T23:29:02.702 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.c 2024-03-31T23:29:03.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:02 smithi188 systemd[1]: Stopping Ceph mon.c for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:03.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c[36050]: 2024-03-31T23:29:03.074+0000 7fa25ef07700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:03.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c[36050]: 2024-03-31T23:29:03.074+0000 7fa25ef07700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-31T23:29:03.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:03 smithi188 podman[72410]: 2024-03-31 23:29:03.126228177 +0000 UTC m=+0.227465259 container died 50bcb0a98509865fbd70587142d472855478d9e3caaf795cca0848506c6a5729 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-31T23:29:03.718 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:03 smithi188 podman[72410]: 2024-03-31 23:29:03.588842644 +0000 UTC m=+0.690079727 container cleanup 50bcb0a98509865fbd70587142d472855478d9e3caaf795cca0848506c6a5729 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-31T23:29:03.719 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:03 smithi188 bash[72410]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c 2024-03-31T23:29:04.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:03 smithi188 podman[72424]: 2024-03-31 23:29:03.81769954 +0000 UTC m=+0.687583593 container remove 50bcb0a98509865fbd70587142d472855478d9e3caaf795cca0848506c6a5729 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mon-c, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:04.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:04 smithi188 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.c.service: Deactivated successfully. 2024-03-31T23:29:04.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Mar 31 23:29:04 smithi188 systemd[1]: Stopped Ceph mon.c for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:29:04.070 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mon.c.service' 2024-03-31T23:29:04.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:04.120 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-31T23:29:04.120 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-31T23:29:04.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x 2024-03-31T23:29:04.409 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:04 smithi042 systemd[1]: Stopping Ceph mgr.x for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:04.701 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:29:04.408+0000 7f1f02644700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:04.702 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x[32614]: 2024-03-31T23:29:04.408+0000 7f1f02644700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-31T23:29:04.702 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:04 smithi042 podman[94396]: 2024-03-31 23:29:04.439606451 +0000 UTC m=+0.120259582 container died ba3aeb64305d8d4a3ff94bed96b151318a33beab70e1ee97b342b6be30591bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-31T23:29:05.075 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:04 smithi042 podman[94396]: 2024-03-31 23:29:04.79301275 +0000 UTC m=+0.473665859 container cleanup ba3aeb64305d8d4a3ff94bed96b151318a33beab70e1ee97b342b6be30591bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-03-31T23:29:05.076 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:04 smithi042 bash[94396]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x 2024-03-31T23:29:05.446 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Mar 31 23:29:05 smithi042 podman[94408]: 2024-03-31 23:29:05.26215121 +0000 UTC m=+0.823117836 container remove ba3aeb64305d8d4a3ff94bed96b151318a33beab70e1ee97b342b6be30591bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384f31f3d3aee7f8ba3f60846b8844c049165583, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:05.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.x.service' 2024-03-31T23:29:05.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:05.502 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-31T23:29:05.503 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-31T23:29:05.503 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.y 2024-03-31T23:29:05.846 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:29:05 smithi094 systemd[1]: Stopping Ceph mgr.y for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:06.142 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:29:05 smithi094 podman[72261]: 2024-03-31 23:29:05.845777538 +0000 UTC m=+0.156972367 container died 595da78b082b0274fbb7fad47c231138cef1a8cf96c548e8339b332279e68154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-31T23:29:06.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:29:06 smithi094 podman[72261]: 2024-03-31 23:29:06.250342466 +0000 UTC m=+0.561537301 container cleanup 595da78b082b0274fbb7fad47c231138cef1a8cf96c548e8339b332279e68154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y, RELEASE=squid-384f31f, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:06.422 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Mar 31 23:29:06 smithi094 bash[72261]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-y 2024-03-31T23:29:06.668 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.y.service' 2024-03-31T23:29:06.706 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:06.706 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-31T23:29:06.706 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-03-31T23:29:06.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.z 2024-03-31T23:29:07.050 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:06 smithi188 systemd[1]: Stopping Ceph mgr.z for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:07.324 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 podman[72532]: 2024-03-31 23:29:07.050199032 +0000 UTC m=+0.149130083 container died 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:29:07.716 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 podman[72532]: 2024-03-31 23:29:07.48140745 +0000 UTC m=+0.580338490 container cleanup 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:07.716 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 bash[72532]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z 2024-03-31T23:29:07.950 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.z.service' 2024-03-31T23:29:07.968 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 podman[72546]: 2024-03-31 23:29:07.716307964 +0000 UTC m=+0.658069380 container remove 39960ce38a16891c48f96b12dcca75b6e9a700d5a4d1bab1339574290368cd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mgr-z, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:07.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-03-31T23:29:07.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.z.service: Failed with result 'exit-code'. 2024-03-31T23:29:07.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 systemd[1]: Stopped Ceph mgr.z for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:29:07.969 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Mar 31 23:29:07 smithi188 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mgr.z.service: Consumed 20.399s CPU time. 2024-03-31T23:29:07.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:07.987 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-03-31T23:29:07.988 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-31T23:29:07.988 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.0 2024-03-31T23:29:08.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:08 smithi042 systemd[1]: Stopping Ceph osd.0 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:08.575 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0[44792]: 2024-03-31T23:29:08.306+0000 7f1a133c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:08.575 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0[44792]: 2024-03-31T23:29:08.306+0000 7f1a133c6700 -1 osd.0 106 *** Got signal Terminated *** 2024-03-31T23:29:08.575 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0[44792]: 2024-03-31T23:29:08.306+0000 7f1a133c6700 -1 osd.0 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:14.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:13 smithi042 podman[94532]: 2024-03-31 23:29:13.804928353 +0000 UTC m=+5.625187474 container died fdb3b50209b60031ea3b34e956f2e3f86181cbf419e93dbb7d60cce9b8ab518a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-31T23:29:14.435 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 podman[94532]: 2024-03-31 23:29:14.183284581 +0000 UTC m=+6.003543697 container cleanup fdb3b50209b60031ea3b34e956f2e3f86181cbf419e93dbb7d60cce9b8ab518a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0, RELEASE=squid-384f31f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:14.435 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 bash[94532]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0 2024-03-31T23:29:14.754 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 podman[94550]: 2024-03-31 23:29:14.434940323 +0000 UTC m=+0.626721282 container remove fdb3b50209b60031ea3b34e956f2e3f86181cbf419e93dbb7d60cce9b8ab518a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:15.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 podman[94644]: 2024-03-31 23:29:14.657370247 +0000 UTC m=+0.017881691 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:29:15.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 podman[94644]: 2024-03-31 23:29:14.761166342 +0000 UTC m=+0.121677817 container create 95a017b2cf15b6681b26553322397f09beb1293c3450af649e5d33705cc58d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0-deactivate, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-31T23:29:15.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 podman[94644]: 2024-03-31 23:29:14.989112418 +0000 UTC m=+0.349623850 container init 95a017b2cf15b6681b26553322397f09beb1293c3450af649e5d33705cc58d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-31T23:29:15.075 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:14 smithi042 podman[94644]: 2024-03-31 23:29:14.99219469 +0000 UTC m=+0.352706125 container start 95a017b2cf15b6681b26553322397f09beb1293c3450af649e5d33705cc58d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:15.575 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:15 smithi042 podman[94644]: 2024-03-31 23:29:15.080791317 +0000 UTC m=+0.441302754 container attach 95a017b2cf15b6681b26553322397f09beb1293c3450af649e5d33705cc58d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-31T23:29:15.575 INFO:journalctl@ceph.osd.0.smithi042.stdout:Mar 31 23:29:15 smithi042 podman[94644]: 2024-03-31 23:29:15.295121355 +0000 UTC m=+0.655632785 container died 95a017b2cf15b6681b26553322397f09beb1293c3450af649e5d33705cc58d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-03-31T23:29:16.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.0.service' 2024-03-31T23:29:16.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:16.143 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-31T23:29:16.144 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-31T23:29:16.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.1 2024-03-31T23:29:16.458 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:16 smithi094 systemd[1]: Stopping Ceph osd.1 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:16.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1[40749]: 2024-03-31T23:29:16.454+0000 7f9c513cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:16.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1[40749]: 2024-03-31T23:29:16.454+0000 7f9c513cd700 -1 osd.1 106 *** Got signal Terminated *** 2024-03-31T23:29:16.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1[40749]: 2024-03-31T23:29:16.454+0000 7f9c513cd700 -1 osd.1 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:22.298 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:21 smithi094 podman[72385]: 2024-03-31 23:29:21.993892991 +0000 UTC m=+5.657727836 container died b9df366ac9f7f313cea51f92351f9f58d8fdd6211ec1af83c6f9093640ffe6b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-384f31f, ceph=True) 2024-03-31T23:29:22.648 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:22 smithi094 podman[72385]: 2024-03-31 23:29:22.388343805 +0000 UTC m=+6.052178652 container cleanup b9df366ac9f7f313cea51f92351f9f58d8fdd6211ec1af83c6f9093640ffe6b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-31T23:29:22.648 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:22 smithi094 bash[72385]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1 2024-03-31T23:29:22.922 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:22 smithi094 podman[72402]: 2024-03-31 23:29:22.648113173 +0000 UTC m=+0.657127914 container remove b9df366ac9f7f313cea51f92351f9f58d8fdd6211ec1af83c6f9093640ffe6b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-03-31T23:29:23.277 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:22 smithi094 podman[72495]: 2024-03-31 23:29:22.873515814 +0000 UTC m=+0.017584787 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:29:23.277 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:22 smithi094 podman[72495]: 2024-03-31 23:29:22.974093811 +0000 UTC m=+0.118162768 container create f1384fa5b4be0b4d18aa0c112964aa70ff9f25bd98080d8ca65470f8281146c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-384f31f) 2024-03-31T23:29:23.277 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:23 smithi094 podman[72495]: 2024-03-31 23:29:23.277096457 +0000 UTC m=+0.421165414 container init f1384fa5b4be0b4d18aa0c112964aa70ff9f25bd98080d8ca65470f8281146c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-31T23:29:23.570 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:23 smithi094 podman[72495]: 2024-03-31 23:29:23.280515386 +0000 UTC m=+0.424584335 container start f1384fa5b4be0b4d18aa0c112964aa70ff9f25bd98080d8ca65470f8281146c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-31T23:29:23.570 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:23 smithi094 podman[72495]: 2024-03-31 23:29:23.36862357 +0000 UTC m=+0.512692552 container attach f1384fa5b4be0b4d18aa0c112964aa70ff9f25bd98080d8ca65470f8281146c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-31T23:29:23.880 INFO:journalctl@ceph.osd.1.smithi094.stdout:Mar 31 23:29:23 smithi094 podman[72495]: 2024-03-31 23:29:23.570217498 +0000 UTC m=+0.714286458 container died f1384fa5b4be0b4d18aa0c112964aa70ff9f25bd98080d8ca65470f8281146c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-31T23:29:24.218 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.1.service' 2024-03-31T23:29:24.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:24.261 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-31T23:29:24.261 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-31T23:29:24.261 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.2 2024-03-31T23:29:24.651 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:24 smithi188 systemd[1]: Stopping Ceph osd.2 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:24.912 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2[41193]: 2024-03-31T23:29:24.649+0000 7f34e8fd4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:24.912 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2[41193]: 2024-03-31T23:29:24.649+0000 7f34e8fd4700 -1 osd.2 106 *** Got signal Terminated *** 2024-03-31T23:29:24.912 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2[41193]: 2024-03-31T23:29:24.649+0000 7f34e8fd4700 -1 osd.2 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:30.310 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:30 smithi188 podman[72656]: 2024-03-31 23:29:30.016308564 +0000 UTC m=+5.564132825 container died 1c4e54a7ad630c30b174bfac33ab68f22aaf07107fc87d3ad340007cf6e8b15e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.build-date=20240326) 2024-03-31T23:29:30.685 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:30 smithi188 podman[72656]: 2024-03-31 23:29:30.400290522 +0000 UTC m=+5.948114774 container cleanup 1c4e54a7ad630c30b174bfac33ab68f22aaf07107fc87d3ad340007cf6e8b15e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326) 2024-03-31T23:29:30.685 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:30 smithi188 bash[72656]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2 2024-03-31T23:29:30.968 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:30 smithi188 podman[72684]: 2024-03-31 23:29:30.685309836 +0000 UTC m=+0.671815613 container remove 1c4e54a7ad630c30b174bfac33ab68f22aaf07107fc87d3ad340007cf6e8b15e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-03-31T23:29:31.281 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:31 smithi188 podman[72776]: 2024-03-31 23:29:30.920548752 +0000 UTC m=+0.018087658 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:29:31.282 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:31 smithi188 podman[72776]: 2024-03-31 23:29:31.027887948 +0000 UTC m=+0.125426848 container create a7bd1d68ed4dcd5706c0f2dc59a9b2ad7d1f206b3d8b2b0019c7495aa6fa3819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-31T23:29:31.576 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:31 smithi188 podman[72776]: 2024-03-31 23:29:31.281736167 +0000 UTC m=+0.379275095 container init a7bd1d68ed4dcd5706c0f2dc59a9b2ad7d1f206b3d8b2b0019c7495aa6fa3819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2-deactivate, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-31T23:29:31.577 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:31 smithi188 podman[72776]: 2024-03-31 23:29:31.285124592 +0000 UTC m=+0.382663493 container start a7bd1d68ed4dcd5706c0f2dc59a9b2ad7d1f206b3d8b2b0019c7495aa6fa3819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2-deactivate, RELEASE=squid-384f31f, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-31T23:29:31.577 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:31 smithi188 podman[72776]: 2024-03-31 23:29:31.398912017 +0000 UTC m=+0.496450942 container attach a7bd1d68ed4dcd5706c0f2dc59a9b2ad7d1f206b3d8b2b0019c7495aa6fa3819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-384f31f) 2024-03-31T23:29:31.869 INFO:journalctl@ceph.osd.2.smithi188.stdout:Mar 31 23:29:31 smithi188 podman[72776]: 2024-03-31 23:29:31.576372312 +0000 UTC m=+0.673911214 container died a7bd1d68ed4dcd5706c0f2dc59a9b2ad7d1f206b3d8b2b0019c7495aa6fa3819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-31T23:29:32.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.2.service' 2024-03-31T23:29:32.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:32.251 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-31T23:29:32.251 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-31T23:29:32.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.3 2024-03-31T23:29:32.564 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:32 smithi042 systemd[1]: Stopping Ceph osd.3 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:32.825 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:32 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:29:32.563+0000 7f9c04406700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:32.825 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:32 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:29:32.563+0000 7f9c04406700 -1 osd.3 106 *** Got signal Terminated *** 2024-03-31T23:29:32.825 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:32 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:29:32.563+0000 7f9c04406700 -1 osd.3 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:35.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:35 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:35.006+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:36.075 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:35 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:29:35.711+0000 7f9c009fa700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.527638+0000 front 2024-03-31T23:29:11.527583+0000 (oldest deadline 2024-03-31T23:29:35.627878+0000) 2024-03-31T23:29:36.362 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:36 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:36.322+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:36.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:35 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:35.982+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:36.719 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:36.229+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:37.075 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:36 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3[51734]: 2024-03-31T23:29:36.716+0000 7f9c009fa700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.527638+0000 front 2024-03-31T23:29:11.527583+0000 (oldest deadline 2024-03-31T23:29:35.627878+0000) 2024-03-31T23:29:37.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:36 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:36.997+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:37.521 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:37.247+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:37.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:37 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:37.369+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:37.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:37.533+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:37.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:37.520+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:38.264 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:37 smithi042 podman[94750]: 2024-03-31 23:29:37.988367919 +0000 UTC m=+5.540035972 container died b476ef18246584eead8b00df9aeff198c1cadb11ab473dbf91f2c29adab53c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-384f31f, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-31T23:29:38.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:38 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:38.012+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:38.550 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:38.272+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:38.551 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:38.515+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:38.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:38 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:38.355+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:38.575 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:38 smithi042 podman[94750]: 2024-03-31 23:29:38.364180878 +0000 UTC m=+5.915848931 container cleanup b476ef18246584eead8b00df9aeff198c1cadb11ab473dbf91f2c29adab53c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-384f31f, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-31T23:29:38.575 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:38 smithi042 bash[94750]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3 2024-03-31T23:29:38.930 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:38 smithi042 podman[94779]: 2024-03-31 23:29:38.615565443 +0000 UTC m=+0.628753178 container remove b476ef18246584eead8b00df9aeff198c1cadb11ab473dbf91f2c29adab53c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:38.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:38.549+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:39.220 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:38 smithi042 podman[94871]: 2024-03-31 23:29:38.83328657 +0000 UTC m=+0.017734602 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:29:39.245 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:38 smithi042 podman[94871]: 2024-03-31 23:29:38.96700549 +0000 UTC m=+0.151453580 container create 51669c33b592be4ee302f8ad3f68188cb6cc7a53f4b5af53ddd778fbd6c62507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3-deactivate, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux ) 2024-03-31T23:29:39.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:39 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:39.059+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:39.519 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:39 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:39.349+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:39.520 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:39 smithi042 podman[94871]: 2024-03-31 23:29:39.219843121 +0000 UTC m=+0.404291163 container init 51669c33b592be4ee302f8ad3f68188cb6cc7a53f4b5af53ddd778fbd6c62507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-31T23:29:39.520 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:39 smithi042 podman[94871]: 2024-03-31 23:29:39.223399593 +0000 UTC m=+0.407847624 container start 51669c33b592be4ee302f8ad3f68188cb6cc7a53f4b5af53ddd778fbd6c62507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3-deactivate, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-03-31T23:29:39.520 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:39 smithi042 podman[94871]: 2024-03-31 23:29:39.311591241 +0000 UTC m=+0.496039301 container attach 51669c33b592be4ee302f8ad3f68188cb6cc7a53f4b5af53ddd778fbd6c62507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-31T23:29:39.551 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:39.284+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:39.825 INFO:journalctl@ceph.osd.3.smithi042.stdout:Mar 31 23:29:39 smithi042 podman[94871]: 2024-03-31 23:29:39.519673783 +0000 UTC m=+0.704121817 container died 51669c33b592be4ee302f8ad3f68188cb6cc7a53f4b5af53ddd778fbd6c62507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-31T23:29:39.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:39.554+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:39.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:39.551+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:40.156 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.3.service' 2024-03-31T23:29:40.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:40.199 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-31T23:29:40.199 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-31T23:29:40.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.4 2024-03-31T23:29:40.422 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:40 smithi094 systemd[1]: Stopping Ceph osd.4 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:40.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:40 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:40.043+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:40.519 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:40.248+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:40.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:40 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:40.342+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:40.922 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:40 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:29:40.517+0000 7fd5c47cf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:40.922 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:40 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:29:40.517+0000 7fd5c47cf700 -1 osd.4 106 *** Got signal Terminated *** 2024-03-31T23:29:40.922 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:40 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:29:40.517+0000 7fd5c47cf700 -1 osd.4 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:40.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:40.535+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:40.519+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:41.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:41 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:41.070+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:41.550 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:41 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:41.292+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:41.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:41 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:41.345+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:41.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:41 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:41.550+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:41.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:41 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:41.567+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:42.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:42 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:42.044+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:42.567 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:42 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:42.326+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:42.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:42 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:42.319+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:42.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:42 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:42.566+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:42.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:42 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:42.588+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:43.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:43 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:43.150+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:43.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:43 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:43.052+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:43.549 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:43 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:43.291+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:43.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:43 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:43.274+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:43.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:43 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:43.274+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:43.922 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:43 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:29:43.426+0000 7fd5bcdbb700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:17.105745+0000 front 2024-03-31T23:29:17.105724+0000 (oldest deadline 2024-03-31T23:29:43.005863+0000) 2024-03-31T23:29:43.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:43 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:43.579+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:43.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:43 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:43.549+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:43.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:43 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:43.549+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:44.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:44 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:44.051+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:44.326 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:44 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:44.275+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:44.326 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:44 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:44.275+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:44.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:44 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:44.156+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:44.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:44 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:44.048+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:44.552 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:44 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:44.270+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:44.552 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:44 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:44.270+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:44.922 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:44 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:29:44.425+0000 7fd5bcdbb700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:17.105745+0000 front 2024-03-31T23:29:17.105724+0000 (oldest deadline 2024-03-31T23:29:43.005863+0000) 2024-03-31T23:29:44.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:44 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:44.551+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:44.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:44 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:44.593+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:44.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:44 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:44.593+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:45.406 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:45 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:45.180+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:45.407 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:45 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:45.048+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:45.407 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:45 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:45.048+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:45.540 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:45 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:45.258+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:45.541 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:45 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:45.258+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:45.575 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:45 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:45.093+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:45.576 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:45 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:45.324+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:45.576 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:45 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:45.324+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:45.672 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:45 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4[47272]: 2024-03-31T23:29:45.405+0000 7fd5bcdbb700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:17.105745+0000 front 2024-03-31T23:29:17.105724+0000 (oldest deadline 2024-03-31T23:29:43.005863+0000) 2024-03-31T23:29:45.971 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:45 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:45.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:45.971 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:45 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:45.577+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:45.971 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:45 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:45.577+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:46.244 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:45 smithi094 podman[72612]: 2024-03-31 23:29:45.957747207 +0000 UTC m=+5.565181547 container died ddc349100ac88054bd9438ac104739830da719ed7b5d7ff8925efe9736f35e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux ) 2024-03-31T23:29:46.244 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:46 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:46.181+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:46.244 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:46 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:46.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:46.244 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:46 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:46.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:46.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:46 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:46.064+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:46.545 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:46 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:46.232+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:46.545 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:46 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:46.232+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:46.594 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:46 smithi094 podman[72612]: 2024-03-31 23:29:46.342501586 +0000 UTC m=+5.949935926 container cleanup ddc349100ac88054bd9438ac104739830da719ed7b5d7ff8925efe9736f35e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:29:46.594 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:46 smithi094 bash[72612]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4 2024-03-31T23:29:46.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:46 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:46.340+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:46.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:46 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:46.340+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:46.908 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:46 smithi094 podman[72629]: 2024-03-31 23:29:46.594194846 +0000 UTC m=+0.639759935 container remove ddc349100ac88054bd9438ac104739830da719ed7b5d7ff8925efe9736f35e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-31T23:29:46.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:46 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:46.544+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:46.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:46 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:46.547+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:46.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:46 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:46.547+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:47.172 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:46 smithi094 podman[72723]: 2024-03-31 23:29:46.811341963 +0000 UTC m=+0.018167941 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:29:47.172 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:46 smithi094 podman[72723]: 2024-03-31 23:29:46.940392397 +0000 UTC m=+0.147218375 container create a8041012e83acc1f1b9e60c905d0ac39158337f684382286453b82dc65fc0845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4-deactivate, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:29:47.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:47 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:47.012+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:47.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:47 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:47.012+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:47.476 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:47 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:47.226+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:47.476 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:47 smithi094 podman[72723]: 2024-03-31 23:29:47.189049299 +0000 UTC m=+0.395875279 container init a8041012e83acc1f1b9e60c905d0ac39158337f684382286453b82dc65fc0845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-31T23:29:47.476 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:47 smithi094 podman[72723]: 2024-03-31 23:29:47.192041456 +0000 UTC m=+0.398867443 container start a8041012e83acc1f1b9e60c905d0ac39158337f684382286453b82dc65fc0845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4-deactivate, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-31T23:29:47.476 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:47 smithi094 podman[72723]: 2024-03-31 23:29:47.289134127 +0000 UTC m=+0.495960114 container attach a8041012e83acc1f1b9e60c905d0ac39158337f684382286453b82dc65fc0845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-31T23:29:47.507 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:47 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:47.251+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:47.507 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:47 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:47.251+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:47.575 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:47 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:47.081+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:47.576 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:47 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:47.324+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:47.576 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:47 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:47.324+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:47.775 INFO:journalctl@ceph.osd.4.smithi094.stdout:Mar 31 23:29:47 smithi094 podman[72723]: 2024-03-31 23:29:47.47637876 +0000 UTC m=+0.683204750 container died a8041012e83acc1f1b9e60c905d0ac39158337f684382286453b82dc65fc0845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:47.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:47 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:47.554+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:47.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:47 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:47.507+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:47.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:47 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:47.507+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:48.077 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.4.service' 2024-03-31T23:29:48.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:48.119 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-31T23:29:48.119 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-31T23:29:48.119 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.5 2024-03-31T23:29:48.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:48 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:48.271+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:48.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:48 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:48.049+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:48.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:48 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:48.049+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:48.438 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:48 smithi188 systemd[1]: Stopping Ceph osd.5 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:48.438 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:48.208+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:48.438 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:48.208+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:48.575 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:48 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:48.123+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:48.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:48 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:48.348+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:48.576 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:48 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:48.348+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:48.718 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:48.595+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:48.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:48.488+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:48.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:48.488+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:48.719 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:48.437+0000 7fa03683c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:48.719 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:48.437+0000 7fa03683c700 -1 osd.5 106 *** Got signal Terminated *** 2024-03-31T23:29:48.719 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:48 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:48.437+0000 7fa03683c700 -1 osd.5 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:49.390 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:49 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:49.085+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:49.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:49 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:49.251+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:49.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:49 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:49.007+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:49.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:49 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:49.007+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:49.554 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:49.244+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:49.554 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:49.244+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:49.554 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:49.487+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:49.554 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:49.487+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:49.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:49 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:49.390+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:49.827 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:49 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:49.390+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:49.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:49 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:49.554+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:50.295 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:50.007+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:50.295 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:50.007+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:50.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:50 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:50.058+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:50.470 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:50.449+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:50.470 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:50.449+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:50.471 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:50.210+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:50.471 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:50.210+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:50.471 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:50.210+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.894514+0000 front 2024-03-31T23:29:27.894633+0000 (oldest deadline 2024-03-31T23:29:50.194723+0000) 2024-03-31T23:29:50.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:50.294+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:50.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:50 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:50.389+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:50.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:50 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:50.389+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:50.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:50 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:50.532+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:51.311 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:50.973+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:51.311 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:50 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:50.973+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:51.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:51.061+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:51.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:51.061+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:51.464 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:51.172+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:51.464 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:51.172+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:51.464 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:51.172+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.894514+0000 front 2024-03-31T23:29:27.894633+0000 (oldest deadline 2024-03-31T23:29:50.194723+0000) 2024-03-31T23:29:51.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:51.310+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:51.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:51.310+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:51.718 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:51.556+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:51.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:51.462+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:51.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:51 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:51.462+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:51.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:51.412+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:51.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:51.412+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:52.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:51.992+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:52.316 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:51.992+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:52.316 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:51 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:51.992+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:52.414 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:52.154+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:52.415 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:52.154+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:52.415 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:52.154+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.894514+0000 front 2024-03-31T23:29:27.894633+0000 (oldest deadline 2024-03-31T23:29:50.194723+0000) 2024-03-31T23:29:52.460 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:52 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:52.096+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:52.460 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:52 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:52.096+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:52.586 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:52.315+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:52.586 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:52.315+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:52.718 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:52.523+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:52.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:52.413+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:52.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:52.413+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:52.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:52 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:52.413+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:52.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:52 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:52.460+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:52.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:52 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:52.460+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:52.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:52 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:52.460+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:53.286 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:52.998+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:53.286 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:52.998+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:53.287 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:52 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:52.998+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:53.459 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:53.160+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.092204+0000 front 2024-03-31T23:29:12.092240+0000 (oldest deadline 2024-03-31T23:29:36.192265+0000) 2024-03-31T23:29:53.459 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:53.160+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.693556+0000 front 2024-03-31T23:29:19.693543+0000 (oldest deadline 2024-03-31T23:29:43.793546+0000) 2024-03-31T23:29:53.460 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5[48162]: 2024-03-31T23:29:53.160+0000 7fa032e30700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.894514+0000 front 2024-03-31T23:29:27.894633+0000 (oldest deadline 2024-03-31T23:29:50.194723+0000) 2024-03-31T23:29:53.501 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:53 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:53.110+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:53.501 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:53 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:53.110+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:53.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:53 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:53.285+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:53.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:53 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:53.285+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:53.718 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:53.458+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:53.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:53.458+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:53.719 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:53.458+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:53.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:53.524+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:53.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:53 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:53.524+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:53.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:53 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:53.501+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:53.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:53 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:53.501+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:53.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:53 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:53.501+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:54.106 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:53 smithi188 podman[72881]: 2024-03-31 23:29:53.828073923 +0000 UTC m=+5.514715225 container died d647c5b8d56ccfefa079146bbc84625f2f819691703d479d517f8bef8edbdc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-384f31f) 2024-03-31T23:29:54.334 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:54.006+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:54.334 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:54.006+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:54.334 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:54.006+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:54.469 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:54 smithi188 podman[72881]: 2024-03-31 23:29:54.205097488 +0000 UTC m=+5.891738790 container cleanup d647c5b8d56ccfefa079146bbc84625f2f819691703d479d517f8bef8edbdc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-31T23:29:54.469 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:54 smithi188 bash[72881]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5 2024-03-31T23:29:54.470 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:54 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:54.129+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:54.470 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:54 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:54.129+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:54.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:54.333+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:54.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:54 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:54.333+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:54.798 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:54 smithi188 podman[72898]: 2024-03-31 23:29:54.488329888 +0000 UTC m=+0.658305993 container remove d647c5b8d56ccfefa079146bbc84625f2f819691703d479d517f8bef8edbdc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-31T23:29:54.799 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:54.484+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:54.799 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:54.484+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:54.799 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:54.484+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:54.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:54.520+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:54.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:54 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:54.520+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:54.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:54 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:54.470+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:54.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:54 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:54.470+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:54.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:54 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:54.470+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:55.093 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:54 smithi188 podman[72990]: 2024-03-31 23:29:54.701339596 +0000 UTC m=+0.018176062 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:29:55.093 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:54 smithi188 podman[72990]: 2024-03-31 23:29:54.840831934 +0000 UTC m=+0.157668408 container create ea9446ccda9348df9216b9d2439b2fc5fe75830c719ff82f623a80195d1edc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-31T23:29:55.347 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:55.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:55.347 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:55.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:55.347 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:55.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:55.382 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:55 smithi188 podman[72990]: 2024-03-31 23:29:55.093576194 +0000 UTC m=+0.410412658 container init ea9446ccda9348df9216b9d2439b2fc5fe75830c719ff82f623a80195d1edc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-31T23:29:55.382 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:55 smithi188 podman[72990]: 2024-03-31 23:29:55.09678557 +0000 UTC m=+0.413622016 container start ea9446ccda9348df9216b9d2439b2fc5fe75830c719ff82f623a80195d1edc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:29:55.382 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:55 smithi188 podman[72990]: 2024-03-31 23:29:55.185161439 +0000 UTC m=+0.501997910 container attach ea9446ccda9348df9216b9d2439b2fc5fe75830c719ff82f623a80195d1edc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:29:55.501 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:55.158+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:55.501 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:55.158+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:55.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:55.346+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:55.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:55.346+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:55.688 INFO:journalctl@ceph.osd.5.smithi188.stdout:Mar 31 23:29:55 smithi188 podman[72990]: 2024-03-31 23:29:55.382154057 +0000 UTC m=+0.698990521 container died ea9446ccda9348df9216b9d2439b2fc5fe75830c719ff82f623a80195d1edc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:29:55.689 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:55.462+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:55.689 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:55.462+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:55.689 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:55.462+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:55.689 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:55.514+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:55.689 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:55 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:55.514+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:55.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:55.501+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:55.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:55.501+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:55.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:55 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:55.501+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:56.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.5.service' 2024-03-31T23:29:56.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:29:56.074 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-31T23:29:56.074 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-31T23:29:56.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.6 2024-03-31T23:29:56.319 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:55.979+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:56.319 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:55.979+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:56.319 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:55 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:55.979+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:56.353 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:56 smithi042 systemd[1]: Stopping Ceph osd.6 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:29:56.353 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:56.138+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:56.353 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:56.138+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:56.353 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:56.351+0000 7fd59be17700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:29:56.353 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:56.351+0000 7fd59be17700 -1 osd.6 106 *** Got signal Terminated *** 2024-03-31T23:29:56.353 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:56.351+0000 7fd59be17700 -1 osd.6 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:29:56.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:56.318+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:56.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:56.318+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:56.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:56.463+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:56.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:56.463+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:56.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:56.463+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:56.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:56 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:56.545+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:56.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:56 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:56.545+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:56.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:56 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:56.479+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:56.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:56 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:56.479+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:56.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:56 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:56.479+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:57.326 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:56.958+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:57.326 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:56.958+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:57.326 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:56 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:56.958+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:57.463 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:57.127+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:57.464 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:57.127+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:57.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:57 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:57.325+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:57.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:57 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:57.325+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:57.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:57.463+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:57.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:57.463+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:57.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:57 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:57.463+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:57.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:57.544+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:57.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:57.544+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:57.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:57.487+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:57.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:57.487+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:57.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:57 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:57.487+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:58.289 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:57 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:57.932+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:58.289 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:57 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:57.932+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:58.290 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:57 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:57.932+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:58.500 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:58 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:58.124+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:58.500 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:58 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:58.124+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:58.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:58 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:58.288+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:58.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:58 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:58.288+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:58.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:58 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:58.499+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:58.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:58 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:58.499+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:58.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:58 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:58.499+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:58.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:58 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:58.533+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:58.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:58 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:58.533+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:58.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:58 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:58.493+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:58.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:58 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:58.493+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:58.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:58 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:58.493+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:59.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:58 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:58.898+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:29:59.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:58 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:58.898+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:29:59.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:58 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:58.898+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:29:59.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:58 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:58.898+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:29:59.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:59.074+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:29:59.326 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:29:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:29:59.074+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:29:59.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:59.246+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:29:59.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:59.246+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:29:59.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:29:59.246+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:29:59.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:59.541+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:29:59.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:59.541+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:29:59.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:59.541+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:29:59.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:29:59 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:29:59.541+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:29:59.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:59 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:59.542+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:29:59.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:59 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:59.542+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:29:59.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:29:59 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:29:59.542+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:29:59.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:59 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:59.522+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:29:59.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:59 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:59.522+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:29:59.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:29:59 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:29:59.522+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:00.214 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:59.944+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:00.214 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:59.944+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:00.214 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:59.944+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:00.214 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:29:59 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:29:59.944+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:00.538 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:30:00.117+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:30:00.539 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:30:00.117+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:30:00.539 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:30:00.117+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.208862+0000 front 2024-03-31T23:29:35.208962+0000 (oldest deadline 2024-03-31T23:29:59.909052+0000) 2024-03-31T23:30:00.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:00.213+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:00.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:00.213+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:00.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:00.213+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:00.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:00.538+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:00.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:00.538+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:00.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:00.538+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:00.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:00 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:00.538+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:00.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:00 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:00.588+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:00.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:00 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:00.588+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:00.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:00 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:00.588+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:00.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:00 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:00.525+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:00.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:00 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:00.525+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:00.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:00 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:00.525+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:01.248 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:00.947+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:01.248 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:00.947+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:01.248 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:00.947+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:01.248 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:00.947+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:01.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:30:01.072+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.104362+0000 front 2024-03-31T23:29:19.104478+0000 (oldest deadline 2024-03-31T23:29:43.204434+0000) 2024-03-31T23:30:01.325 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:30:01.072+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.107142+0000 front 2024-03-31T23:29:27.107247+0000 (oldest deadline 2024-03-31T23:29:50.607206+0000) 2024-03-31T23:30:01.326 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6[58285]: 2024-03-31T23:30:01.072+0000 7fd59840b700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.208862+0000 front 2024-03-31T23:29:35.208962+0000 (oldest deadline 2024-03-31T23:29:59.909052+0000) 2024-03-31T23:30:01.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:01.247+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:01.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:01.247+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:01.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:01.247+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:01.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:01 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:01.546+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:01.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:01 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:01.546+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:01.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:01 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:01.546+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:01.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:01 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:01.558+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:01.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:01 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:01.558+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:01.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:01 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:01.558+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:01.987 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:01 smithi042 podman[94977]: 2024-03-31 23:30:01.698573238 +0000 UTC m=+5.426223925 container died 6249b426b7082cecb75249e2757524d98fdb4468b1fd2ef468292f5e22dd2736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-31T23:30:01.988 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:01.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:01.988 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:01.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:01.988 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:01.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:01.988 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:01 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:01.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:02.245 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 podman[94977]: 2024-03-31 23:30:02.077766006 +0000 UTC m=+5.805416678 container cleanup 6249b426b7082cecb75249e2757524d98fdb4468b1fd2ef468292f5e22dd2736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:02.246 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 bash[94977]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6 2024-03-31T23:30:02.293 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:01.922+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:02.293 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:01.922+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:02.293 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:01.922+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:02.293 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:01 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:01.922+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:02.575 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 podman[94997]: 2024-03-31 23:30:02.245809772 +0000 UTC m=+0.545244873 container remove 6249b426b7082cecb75249e2757524d98fdb4468b1fd2ef468292f5e22dd2736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5) 2024-03-31T23:30:02.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:02.292+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:02.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:02.292+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:02.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:02.292+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:02.875 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 podman[95086]: 2024-03-31 23:30:02.592439245 +0000 UTC m=+0.017345874 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:30:02.875 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 podman[95086]: 2024-03-31 23:30:02.721833204 +0000 UTC m=+0.146739860 container create 39a30fc7a5e41cdda75de55efcda3cc4d77c74d1ae07a6daf76e5cca0d7001da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:30:02.875 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:02.623+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:02.875 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:02.623+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:02.875 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:02.623+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:02.875 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:02 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:02.623+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:02.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:02.580+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:02.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:02.580+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:02.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:02.580+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:02.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:02.515+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:02.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:02.515+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:02.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:02.515+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:02.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:02 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:02.515+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:03.240 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 podman[95086]: 2024-03-31 23:30:02.941308439 +0000 UTC m=+0.366215058 container init 39a30fc7a5e41cdda75de55efcda3cc4d77c74d1ae07a6daf76e5cca0d7001da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-31T23:30:03.240 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:02 smithi042 podman[95086]: 2024-03-31 23:30:02.944962693 +0000 UTC m=+0.369869317 container start 39a30fc7a5e41cdda75de55efcda3cc4d77c74d1ae07a6daf76e5cca0d7001da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:30:03.240 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:03 smithi042 podman[95086]: 2024-03-31 23:30:03.033009546 +0000 UTC m=+0.457916183 container attach 39a30fc7a5e41cdda75de55efcda3cc4d77c74d1ae07a6daf76e5cca0d7001da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-31T23:30:03.245 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:02.943+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:03.245 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:02.943+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:03.245 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:02.943+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:03.245 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:02 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:02.943+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:03.544 INFO:journalctl@ceph.osd.6.smithi042.stdout:Mar 31 23:30:03 smithi042 podman[95086]: 2024-03-31 23:30:03.240252561 +0000 UTC m=+0.665159176 container died 39a30fc7a5e41cdda75de55efcda3cc4d77c74d1ae07a6daf76e5cca0d7001da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f) 2024-03-31T23:30:03.576 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:03.245+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:03.576 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:03.245+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:03.576 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:03.245+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:03.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:03.607+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:03.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:03.607+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:03.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:03.607+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:03.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:03 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:03.607+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:03.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.6.service' 2024-03-31T23:30:03.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:03.913 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-31T23:30:03.913 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-31T23:30:03.913 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.7 2024-03-31T23:30:03.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:03.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:03.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:03.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:03.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:03.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:03.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:03.538+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:03.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:03.538+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:03.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:03.538+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:03.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:03 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:03.538+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:04.172 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:03 smithi094 systemd[1]: Stopping Ceph osd.7 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:04.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:03.913+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:04.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:03.913+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:04.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:03.913+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:04.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:03 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:03.913+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:04.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:04.237+0000 7f38cba26700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:04.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:04.237+0000 7f38cba26700 -1 osd.7 106 *** Got signal Terminated *** 2024-03-31T23:30:04.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:04.237+0000 7f38cba26700 -1 osd.7 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:30:04.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:04.239+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:04.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:04.239+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:04.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:04.239+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:04.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:04.557+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:04.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:04.557+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:04.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:04.557+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:04.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:04 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:04.557+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:04.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:04.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:04.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:04.552+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:04.552+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:04.552+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:04.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:04 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:04.552+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:05.197 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:04.935+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:05.197 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:04.935+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:05.197 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:04.935+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:05.197 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:04 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:04.935+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:05.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:05.196+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:05.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:05.196+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:05.672 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:05.196+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:05.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:05.551+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:05.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:05.551+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:05.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:05.551+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:05.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:05 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:05.551+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:05.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:05.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:05.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:05.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:05.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:05.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:05.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:05.599+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:05.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:05.599+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:05.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:05.599+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:05.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:05 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:05.599+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:06.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:06.176+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:06.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:06.176+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:06.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:06.176+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:06.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:05.950+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:06.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:05.950+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:06.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:05.950+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:06.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:05.950+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:06.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:06.567+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:06.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:06.567+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:06.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:06.567+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:06.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:06 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:06.567+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:06.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:06.558+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:06.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:06.558+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:06.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:06.558+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:06.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:06.604+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:06.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:06.604+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:06.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:06.604+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:06.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:06 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:06.604+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:07.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:07.127+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:07.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:07.127+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:07.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:07.127+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:07.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:06.941+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:07.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:06.941+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:07.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:06.941+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:07.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:06.941+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:07.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:06 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:06.941+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:07.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:07.529+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:07.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:07.529+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:07.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:07.529+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:07.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:07 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:07.529+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:07.539+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:07.539+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:07.539+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:07.630+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:07.630+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:07.630+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:07.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:07 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:07.630+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:08.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:08.151+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:08.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:08.151+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:08.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:08.151+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:08.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:07.972+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:08.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:07.972+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:08.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:07.972+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:08.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:07.972+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:08.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:07 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:07.972+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:08.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:08.574+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:08.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:08.574+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:08.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:08.574+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:08.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:08 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:08.574+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:08.554+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:08.554+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:08.554+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:08.671+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:08.671+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:08.671+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:08.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:08 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:08.671+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:09.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:09.173+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:18.176819+0000 front 2024-03-31T23:29:18.177233+0000 (oldest deadline 2024-03-31T23:29:42.277071+0000) 2024-03-31T23:30:09.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:09.173+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:25.778406+0000 front 2024-03-31T23:29:25.778394+0000 (oldest deadline 2024-03-31T23:29:50.478233+0000) 2024-03-31T23:30:09.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:09.173+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.180162+0000 front 2024-03-31T23:29:36.180248+0000 (oldest deadline 2024-03-31T23:29:59.080224+0000) 2024-03-31T23:30:09.422 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7[53897]: 2024-03-31T23:30:09.173+0000 7f38c4012700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.981101+0000 front 2024-03-31T23:29:44.981146+0000 (oldest deadline 2024-03-31T23:30:09.081412+0000) 2024-03-31T23:30:09.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:08.976+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:09.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:08.976+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:09.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:08.976+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:09.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:08.976+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:09.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:08 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:08.976+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:09.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:09.547+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:09.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:09.547+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:09.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:09.547+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:09.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:09 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:09.547+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:09.896 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 podman[72842]: 2024-03-31 23:30:09.622164329 +0000 UTC m=+5.507836650 container died a4397c9fb45b0cae6d174b3485177f8f80289988715ae4f6d146a55017090382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:09.679+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:09.679+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:09.679+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:09.679+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:09.593+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:09.593+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:09.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:09.593+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:09.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:09 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:09.593+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:10.172 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 podman[72842]: 2024-03-31 23:30:09.995778289 +0000 UTC m=+5.881450627 container cleanup a4397c9fb45b0cae6d174b3485177f8f80289988715ae4f6d146a55017090382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-384f31f) 2024-03-31T23:30:10.172 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:09 smithi094 bash[72842]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7 2024-03-31T23:30:10.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:10 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.011+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:10.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:10 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.011+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:10.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:10 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.011+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:10.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:10 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.011+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:10.173 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:10 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.011+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:10.604 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:10 smithi094 podman[72859]: 2024-03-31 23:30:10.280097104 +0000 UTC m=+0.648403886 container remove a4397c9fb45b0cae6d174b3485177f8f80289988715ae4f6d146a55017090382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f) 2024-03-31T23:30:10.917 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:10 smithi094 podman[72948]: 2024-03-31 23:30:10.507141005 +0000 UTC m=+0.018310750 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:30:10.917 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:10 smithi094 podman[72948]: 2024-03-31 23:30:10.622786316 +0000 UTC m=+0.133956055 container create ed8154fe8ceb2713b098680feb4788da3cefcceabab5842f29a73d33e79aca20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:10.917 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:10 smithi094 podman[72948]: 2024-03-31 23:30:10.842268163 +0000 UTC m=+0.353437913 container init ed8154fe8ceb2713b098680feb4788da3cefcceabab5842f29a73d33e79aca20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:10.917 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:10 smithi094 podman[72948]: 2024-03-31 23:30:10.845502048 +0000 UTC m=+0.356671780 container start ed8154fe8ceb2713b098680feb4788da3cefcceabab5842f29a73d33e79aca20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0) 2024-03-31T23:30:10.918 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:10 smithi094 podman[72948]: 2024-03-31 23:30:10.917116098 +0000 UTC m=+0.428285851 container attach ed8154fe8ceb2713b098680feb4788da3cefcceabab5842f29a73d33e79aca20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:10.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:10.653+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:10.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:10.653+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:10.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:10.653+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:10.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:10.653+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:10.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:10.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:10.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:10.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:10.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:10.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:10.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:10 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:10.563+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:11.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:10.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:11.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:10.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:11.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:10.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:11.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:10.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:11.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:10 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:10.579+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:11.172 INFO:journalctl@ceph.osd.7.smithi094.stdout:Mar 31 23:30:11 smithi094 podman[72948]: 2024-03-31 23:30:11.130694982 +0000 UTC m=+0.641864726 container died ed8154fe8ceb2713b098680feb4788da3cefcceabab5842f29a73d33e79aca20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-03-31T23:30:11.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:11 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.999+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:11.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:11 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.999+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:11.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:11 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.999+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:11.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:11 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.999+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:11.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:11 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:10.999+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:11.794 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.7.service' 2024-03-31T23:30:11.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:11.836 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-31T23:30:11.836 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-03-31T23:30:11.836 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.8 2024-03-31T23:30:11.866 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:11.635+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:11.866 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:11.635+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:11.866 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:11.635+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:11.866 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:11.635+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:11.867 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:11.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:11.867 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:11.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:11.867 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:11.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:11.867 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:11 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:11.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:12.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:11.584+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:12.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:11.584+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:12.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:11.584+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:12.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:11.584+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:12.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:11 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:11.584+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:12.141 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:11 smithi188 systemd[1]: Stopping Ceph osd.8 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:12.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:12.028+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:12.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:12.028+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:12.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:12.028+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:12.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:12.028+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:12.172 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:12.028+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:12.469 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.139+0000 7f7ef3b05700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:12.469 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.139+0000 7f7ef3b05700 -1 osd.8 106 *** Got signal Terminated *** 2024-03-31T23:30:12.469 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.139+0000 7f7ef3b05700 -1 osd.8 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.644+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.644+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.644+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:12.644+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:12.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:12.505+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:12.505+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:12.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:12 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:12.505+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:13.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:12.615+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:13.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:12.615+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:13.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:12.615+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:13.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:12.615+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:13.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:12 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:12.615+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:13.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:13.053+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:13.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:13.053+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:13.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:13.053+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:13.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:13.053+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:13.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:13 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:13.053+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:13.608+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:13.608+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:13.608+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:13.608+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:13.496+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:13.496+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:13.496+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:13.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:13 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:13.496+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:14.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:13.613+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:14.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:13.613+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:14.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:13.613+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:14.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:13.613+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:14.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:13 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:13.613+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:14.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:14 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:14.029+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:14.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:14 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:14.029+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:14.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:14 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:14.029+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:14.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:14 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:14.029+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:14.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:14 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:14.029+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:14.589+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:14.589+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:14.589+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:14.589+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:14.518+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:14.518+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:14.518+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:14.518+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:14.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:14 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:14.518+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:15.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:14.595+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:15.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:14.595+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:15.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:14.595+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:15.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:14.595+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:15.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:14 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:14.595+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:15.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:15 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:15.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:15.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:15 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:15.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:15.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:15 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:15.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:15.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:15 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:15.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:15.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:15 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:15.026+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:15.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:15.595+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:15.595+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:15.595+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:15.595+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:15.550+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:15.550+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:15.550+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:15.550+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:15.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:15 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:15.550+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:16.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:15 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:15.577+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:16.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:15 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:15.577+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:16.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:15 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:15.577+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:16.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:15 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:15.577+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:16.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:15 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:15.577+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:16.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:16.042+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:16.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:16.042+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:16.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:16.042+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:16.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:16.042+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:16.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:16 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:16.042+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:16.968 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:16.549+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:07.831575+0000 front 2024-03-31T23:29:07.831427+0000 (oldest deadline 2024-03-31T23:29:36.631869+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:16.549+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:20.132758+0000 front 2024-03-31T23:29:20.132707+0000 (oldest deadline 2024-03-31T23:29:43.032795+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:16.549+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.034219+0000 front 2024-03-31T23:29:27.034283+0000 (oldest deadline 2024-03-31T23:29:52.334363+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8[54715]: 2024-03-31T23:30:16.549+0000 7f7ef00f9700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.835395+0000 front 2024-03-31T23:29:35.835297+0000 (oldest deadline 2024-03-31T23:30:01.735262+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:16.531+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:16.531+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:16.531+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:16.531+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:16.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:16 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:16.531+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:17.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:16.598+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:17.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:16.598+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:17.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:16.598+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:17.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:16.598+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:17.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:16.598+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:17.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:16 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:16.598+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:17.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:17.087+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:17.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:17.087+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:17.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:17.087+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:17.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:17.087+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:17.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:17 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:17.087+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:17.825 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:17 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:17.582+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:17.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:17 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:17.582+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:17.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:17 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:17.582+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:17.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:17 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:17.582+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:17.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:17 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:17.582+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:17.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:17 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:17.582+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:17.891 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:17 smithi188 podman[73096]: 2024-03-31 23:30:17.618549135 +0000 UTC m=+5.583846279 container died affb58be7d765cca9d2f0027d54b6fb31ea22d25ed7b9f2e1479156cfe43390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326) 2024-03-31T23:30:17.891 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:17.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:17.892 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:17.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:17.892 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:17.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:17.892 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:17.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:17.892 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:17.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:18.218 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:17 smithi188 podman[73096]: 2024-03-31 23:30:17.97310677 +0000 UTC m=+5.938403917 container cleanup affb58be7d765cca9d2f0027d54b6fb31ea22d25ed7b9f2e1479156cfe43390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, ceph=True, RELEASE=squid-384f31f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:18.218 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:17 smithi188 bash[73096]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8 2024-03-31T23:30:18.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:18 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:18.115+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:18.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:18 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:18.115+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:18.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:18 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:18.115+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:18.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:18 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:18.115+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:18.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:18 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:18.115+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:18.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:18 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:18.115+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:18.501 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:18 smithi188 podman[73113]: 2024-03-31 23:30:18.249109534 +0000 UTC m=+0.628286929 container remove affb58be7d765cca9d2f0027d54b6fb31ea22d25ed7b9f2e1479156cfe43390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:18 smithi188 podman[73204]: 2024-03-31 23:30:18.484697908 +0000 UTC m=+0.017518166 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:18 smithi188 podman[73204]: 2024-03-31 23:30:18.600080188 +0000 UTC m=+0.132900440 container create 066a2822b0ce9c01b911a82ec28bc363a5ff6fb1d831d75e3b91d21f9b1432f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:18 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:18.500+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:18 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:18.500+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:18 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:18.500+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:18 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:18.500+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:18.820 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:18 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:18.500+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:19.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:18 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:18.627+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:19.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:18 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:18.627+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:19.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:18 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:18.627+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:19.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:18 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:18.627+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:19.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:18 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:18.627+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:19.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:18 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:18.627+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:19.108 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:18 smithi188 podman[73204]: 2024-03-31 23:30:18.819088553 +0000 UTC m=+0.351908812 container init 066a2822b0ce9c01b911a82ec28bc363a5ff6fb1d831d75e3b91d21f9b1432f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-31T23:30:19.108 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:18 smithi188 podman[73204]: 2024-03-31 23:30:18.822973983 +0000 UTC m=+0.355794251 container start 066a2822b0ce9c01b911a82ec28bc363a5ff6fb1d831d75e3b91d21f9b1432f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-03-31T23:30:19.109 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:18 smithi188 podman[73204]: 2024-03-31 23:30:18.902210017 +0000 UTC m=+0.435030289 container attach 066a2822b0ce9c01b911a82ec28bc363a5ff6fb1d831d75e3b91d21f9b1432f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, RELEASE=squid-384f31f) 2024-03-31T23:30:19.370 INFO:journalctl@ceph.osd.8.smithi188.stdout:Mar 31 23:30:19 smithi188 podman[73204]: 2024-03-31 23:30:19.109034758 +0000 UTC m=+0.641855023 container died 066a2822b0ce9c01b911a82ec28bc363a5ff6fb1d831d75e3b91d21f9b1432f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-31T23:30:19.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:19 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:19.116+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:19.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:19 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:19.116+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:19.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:19 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:19.116+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:19.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:19 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:19.116+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:19.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:19 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:19.116+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:19.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:19 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:19.116+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:19.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:19 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:19.548+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:19.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:19 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:19.548+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:19.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:19 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:19.548+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:19.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:19 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:19.548+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:19.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:19 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:19.548+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:19.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.8.service' 2024-03-31T23:30:19.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:19.884 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-03-31T23:30:19.884 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-03-31T23:30:19.884 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.9 2024-03-31T23:30:19.913 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:19.641+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:19.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:19.641+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:19.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:19.641+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:19.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:19.641+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:19.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:19.641+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:19.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:19.641+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:20.199 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:19 smithi042 systemd[1]: Stopping Ceph osd.9 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:20.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:20 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:20.067+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:20.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:20 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:20.067+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:20.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:20 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:20.067+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:20.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:20 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:20.067+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:20.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:20 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:20.067+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:20.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:20 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:20.067+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:20.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.198+0000 7f1cb4569700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:20.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.198+0000 7f1cb4569700 -1 osd.9 106 *** Got signal Terminated *** 2024-03-31T23:30:20.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.198+0000 7f1cb4569700 -1 osd.9 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:30:20.718 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:20.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:20.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:20.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:20.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:20.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:20.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:20.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:20.719 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:20.504+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:21.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.620+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:21.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.620+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:21.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.620+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:21.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.620+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:21.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.620+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:21.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:20 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:20.620+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:21.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:21 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:21.096+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:21.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:21 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:21.096+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:21.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:21 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:21.096+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:21.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:21 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:21.096+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:21.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:21 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:21.096+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:21.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:21 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:21.096+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:21.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:21 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:21.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:21.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:21 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:21.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:21.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:21 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:21.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:21.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:21 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:21.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:21.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:21 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:21.552+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:22.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:21 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:21.600+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:22.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:21 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:21.600+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:22.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:21 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:21.600+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:22.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:21 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:21.600+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:22.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:21 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:21.600+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:22.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:21 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:21.600+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:22.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:22 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:22.107+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:22.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:22 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:22.107+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:22.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:22 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:22.107+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:22.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:22 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:22.107+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:22.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:22 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:22.107+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:22.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:22 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:22.107+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:22.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:22.573+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:22.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:22.573+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:22.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:22.573+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:22.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:22.573+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:22.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:22.573+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:22.826 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:22 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:22.573+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:22.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:22 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:22.570+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:22.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:22 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:22.570+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:22.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:22 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:22.570+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:22.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:22 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:22.570+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:22.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:22 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:22.570+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:23.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:23 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:23.072+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:23.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:23 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:23.072+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:23.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:23 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:23.072+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:23.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:23 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:23.072+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:23.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:23 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:23.072+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:23.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:23 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:23.072+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:23.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:23 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:23.542+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:23.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:23 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:23.542+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:23.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:23 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:23.542+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:23.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:23 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:23.542+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:23.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:23 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:23.542+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:24.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:23.586+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:24.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:23.586+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:24.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:23.586+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:24.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:23.586+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:24.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:23.586+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:24.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:23 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:23.586+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:24.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:24 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:24.110+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:24.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:24 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:24.110+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:24.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:24 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:24.110+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:24.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:24 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:24.110+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:24.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:24 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:24.110+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:24.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:24 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:24.110+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:24.870 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:24.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:24.870 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:24.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:24.870 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:24.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:24.870 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:24.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:24.870 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:24.540+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:25.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:24 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:24.603+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.641391+0000 front 2024-03-31T23:29:11.641432+0000 (oldest deadline 2024-03-31T23:29:36.242337+0000) 2024-03-31T23:30:25.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:24 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:24.603+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.044053+0000 front 2024-03-31T23:29:19.043962+0000 (oldest deadline 2024-03-31T23:29:43.044396+0000) 2024-03-31T23:30:25.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:24 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:24.603+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:26.446607+0000 front 2024-03-31T23:29:26.446819+0000 (oldest deadline 2024-03-31T23:29:52.346566+0000) 2024-03-31T23:30:25.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:24 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:24.603+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:36.947759+0000 front 2024-03-31T23:29:36.947726+0000 (oldest deadline 2024-03-31T23:29:58.647883+0000) 2024-03-31T23:30:25.075 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:24 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:24.603+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:44.549089+0000 front 2024-03-31T23:29:44.549270+0000 (oldest deadline 2024-03-31T23:30:10.448954+0000) 2024-03-31T23:30:25.076 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:24 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9[64845]: 2024-03-31T23:30:24.603+0000 7f1cb0b5d700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:52.650314+0000 front 2024-03-31T23:29:52.650360+0000 (oldest deadline 2024-03-31T23:30:16.150315+0000) 2024-03-31T23:30:25.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:25.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:25.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:25.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:25.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:25.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:25.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:25 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:25.123+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:25.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:25 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:25.567+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:25.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:25 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:25.567+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:25.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:25 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:25.567+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:25.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:25 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:25.567+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:25.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:25 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:25.567+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:26.016 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:25 smithi042 podman[95205]: 2024-03-31 23:30:25.756998897 +0000 UTC m=+5.676138015 container died 3ca25a81d62f17a07150fd4e31a1fbd295a6529e0e5281fdb1104dc1d104b760 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:30:26.274 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 podman[95205]: 2024-03-31 23:30:26.090512173 +0000 UTC m=+6.009651282 container cleanup 3ca25a81d62f17a07150fd4e31a1fbd295a6529e0e5281fdb1104dc1d104b760 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:30:26.275 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 bash[95205]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.139+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.139+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.139+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.139+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.140+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.140+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:26.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:26 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:26.140+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:26.575 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 podman[95221]: 2024-03-31 23:30:26.274956407 +0000 UTC m=+0.517918596 container remove 3ca25a81d62f17a07150fd4e31a1fbd295a6529e0e5281fdb1104dc1d104b760 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:26.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:26.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:26.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:26.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:26.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:26.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:26.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:26.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:26.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:26.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:26.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:26 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:26.609+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:27.019 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 podman[95315]: 2024-03-31 23:30:26.709104211 +0000 UTC m=+0.111238414 container create c6162e05ae95fbb8d8f6efeb99751cb8e74587368a4c9cb04081b86b3c63c27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-31T23:30:27.019 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 podman[95315]: 2024-03-31 23:30:26.61579405 +0000 UTC m=+0.017928270 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:30:27.020 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 podman[95315]: 2024-03-31 23:30:26.936603503 +0000 UTC m=+0.338737719 container init c6162e05ae95fbb8d8f6efeb99751cb8e74587368a4c9cb04081b86b3c63c27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True) 2024-03-31T23:30:27.020 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:26 smithi042 podman[95315]: 2024-03-31 23:30:26.939666988 +0000 UTC m=+0.341801189 container start c6162e05ae95fbb8d8f6efeb99751cb8e74587368a4c9cb04081b86b3c63c27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:27.020 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:27 smithi042 podman[95315]: 2024-03-31 23:30:27.01975299 +0000 UTC m=+0.421887200 container attach c6162e05ae95fbb8d8f6efeb99751cb8e74587368a4c9cb04081b86b3c63c27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:27.305 INFO:journalctl@ceph.osd.9.smithi042.stdout:Mar 31 23:30:27 smithi042 podman[95315]: 2024-03-31 23:30:27.245945936 +0000 UTC m=+0.648080131 container died c6162e05ae95fbb8d8f6efeb99751cb8e74587368a4c9cb04081b86b3c63c27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:27.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:27 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:27.143+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:27.918 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.9.service' 2024-03-31T23:30:27.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:27 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:27.590+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:27.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:27 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:27.590+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:27.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:27 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:27.590+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:27.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:27 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:27.590+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:27.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:27 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:27.590+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:27.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:27 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:27.590+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:27.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:27.999 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-03-31T23:30:27.999 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-03-31T23:30:27.999 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.10 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 systemd[1]: Stopping Ceph osd.10 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.095+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:28.315 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.314+0000 7f61e71af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:28.316 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.314+0000 7f61e71af700 -1 osd.10 106 *** Got signal Terminated *** 2024-03-31T23:30:28.316 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:28 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:28.314+0000 7f61e71af700 -1 osd.10 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:30:28.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:28 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:28.630+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:28.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:28 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:28.630+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:28.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:28 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:28.630+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:28.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:28 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:28.630+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:28.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:28 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:28.630+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:28.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:28 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:28.630+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:29.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:29 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:29.124+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:29.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:29.589+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:29.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:29.589+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:29.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:29.589+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:29.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:29.589+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:29.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:29.589+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:29.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:29.589+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:30.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:30 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:30.077+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:30.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:30 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:30.638+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:31.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:31.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:31.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:31.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:31.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:31.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:31.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:31 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:31.033+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:31.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:31.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:31.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:31.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:31.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:31.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:31.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:31 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:31.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.008+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.009+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:32.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:32 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:32.009+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:32.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:32.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:32.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:32.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:32.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:32.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:32.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:32 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:32.681+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:33.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:12.512136+0000 front 2024-03-31T23:29:12.511995+0000 (oldest deadline 2024-03-31T23:29:34.812111+0000) 2024-03-31T23:30:33.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-03-31T23:29:19.513231+0000 front 2024-03-31T23:29:19.513255+0000 (oldest deadline 2024-03-31T23:29:44.813477+0000) 2024-03-31T23:30:33.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:28.314843+0000 front 2024-03-31T23:29:28.314713+0000 (oldest deadline 2024-03-31T23:29:51.214708+0000) 2024-03-31T23:30:33.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:35.916062+0000 front 2024-03-31T23:29:35.916149+0000 (oldest deadline 2024-03-31T23:29:58.215741+0000) 2024-03-31T23:30:33.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:41.116770+0000 front 2024-03-31T23:29:41.116750+0000 (oldest deadline 2024-03-31T23:30:06.416821+0000) 2024-03-31T23:30:33.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:53.318469+0000 front 2024-03-31T23:29:53.318561+0000 (oldest deadline 2024-03-31T23:30:17.418459+0000) 2024-03-31T23:30:33.423 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10[60946]: 2024-03-31T23:30:33.001+0000 7f61e37a3700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:59.719601+0000 front 2024-03-31T23:29:59.719691+0000 (oldest deadline 2024-03-31T23:30:25.019385+0000) 2024-03-31T23:30:33.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:33.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:33.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:33.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:33.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:33.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:33.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:33 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:33.648+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:34.124 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:33 smithi094 podman[73053]: 2024-03-31 23:30:33.844405832 +0000 UTC m=+5.650490659 container died 6c37e54fa5c106fe6983bfc300053c259c8b392fd276946fc2bf8ed8a0fa9dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-31T23:30:34.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:34 smithi094 podman[73053]: 2024-03-31 23:30:34.231553556 +0000 UTC m=+6.037638429 container cleanup 6c37e54fa5c106fe6983bfc300053c259c8b392fd276946fc2bf8ed8a0fa9dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:34.422 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:34 smithi094 bash[73053]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10 2024-03-31T23:30:34.842 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:34 smithi094 podman[73071]: 2024-03-31 23:30:34.507591459 +0000 UTC m=+0.653405389 container remove 6c37e54fa5c106fe6983bfc300053c259c8b392fd276946fc2bf8ed8a0fa9dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:34.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:34.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:34.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:34.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:34.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:34.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:34.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:34 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:34.645+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:35.102 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:34 smithi094 podman[73166]: 2024-03-31 23:30:34.745768718 +0000 UTC m=+0.017588046 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:30:35.103 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:34 smithi094 podman[73166]: 2024-03-31 23:30:34.866632381 +0000 UTC m=+0.138451749 container create 730a5524ed53c7633b145d2183e69387b5ab2a2cbb76d2c379627c0dc9776ac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_CLEAN=True) 2024-03-31T23:30:35.103 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:35 smithi094 podman[73166]: 2024-03-31 23:30:35.102537079 +0000 UTC m=+0.374356424 container init 730a5524ed53c7633b145d2183e69387b5ab2a2cbb76d2c379627c0dc9776ac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:35.389 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:35 smithi094 podman[73166]: 2024-03-31 23:30:35.106369232 +0000 UTC m=+0.378188559 container start 730a5524ed53c7633b145d2183e69387b5ab2a2cbb76d2c379627c0dc9776ac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-31T23:30:35.390 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:35 smithi094 podman[73166]: 2024-03-31 23:30:35.194354646 +0000 UTC m=+0.466173984 container attach 730a5524ed53c7633b145d2183e69387b5ab2a2cbb76d2c379627c0dc9776ac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:35.672 INFO:journalctl@ceph.osd.10.smithi094.stdout:Mar 31 23:30:35 smithi094 podman[73166]: 2024-03-31 23:30:35.389577092 +0000 UTC m=+0.661396414 container died 730a5524ed53c7633b145d2183e69387b5ab2a2cbb76d2c379627c0dc9776ac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-10-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-31T23:30:35.963 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.10.service' 2024-03-31T23:30:35.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:35.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:35.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:35.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:35.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:35.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:35.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:35 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:35.656+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:36.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:36.002 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-03-31T23:30:36.002 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-03-31T23:30:36.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.11 2024-03-31T23:30:36.302 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 systemd[1]: Stopping Ceph osd.11 for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.298+0000 7f47c269a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.298+0000 7f47c269a700 -1 osd.11 106 *** Got signal Terminated *** 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.298+0000 7f47c269a700 -1 osd.11 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:36.636 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:36.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:36.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:36.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:36 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:36.635+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:37.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:37.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:37.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:37.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:37.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:37.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:37.970 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:37 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:37.627+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:38.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:38.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:38 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:38.657+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6820 osd.8 since back 2024-03-31T23:30:16.767068+0000 front 2024-03-31T23:30:16.767105+0000 (oldest deadline 2024-03-31T23:30:37.867104+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:39.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:39 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:39.688+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6820 osd.8 since back 2024-03-31T23:30:16.767068+0000 front 2024-03-31T23:30:16.767105+0000 (oldest deadline 2024-03-31T23:30:37.867104+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-03-31T23:29:11.355288+0000 front 2024-03-31T23:29:11.355212+0000 (oldest deadline 2024-03-31T23:29:36.655089+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-03-31T23:29:27.459099+0000 front 2024-03-31T23:29:27.459047+0000 (oldest deadline 2024-03-31T23:29:53.359130+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-03-31T23:29:33.359606+0000 front 2024-03-31T23:29:33.359689+0000 (oldest deadline 2024-03-31T23:29:58.659659+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-03-31T23:29:43.360807+0000 front 2024-03-31T23:29:43.361022+0000 (oldest deadline 2024-03-31T23:30:08.660622+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-03-31T23:29:50.261969+0000 front 2024-03-31T23:29:50.261915+0000 (oldest deadline 2024-03-31T23:30:14.361931+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-03-31T23:29:58.764404+0000 front 2024-03-31T23:29:58.764416+0000 (oldest deadline 2024-03-31T23:30:25.764778+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-03-31T23:30:05.765374+0000 front 2024-03-31T23:30:05.765497+0000 (oldest deadline 2024-03-31T23:30:30.465387+0000) 2024-03-31T23:30:40.969 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:40 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11[61327]: 2024-03-31T23:30:40.662+0000 7f47bec8e700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.188:6820 osd.8 since back 2024-03-31T23:30:16.767068+0000 front 2024-03-31T23:30:16.767105+0000 (oldest deadline 2024-03-31T23:30:37.867104+0000) 2024-03-31T23:30:42.082 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:41 smithi188 podman[73322]: 2024-03-31 23:30:41.815043992 +0000 UTC m=+5.610371317 container died 23fa1b6c7d5898b1d251693b80d6afd8db9a4e782287e9e2ea57efa0b23cea37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-384f31f, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-31T23:30:42.448 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 podman[73322]: 2024-03-31 23:30:42.164164985 +0000 UTC m=+5.959492298 container cleanup 23fa1b6c7d5898b1d251693b80d6afd8db9a4e782287e9e2ea57efa0b23cea37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-31T23:30:42.448 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 bash[73322]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11 2024-03-31T23:30:42.718 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 podman[73340]: 2024-03-31 23:30:42.448503257 +0000 UTC m=+0.635823152 container remove 23fa1b6c7d5898b1d251693b80d6afd8db9a4e782287e9e2ea57efa0b23cea37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326) 2024-03-31T23:30:43.068 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 podman[73432]: 2024-03-31 23:30:42.685236798 +0000 UTC m=+0.017917024 image pull ec18d7baa60e8b1a0b126fbe5306acce11b1ed0ec5e3bcdddbf39b0a3c591791 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175 2024-03-31T23:30:43.068 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 podman[73432]: 2024-03-31 23:30:42.782657838 +0000 UTC m=+0.115338055 container create b877b1d4cf7a9662ef086ed09e5ffa47b0435de8239f07915bfddf82ba680d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-31T23:30:43.068 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 podman[73432]: 2024-03-31 23:30:42.985102228 +0000 UTC m=+0.317782454 container init b877b1d4cf7a9662ef086ed09e5ffa47b0435de8239f07915bfddf82ba680d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:43.068 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:42 smithi188 podman[73432]: 2024-03-31 23:30:42.988167749 +0000 UTC m=+0.320847968 container start b877b1d4cf7a9662ef086ed09e5ffa47b0435de8239f07915bfddf82ba680d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326) 2024-03-31T23:30:43.068 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:43 smithi188 podman[73432]: 2024-03-31 23:30:43.06832866 +0000 UTC m=+0.401008894 container attach b877b1d4cf7a9662ef086ed09e5ffa47b0435de8239f07915bfddf82ba680d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11-deactivate, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-03-31T23:30:43.468 INFO:journalctl@ceph.osd.11.smithi188.stdout:Mar 31 23:30:43 smithi188 podman[73432]: 2024-03-31 23:30:43.284830603 +0000 UTC m=+0.617510846 container died b877b1d4cf7a9662ef086ed09e5ffa47b0435de8239f07915bfddf82ba680d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:43.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@osd.11.service' 2024-03-31T23:30:43.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:43.913 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-03-31T23:30:43.913 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-31T23:30:43.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.a 2024-03-31T23:30:44.211 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:30:43 smithi042 systemd[1]: Stopping Ceph mds.a for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:44.575 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:30:44 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a[71706]: 2024-03-31T23:30:44.209+0000 7f48b695c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:44.575 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:30:44 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a[71706]: 2024-03-31T23:30:44.209+0000 7f48b695c700 -1 mds.a *** got signal Terminated *** 2024-03-31T23:30:48.075 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:30:47 smithi042 podman[95436]: 2024-03-31 23:30:47.810187197 +0000 UTC m=+3.693563712 container died d804080dd6db4c56300e7300147b072d1f30b9f0bde1f9bee92185a0b44f9f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:30:48.377 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:30:48 smithi042 podman[95436]: 2024-03-31 23:30:48.176827342 +0000 UTC m=+4.060203857 container cleanup d804080dd6db4c56300e7300147b072d1f30b9f0bde1f9bee92185a0b44f9f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:48.377 INFO:journalctl@ceph.mds.a.smithi042.stdout:Mar 31 23:30:48 smithi042 bash[95436]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-a 2024-03-31T23:30:48.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.a.service' 2024-03-31T23:30:48.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:48.639 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-31T23:30:48.639 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-03-31T23:30:48.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.d 2024-03-31T23:30:48.955 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:48 smithi042 systemd[1]: Stopping Ceph mds.d for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:49.325 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:48 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d[70747]: 2024-03-31T23:30:48.963+0000 7fa578f02700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:49.325 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:48 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d[70747]: 2024-03-31T23:30:48.963+0000 7fa578f02700 -1 mds.d *** got signal Terminated *** 2024-03-31T23:30:50.325 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:50 smithi042 podman[95557]: 2024-03-31 23:30:50.058420513 +0000 UTC m=+1.196815416 container stop 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:50.325 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:50 smithi042 podman[95557]: 2024-03-31 23:30:50.084089584 +0000 UTC m=+1.222484490 container died 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-31T23:30:50.682 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:50 smithi042 podman[95557]: 2024-03-31 23:30:50.439721795 +0000 UTC m=+1.578116698 container cleanup 8c677f38087f41c157a99d0c64ad17d33cfe3e1bb5b4e6732ed93e8707cb3748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-384f31f) 2024-03-31T23:30:50.682 INFO:journalctl@ceph.mds.d.smithi042.stdout:Mar 31 23:30:50 smithi042 bash[95557]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-d 2024-03-31T23:30:50.824 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.d.service' 2024-03-31T23:30:50.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:50.859 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-03-31T23:30:50.859 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-03-31T23:30:50.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.g 2024-03-31T23:30:51.202 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:50 smithi042 systemd[1]: Stopping Ceph mds.g for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:51.576 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g[71344]: 2024-03-31T23:30:51.201+0000 7f1946962700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:51.576 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:51 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g[71344]: 2024-03-31T23:30:51.201+0000 7f1946962700 -1 mds.g *** got signal Terminated *** 2024-03-31T23:30:55.539 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:55 smithi042 podman[95680]: 2024-03-31 23:30:55.211435337 +0000 UTC m=+4.123670942 container died b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-31T23:30:55.540 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:55 smithi042 podman[95680]: 2024-03-31 23:30:55.539662728 +0000 UTC m=+4.451898321 container cleanup b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-31T23:30:55.825 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:55 smithi042 bash[95680]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g 2024-03-31T23:30:55.825 INFO:journalctl@ceph.mds.g.smithi042.stdout:Mar 31 23:30:55 smithi042 podman[95694]: 2024-03-31 23:30:55.777825664 +0000 UTC m=+0.565061601 container remove b435f34e9bd1a8157f6da3c43c80b623d96249f428fb8782345cf78adbce6867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-g, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326) 2024-03-31T23:30:56.014 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.g.service' 2024-03-31T23:30:56.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:30:56.048 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-03-31T23:30:56.048 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-03-31T23:30:56.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.j 2024-03-31T23:30:56.325 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:30:56 smithi042 systemd[1]: Stopping Ceph mds.j for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:30:56.825 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:30:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j[70338]: 2024-03-31T23:30:56.379+0000 7f72d56fe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:30:56.825 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:30:56 smithi042 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j[70338]: 2024-03-31T23:30:56.379+0000 7f72d56fe700 -1 mds.j *** got signal Terminated *** 2024-03-31T23:30:59.575 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:30:59 smithi042 podman[95802]: 2024-03-31 23:30:59.272569378 +0000 UTC m=+2.999682027 container died fb2ead0503e3f69076870b4437606d0cf59a443621e33daef381542ddc36481c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-03-31T23:30:59.989 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:30:59 smithi042 podman[95802]: 2024-03-31 23:30:59.755503505 +0000 UTC m=+3.482616142 container cleanup fb2ead0503e3f69076870b4437606d0cf59a443621e33daef381542ddc36481c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-31T23:30:59.990 INFO:journalctl@ceph.mds.j.smithi042.stdout:Mar 31 23:30:59 smithi042 bash[95802]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-j 2024-03-31T23:31:00.103 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.j.service' 2024-03-31T23:31:00.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:00.137 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-03-31T23:31:00.137 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-31T23:31:00.137 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.b 2024-03-31T23:31:00.422 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:00 smithi094 systemd[1]: Stopping Ceph mds.b for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:00.686 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:31:00.440+0000 7fbb2b96e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:00.687 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:00 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b[66643]: 2024-03-31T23:31:00.440+0000 7fbb2b96e700 -1 mds.b *** got signal Terminated *** 2024-03-31T23:31:04.172 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:03 smithi094 podman[73273]: 2024-03-31 23:31:03.834495129 +0000 UTC m=+3.507241050 container died f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-31T23:31:04.535 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:04 smithi094 podman[73273]: 2024-03-31 23:31:04.350067082 +0000 UTC m=+4.022813002 container cleanup f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-31T23:31:04.535 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:04 smithi094 bash[73273]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b 2024-03-31T23:31:04.767 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.b.service' 2024-03-31T23:31:04.792 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:04 smithi094 podman[73299]: 2024-03-31 23:31:04.535571986 +0000 UTC m=+0.700487131 container remove f34074edf4736f517c3c37b1dd75999a4aebfecc815cdd29b22bc9f03fac0e1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-31T23:31:04.792 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:04 smithi094 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.b.service: Deactivated successfully. 2024-03-31T23:31:04.792 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:04 smithi094 systemd[1]: Stopped Ceph mds.b for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:31:04.792 INFO:journalctl@ceph.mds.b.smithi094.stdout:Mar 31 23:31:04 smithi094 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.b.service: Consumed 5min 53.192s CPU time. 2024-03-31T23:31:04.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:04.805 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-31T23:31:04.806 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-03-31T23:31:04.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.e 2024-03-31T23:31:05.122 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:31:04 smithi094 systemd[1]: Stopping Ceph mds.e for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:05.422 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:31:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e[66011]: 2024-03-31T23:31:05.120+0000 7fd0720dd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:05.422 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:31:05 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e[66011]: 2024-03-31T23:31:05.120+0000 7fd0720dd700 -1 mds.e *** got signal Terminated *** 2024-03-31T23:31:08.172 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:31:07 smithi094 podman[73404]: 2024-03-31 23:31:07.819471316 +0000 UTC m=+2.797176607 container died b3f19d8e60c2beefe2d19b2b4ed78dc000e23a9d93b4ae1adcf096b471c73566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, GIT_CLEAN=True) 2024-03-31T23:31:08.538 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:31:08 smithi094 podman[73404]: 2024-03-31 23:31:08.329276668 +0000 UTC m=+3.306981960 container cleanup b3f19d8e60c2beefe2d19b2b4ed78dc000e23a9d93b4ae1adcf096b471c73566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-31T23:31:08.538 INFO:journalctl@ceph.mds.e.smithi094.stdout:Mar 31 23:31:08 smithi094 bash[73404]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-e 2024-03-31T23:31:08.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.e.service' 2024-03-31T23:31:08.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:08.678 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-03-31T23:31:08.679 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-03-31T23:31:08.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.h 2024-03-31T23:31:08.922 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:31:08 smithi094 systemd[1]: Stopping Ceph mds.h for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:09.422 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:31:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:31:09.007+0000 7f15d9b58700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:09.422 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:31:09 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h[66321]: 2024-03-31T23:31:09.007+0000 7f15d9b58700 -1 mds.h *** got signal Terminated *** 2024-03-31T23:31:12.058 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:31:11 smithi094 podman[73524]: 2024-03-31 23:31:11.824574181 +0000 UTC m=+2.936393453 container died 427c02c34b76077a5a2d74aacd307a4cb20c2bef835196ece98a315c9bbc0605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-31T23:31:12.342 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:31:12 smithi094 podman[73524]: 2024-03-31 23:31:12.149555505 +0000 UTC m=+3.261374777 container cleanup 427c02c34b76077a5a2d74aacd307a4cb20c2bef835196ece98a315c9bbc0605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True) 2024-03-31T23:31:12.342 INFO:journalctl@ceph.mds.h.smithi094.stdout:Mar 31 23:31:12 smithi094 bash[73524]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-h 2024-03-31T23:31:12.564 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.h.service' 2024-03-31T23:31:12.599 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:12.599 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-03-31T23:31:12.599 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-03-31T23:31:12.599 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.k 2024-03-31T23:31:12.895 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:31:12 smithi094 systemd[1]: Stopping Ceph mds.k for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:13.172 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:31:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k[65692]: 2024-03-31T23:31:12.894+0000 7f58bbe1d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:13.172 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:31:12 smithi094 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k[65692]: 2024-03-31T23:31:12.894+0000 7f58bbe1d700 -1 mds.k *** got signal Terminated *** 2024-03-31T23:31:16.172 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:31:15 smithi094 podman[73646]: 2024-03-31 23:31:15.827569446 +0000 UTC m=+3.015230191 container died edc1229fc2b8b94d8ec0b3e303c65747d2d1b3d27bd66551ee3488705af4f9c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-384f31f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:31:16.672 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:31:16 smithi094 podman[73646]: 2024-03-31 23:31:16.444711021 +0000 UTC m=+3.632371764 container cleanup edc1229fc2b8b94d8ec0b3e303c65747d2d1b3d27bd66551ee3488705af4f9c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-384f31f, GIT_BRANCH=HEAD) 2024-03-31T23:31:16.672 INFO:journalctl@ceph.mds.k.smithi094.stdout:Mar 31 23:31:16 smithi094 bash[73646]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-k 2024-03-31T23:31:16.816 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.k.service' 2024-03-31T23:31:16.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:16.850 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-03-31T23:31:16.850 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-03-31T23:31:16.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.c 2024-03-31T23:31:17.135 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:16 smithi188 systemd[1]: Stopping Ceph mds.c for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:17.395 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:31:17.134+0000 7fc7d3b3c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:17.395 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:17 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c[66668]: 2024-03-31T23:31:17.134+0000 7fc7d3b3c700 -1 mds.c *** got signal Terminated *** 2024-03-31T23:31:20.152 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:19 smithi188 podman[73537]: 2024-03-31 23:31:19.820504159 +0000 UTC m=+2.776006798 container stop 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-384f31f, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-31T23:31:20.152 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:19 smithi188 podman[73537]: 2024-03-31 23:31:19.84643351 +0000 UTC m=+2.801936155 container died 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326) 2024-03-31T23:31:20.419 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:20 smithi188 podman[73537]: 2024-03-31 23:31:20.259983097 +0000 UTC m=+3.215485735 container cleanup 36dbe4bda118da852161b8c54f37a0461bb5465177e18872f2dd9be692f0f45c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-384f31f, ceph=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-31T23:31:20.419 INFO:journalctl@ceph.mds.c.smithi188.stdout:Mar 31 23:31:20 smithi188 bash[73537]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-c 2024-03-31T23:31:20.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.c.service' 2024-03-31T23:31:20.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:20.672 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-03-31T23:31:20.672 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-03-31T23:31:20.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.f 2024-03-31T23:31:20.968 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:31:20 smithi188 systemd[1]: Stopping Ceph mds.f for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:21.468 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:31:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:31:20.988+0000 7f48d12a8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:21.469 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:31:20 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f[66354]: 2024-03-31T23:31:20.988+0000 7f48d12a8700 -1 mds.f *** got signal Terminated *** 2024-03-31T23:31:24.088 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:31:23 smithi188 podman[73671]: 2024-03-31 23:31:23.827389592 +0000 UTC m=+2.938886846 container died fe1f16ec5f236205f8fad8633f9fbb7363b0bac33a5751aa89bf31e66992de72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f) 2024-03-31T23:31:24.447 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:31:24 smithi188 podman[73671]: 2024-03-31 23:31:24.188075158 +0000 UTC m=+3.299572400 container cleanup fe1f16ec5f236205f8fad8633f9fbb7363b0bac33a5751aa89bf31e66992de72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-31T23:31:24.447 INFO:journalctl@ceph.mds.f.smithi188.stdout:Mar 31 23:31:24 smithi188 bash[73671]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-f 2024-03-31T23:31:24.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.f.service' 2024-03-31T23:31:24.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:24.606 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-03-31T23:31:24.606 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-03-31T23:31:24.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.i 2024-03-31T23:31:24.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:24 smithi188 systemd[1]: Stopping Ceph mds.i for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:25.218 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:31:24.932+0000 7f39f8440700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:25.219 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:24 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i[66975]: 2024-03-31T23:31:24.932+0000 7f39f8440700 -1 mds.i *** got signal Terminated *** 2024-03-31T23:31:28.192 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:27 smithi188 podman[73794]: 2024-03-31 23:31:27.833797576 +0000 UTC m=+3.011810706 container died 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True) 2024-03-31T23:31:28.467 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:28 smithi188 podman[73794]: 2024-03-31 23:31:28.266023607 +0000 UTC m=+3.444036727 container cleanup 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-384f31f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-31T23:31:28.467 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:28 smithi188 bash[73794]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i 2024-03-31T23:31:28.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.i.service' 2024-03-31T23:31:28.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:28 smithi188 podman[73808]: 2024-03-31 23:31:28.467052717 +0000 UTC m=+0.636932165 container remove 35279880fdbfaf5b1b9db7434441fb85cb10988547decea59d661aef3ba453d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-i, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, RELEASE=squid-384f31f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-31T23:31:28.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:28 smithi188 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.i.service: Deactivated successfully. 2024-03-31T23:31:28.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:28 smithi188 systemd[1]: Stopped Ceph mds.i for 5a449cfe-efb3-11ee-b647-cb9ed24678a4. 2024-03-31T23:31:28.718 INFO:journalctl@ceph.mds.i.smithi188.stdout:Mar 31 23:31:28 smithi188 systemd[1]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.i.service: Consumed 4min 37.038s CPU time. 2024-03-31T23:31:28.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:28.723 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-03-31T23:31:28.724 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-03-31T23:31:28.724 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.l 2024-03-31T23:31:29.045 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:31:28 smithi188 systemd[1]: Stopping Ceph mds.l for 5a449cfe-efb3-11ee-b647-cb9ed24678a4... 2024-03-31T23:31:29.468 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:31:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l[66047]: 2024-03-31T23:31:29.044+0000 7fd74f502700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-31T23:31:29.468 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:31:29 smithi188 ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l[66047]: 2024-03-31T23:31:29.044+0000 7fd74f502700 -1 mds.l *** got signal Terminated *** 2024-03-31T23:31:32.162 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:31:31 smithi188 podman[73917]: 2024-03-31 23:31:31.822253349 +0000 UTC m=+2.884601864 container died 9dcc09fd4e75173330108e40cd54bee9df3b685226d174a0888a684036379083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-384f31f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-31T23:31:32.428 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:31:32 smithi188 podman[73917]: 2024-03-31 23:31:32.261040857 +0000 UTC m=+3.323389412 container cleanup 9dcc09fd4e75173330108e40cd54bee9df3b685226d174a0888a684036379083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b1424f33e755acdf9ce2c30ddd3b36062ff1d57e0fc8c0707b656ebc9ee5d175, name=ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-384f31f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True) 2024-03-31T23:31:32.429 INFO:journalctl@ceph.mds.l.smithi188.stdout:Mar 31 23:31:32 smithi188 bash[73917]: ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4-mds-l 2024-03-31T23:31:32.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a449cfe-efb3-11ee-b647-cb9ed24678a4@mds.l.service' 2024-03-31T23:31:32.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-31T23:31:32.667 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-03-31T23:31:32.667 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-31T23:31:32.864 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:31:35.223 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-31T23:31:35.414 INFO:teuthology.orchestra.run.smithi094.stdout:Deleting cluster with fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:31:37.965 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-31T23:31:38.159 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:31:40.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:31:40.586 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:31:40.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-31T23:31:40.649 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-31T23:31:40.651 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi042/crash 2024-03-31T23:31:40.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash -- . 2024-03-31T23:31:40.682 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-31T23:31:40.682 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2024-03-31T23:31:40.684 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi094/crash 2024-03-31T23:31:40.685 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash -- . 2024-03-31T23:31:40.725 INFO:teuthology.orchestra.run.smithi094.stderr:tar: /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-31T23:31:40.726 INFO:teuthology.orchestra.run.smithi094.stderr:tar: Error is not recoverable: exiting now 2024-03-31T23:31:40.727 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi188/crash 2024-03-31T23:31:40.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash -- . 2024-03-31T23:31:40.812 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /var/lib/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-31T23:31:40.812 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2024-03-31T23:31:40.813 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-31T23:31:40.813 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-31T23:31:40.849 INFO:tasks.cephadm:Compressing logs... 2024-03-31T23:31:40.850 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T23:31:40.892 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T23:31:40.895 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T23:31:40.919 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-03-31T23:31:40.920 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/cephadm.log 2024-03-31T23:31:40.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-03-31T23:31:40.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/cephadm.log: --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.g.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.j.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.g.log: gzip -5 --verbose 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: 90.0% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr: 94.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.j.log.gz 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T23:31:40.938 INFO:teuthology.orchestra.run.smithi042.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log: 84.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.9.log 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log: 89.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.d.log 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi188.stderr:: No such file or directory 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.l.log 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T23:31:40.939 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.l.log: --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.i.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.11.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.z.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.i.log: /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.8.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.z.log: gzip -5 --verbose 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr: -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.f.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.f.log: 90.2% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 83.8% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log: 89.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.c.log 2024-03-31T23:31:40.940 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.2.log: 91.9% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.z.log.gz 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:: No such file or directory 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.10.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.b.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.b.log: /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.k.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.h.log 2024-03-31T23:31:40.941 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-31T23:31:40.942 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.e.log 2024-03-31T23:31:40.942 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.7.log: 90.2% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T23:31:40.942 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-31T23:31:40.942 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T23:31:40.944 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.a.log 2024-03-31T23:31:40.945 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-31T23:31:40.948 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T23:31:40.949 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.d.log.gz 2024-03-31T23:31:40.950 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T23:31:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T23:31:40.960 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log: 83.9% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T23:31:40.962 INFO:teuthology.orchestra.run.smithi094.stderr: 91.8% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-31T23:31:40.964 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T23:31:40.966 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-31T23:31:40.972 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 90.9% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T23:31:41.001 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T23:31:41.295 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.a.log: 90.2% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-31T23:31:41.324 INFO:teuthology.orchestra.run.smithi042.stderr: 94.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.g.log.gz 2024-03-31T23:31:41.325 INFO:teuthology.orchestra.run.smithi042.stderr: 95.0% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.a.log.gz 2024-03-31T23:31:41.429 INFO:teuthology.orchestra.run.smithi188.stderr: 95.4% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.l.log.gz 2024-03-31T23:31:41.537 INFO:teuthology.orchestra.run.smithi188.stderr: 92.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-31T23:31:41.591 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-31T23:31:41.704 INFO:teuthology.orchestra.run.smithi094.stderr: 95.2% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.k.log.gz 2024-03-31T23:31:41.880 INFO:teuthology.orchestra.run.smithi042.stderr: 90.4% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-31T23:31:44.002 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.f.log.gz 2024-03-31T23:31:44.106 INFO:teuthology.orchestra.run.smithi094.stderr: 95.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.e.log.gz 2024-03-31T23:31:45.002 INFO:teuthology.orchestra.run.smithi188.stderr: 93.4% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.c.log.gz 2024-03-31T23:31:46.859 INFO:teuthology.orchestra.run.smithi094.stderr: 91.9% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.10.log.gz 2024-03-31T23:31:47.648 INFO:teuthology.orchestra.run.smithi094.stderr: 93.5% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.h.log.gz 2024-03-31T23:31:48.435 INFO:teuthology.orchestra.run.smithi188.stderr: 91.7% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.8.log.gz 2024-03-31T23:31:48.980 INFO:teuthology.orchestra.run.smithi188.stderr: 93.4% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.i.log.gz 2024-03-31T23:31:49.262 INFO:teuthology.orchestra.run.smithi042.stderr: 91.8% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-31T23:31:49.677 INFO:teuthology.orchestra.run.smithi094.stderr: 91.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-31T23:31:49.897 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-31T23:31:50.194 INFO:teuthology.orchestra.run.smithi042.stderr: 91.5% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-31T23:31:50.314 INFO:teuthology.orchestra.run.smithi188.stderr: 91.7% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.11.log.gz 2024-03-31T23:31:50.958 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.9.log.gz 2024-03-31T23:31:50.960 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-03-31T23:31:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m10.055s 2024-03-31T23:31:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m37.586s 2024-03-31T23:31:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m1.142s 2024-03-31T23:31:51.513 INFO:teuthology.orchestra.run.smithi094.stderr: 91.7% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-31T23:31:51.945 INFO:teuthology.orchestra.run.smithi188.stderr: 91.6% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-31T23:31:52.457 INFO:teuthology.orchestra.run.smithi188.stderr: 91.3% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-31T23:31:52.459 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-03-31T23:31:52.460 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m11.551s 2024-03-31T23:31:52.460 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m53.673s 2024-03-31T23:31:52.460 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m1.533s 2024-03-31T23:31:52.959 INFO:teuthology.orchestra.run.smithi094.stderr: 91.8% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-31T23:32:10.421 INFO:teuthology.orchestra.run.smithi094.stderr: 93.1% -- replaced with /var/log/ceph/5a449cfe-efb3-11ee-b647-cb9ed24678a4/ceph-mds.b.log.gz 2024-03-31T23:32:10.423 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-03-31T23:32:10.423 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m29.515s 2024-03-31T23:32:10.423 INFO:teuthology.orchestra.run.smithi094.stderr:user 1m15.118s 2024-03-31T23:32:10.423 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m2.252s 2024-03-31T23:32:10.423 INFO:tasks.cephadm:Archiving logs... 2024-03-31T23:32:10.424 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi042/log 2024-03-31T23:32:10.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T23:32:16.440 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi094/log 2024-03-31T23:32:16.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T23:32:26.570 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi188/log 2024-03-31T23:32:26.571 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T23:32:33.714 INFO:tasks.cephadm:Removing cluster... 2024-03-31T23:32:33.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --force 2024-03-31T23:32:33.913 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:32:34.218 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --force 2024-03-31T23:32:34.410 INFO:teuthology.orchestra.run.smithi094.stdout:Deleting cluster with fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:32:34.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a449cfe-efb3-11ee-b647-cb9ed24678a4 --force 2024-03-31T23:32:34.994 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: 5a449cfe-efb3-11ee-b647-cb9ed24678a4 2024-03-31T23:32:35.312 INFO:tasks.cephadm:Removing cephadm ... 2024-03-31T23:32:35.312 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-31T23:32:35.331 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-31T23:32:35.347 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-31T23:32:35.362 INFO:tasks.cephadm:Teardown complete 2024-03-31T23:32:35.363 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-31T23:32:35.375 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-31T23:32:35.375 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-31T23:32:35.378 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-31T23:32:35.390 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-31T23:32:35.502 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-31T23:32:35.513 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-31T23:32:35.514 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T23:32:35.518 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T23:32:35.521 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T23:32:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-03-31T23:32:35.532 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-03-31T23:32:35.534 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-03-31T23:32:35.535 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T23:32:35.535 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-03-31T23:32:35.535 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 49 +673us[ +673us] +/- 68ms 2024-03-31T23:32:35.535 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -395us[ -383us] +/- 74ms 2024-03-31T23:32:35.535 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -217us[ -205us] +/- 76ms 2024-03-31T23:32:35.535 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:32:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T23:32:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-03-31T23:32:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +631us[ +631us] +/- 68ms 2024-03-31T23:32:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv02.front.sepia.ceph.com 3 6 377 49 -411us[ -375us] +/- 74ms 2024-03-31T23:32:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -216us[ -180us] +/- 76ms 2024-03-31T23:32:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:32:35.539 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T23:32:35.539 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-03-31T23:32:35.539 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +639us[ +639us] +/- 68ms 2024-03-31T23:32:35.539 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -402us[ -371us] +/- 74ms 2024-03-31T23:32:35.539 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -221us[ -190us] +/- 76ms 2024-03-31T23:32:35.539 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T23:32:35.539 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-31T23:32:35.550 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-31T23:32:35.551 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-31T23:32:35.561 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-31T23:32:35.663 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-31T23:32:35.735 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-31T23:32:35.806 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T23:32:35.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:32:35.838 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T23:32:35.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:32:35.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T23:32:35.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:32:35.898 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-31T23:32:35.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-31T23:32:35.921 INFO:teuthology.task.internal:Duration was 1947.663593 seconds 2024-03-31T23:32:35.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-31T23:32:35.932 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-31T23:32:35.932 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-31T23:32:35.935 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-31T23:32:35.937 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-31T23:32:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T23:32:35.978 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T23:32:35.980 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T23:32:36.452 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-31T23:32:36.452 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-03-31T23:32:36.453 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-31T23:32:36.474 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-03-31T23:32:36.474 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-31T23:32:36.514 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-03-31T23:32:36.514 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-31T23:32:36.550 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-31T23:32:36.550 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-31T23:32:36.553 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-31T23:32:36.557 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-31T23:32:36.618 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-31T23:32:36.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-31T23:32:36.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-31T23:32:36.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-31T23:32:37.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-31T23:32:37.041 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-31T23:32:37.041 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-31T23:32:37.068 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-31T23:32:37.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-31T23:32:37.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-31T23:32:37.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-31T23:32:37.137 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-31T23:32:37.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-31T23:32:37.160 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-03-31T23:32:37.162 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-03-31T23:32:37.187 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-03-31T23:32:37.221 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-31T23:32:37.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:32:37.234 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-31T23:32:37.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:32:37.257 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-31T23:32:37.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:32:37.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-31T23:32:37.286 INFO:teuthology.task.internal:Transferring archived files... 2024-03-31T23:32:37.287 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi042 2024-03-31T23:32:37.287 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T23:32:37.330 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi094 2024-03-31T23:32:37.331 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T23:32:37.372 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125/remote/smithi188 2024-03-31T23:32:37.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T23:32:37.410 INFO:teuthology.task.internal:Removing archive directory... 2024-03-31T23:32:37.411 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-31T23:32:37.413 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-31T23:32:37.415 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-31T23:32:37.458 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-31T23:32:37.473 INFO:teuthology.task.internal:Not uploading archives. 2024-03-31T23:32:37.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-31T23:32:37.485 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-31T23:32:37.485 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-31T23:32:37.487 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-31T23:32:37.489 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-31T23:32:37.499 INFO:teuthology.orchestra.run.smithi042.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 31 23:32 /home/ubuntu/cephtest 2024-03-31T23:32:37.501 INFO:teuthology.orchestra.run.smithi094.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 31 23:32 /home/ubuntu/cephtest 2024-03-31T23:32:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 31 23:32 /home/ubuntu/cephtest 2024-03-31T23:32:37.514 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-31T23:32:37.526 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-31T23:32:37.549 INFO:teuthology.nuke:Checking targets against current locks 2024-03-31T23:32:37.577 DEBUG:teuthology.nuke:shortname: smithi042 2024-03-31T23:32:37.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T23:32:37.602 DEBUG:teuthology.nuke:shortname: smithi094 2024-03-31T23:32:37.602 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T23:32:37.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 22:51:27.015216', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvUcKd3SyFURE3ILlmt0Z6gGd4TVHZRQRPwyWFY/VKOqrg/OCaoq0ToE4Ian4POCp0giAwCNN9E0XfhKanAXK8='} 2024-03-31T23:32:37.626 DEBUG:teuthology.nuke:shortname: smithi188 2024-03-31T23:32:37.626 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T23:32:37.630 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 22:51:27.012404', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkZbnGd8pqbczM/ZBS2szp0CmZx2ppPWntj6csK09G7XQRPi093Syc86e/oc9AVHvEbJxEXhYk/GJJwuGmm530='} 2024-03-31T23:32:37.653 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 22:51:27.013941', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7MZzq2K1goC/DqjRUlf8fhx7WwqTPnMTpVFDWxGyRJ4v4bJqhXZRk0Bcp8DMa7wmwLTUkJZJScDwlLGlZXWug='} 2024-03-31T23:32:37.664 INFO:teuthology.orchestra.console.smithi042:Power off 2024-03-31T23:32:37.664 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T23:32:37.687 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2024-03-31T23:32:37.687 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:37.703 INFO:teuthology.orchestra.console.smithi094:Power off 2024-03-31T23:32:37.703 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T23:32:37.715 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-03-31T23:32:37.727 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2024-03-31T23:32:37.727 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:37.742 INFO:teuthology.orchestra.console.smithi188:Power off 2024-03-31T23:32:37.742 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T23:32:37.751 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-31T23:32:37.764 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-03-31T23:32:37.764 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:37.786 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-03-31T23:32:41.717 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:41.751 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:41.787 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:41.826 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-03-31T23:32:41.862 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-31T23:32:41.897 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-03-31T23:32:45.830 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:45.863 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:45.897 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:45.941 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-03-31T23:32:45.971 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-31T23:32:46.006 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-03-31T23:32:46.042 INFO:teuthology.orchestra.console.smithi042:Power off completed 2024-03-31T23:32:46.106 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-03-31T23:32:49.976 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T23:32:50.086 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-03-31T23:32:50.186 INFO:teuthology.orchestra.console.smithi094:Power off completed 2024-03-31T23:32:50.291 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} duration: 1947.6635930538177 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-03-31T23:32:50.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T23:32:50.377 INFO:teuthology.run:FAIL